2024-09-21T22:04:52.935 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T22:04:52.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T22:04:53.039 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914464' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1478 sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 sleep_before_teardown: 0 subset: 24/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJY0anuK1kvymuivETBT8HyNUkU2UgXVQMqj7WpKDpdOHnUJPB6lSxdHXB1XB+3KOT+EFUQ419Fwku1uBwYK1hU= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIM2kA0BPj3xV3IQ05Yfm8Wj/1b6GU7Yo4WsprsNqUXinZ9fG0SzwkpnjVEB4AANrcMyuVOLZ9iHjWZ6mGmkdEA= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 deep_copy: true ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_21:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T22:04:53.039 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-21T22:04:53.039 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-21T22:04:53.040 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T22:04:53.041 INFO:teuthology.task.internal:Checking packages... 2024-09-21T22:04:53.059 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4e45e6b490e6cbe082cdf155fea780438ec53fc7' 2024-09-21T22:04:53.060 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T22:04:53.060 INFO:teuthology.packaging:ref: None 2024-09-21T22:04:53.060 INFO:teuthology.packaging:tag: None 2024-09-21T22:04:53.060 INFO:teuthology.packaging:branch: squid 2024-09-21T22:04:53.060 INFO:teuthology.packaging:sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T22:04:53.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T22:04:53.272 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-21T22:04:53.273 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T22:04:53.284 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T22:04:53.284 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T22:04:53.363 INFO:teuthology.task.internal:Saving configuration 2024-09-21T22:04:53.375 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T22:04:53.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T22:04:53.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 21:59:43.070468', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJY0anuK1kvymuivETBT8HyNUkU2UgXVQMqj7WpKDpdOHnUJPB6lSxdHXB1XB+3KOT+EFUQ419Fwku1uBwYK1hU='} 2024-09-21T22:04:53.485 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 21:59:43.071943', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIM2kA0BPj3xV3IQ05Yfm8Wj/1b6GU7Yo4WsprsNqUXinZ9fG0SzwkpnjVEB4AANrcMyuVOLZ9iHjWZ6mGmkdEA='} 2024-09-21T22:04:53.485 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T22:04:53.492 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-21T22:04:53.492 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-21T22:04:53.492 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T22:04:53.575 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99e7cfb880>, signals=[15]) 2024-09-21T22:04:53.575 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T22:04:53.581 INFO:teuthology.task.internal:Opening connections... 2024-09-21T22:04:53.581 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:04:53.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:04:53.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:04:53.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:04:53.726 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T22:04:53.732 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-21T22:04:53.751 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-21T22:04:53.751 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-21T22:04:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-21T22:04:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-21T22:04:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-21T22:04:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-21T22:04:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T22:04:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T22:04:53.811 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-21T22:04:53.834 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-21T22:04:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-21T22:04:53.853 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-21T22:04:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-09-21T22:04:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-09-21T22:04:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T22:04:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T22:04:53.912 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-21T22:04:53.934 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T22:04:53.942 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T22:04:53.981 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T22:04:53.981 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-21T22:04:53.983 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-21T22:04:54.001 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T22:04:54.053 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T22:04:54.053 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-21T22:04:54.055 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-21T22:04:54.145 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T22:04:54.194 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T22:04:54.207 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T22:04:54.207 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T22:04:54.208 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T22:04:54.208 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T22:04:54.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:04:54.225 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T22:04:54.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:04:54.226 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-21T22:04:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-503.el9.x86_64 2024-09-21T22:04:54.283 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-503.el9.x86_64 2024-09-21T22:04:54.283 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-09-21T22:04:54.285 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-503.el9.x86_64 2024-09-21T22:04:54.285 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-503.el9.x86_64 2024-09-21T22:04:54.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-09-21T22:04:56.691 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T22:04:56.711 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T22:04:58.496 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-21T22:04:58.517 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-21T22:05:02.985 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T22:05:03.979 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-21T22:05:04.427 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-21T22:05:05.947 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-21T22:05:06.172 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-21T22:05:07.633 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-21T22:05:11.386 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T22:05:13.014 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T22:05:13.301 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T22:05:13.301 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T22:05:13.394 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 79 M 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 126 M 2024-09-21T22:05:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:05:13.604 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 468 kB/s | 36 kB 00:00 2024-09-21T22:05:14.946 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T22:05:14.946 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T22:05:15.050 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:05:15.055 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:05:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-21T22:05:15.055 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 79 M 2024-09-21T22:05:15.056 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 126 M 2024-09-21T22:05:15.057 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:05:15.182 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 347 kB/s | 36 kB 00:00 2024-09-21T22:05:17.404 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-21T22:05:17.449 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-21T22:05:20.783 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.1 MB/s | 29 MB 00:05 2024-09-21T22:05:20.971 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.9 MB/s | 29 MB 00:07 2024-09-21T22:05:21.083 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.8 MB/s | 35 MB 00:06 2024-09-21T22:05:21.083 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:05:21.083 INFO:teuthology.orchestra.run.smithi134.stdout:Total 13 MB/s | 79 MB 00:06 2024-09-21T22:05:21.760 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:05:22.108 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:05:22.108 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:05:22.520 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:08 2024-09-21T22:05:22.521 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:05:22.521 INFO:teuthology.orchestra.run.smithi149.stdout:Total 8.6 MB/s | 79 MB 00:09 2024-09-21T22:05:23.077 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:05:23.078 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:05:23.210 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:05:23.564 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:05:23.564 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:05:24.523 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:05:24.523 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:05:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:05:26.245 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T22:05:26.327 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T22:05:27.008 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:05:27.693 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T22:05:27.779 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T22:05:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T22:05:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T22:05:30.582 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T22:05:30.708 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T22:05:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T22:05:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:05:35.569 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T22:05:35.616 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:05:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:05:40.494 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:17.434 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:17.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T22:06:17.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T22:06:17.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:06:18.271 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:06:18.653 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T22:06:18.735 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:18.737 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T22:06:18.738 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T22:06:18.738 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T22:06:18.738 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T22:06:18.738 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T22:06:18.738 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T22:06:18.738 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T22:06:18.739 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T22:06:18.778 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:18.796 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T22:06:18.797 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T22:06:18.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-09-21T22:06:18.838 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-09-21T22:06:18.838 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 82.el9 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8274670 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-09-21T22:06:18.839 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:06:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T22:06:18.841 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T22:06:18.841 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-508.el9.x86_64 2024-09-21T22:06:18.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T22:06:19.131 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:19.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T22:06:19.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T22:06:19.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T22:06:19.449 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:06:19.981 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:06:20.338 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T22:06:20.416 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T22:06:20.416 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T22:06:20.417 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T22:06:20.417 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T22:06:20.417 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T22:06:20.417 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T22:06:20.417 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T22:06:20.417 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T22:06:20.475 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T22:06:20.475 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T22:06:20.476 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-09-21T22:06:20.508 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-09-21T22:06:20.508 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-09-21T22:06:20.508 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-09-21T22:06:20.508 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 82.el9 2024-09-21T22:06:20.508 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8274670 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-09-21T22:06:20.509 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-09-21T22:06:20.510 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:06:20.510 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T22:06:20.510 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T22:06:20.510 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T22:06:20.510 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-09-21T22:06:20.510 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:06:20.510 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T22:06:20.511 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T22:06:20.511 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-508.el9.x86_64 2024-09-21T22:06:20.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T22:06:20.933 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T22:06:20.968 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-21T22:06:20.970 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-21T22:06:20.986 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.x9Llu0vZS6 2024-09-21T22:06:20.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.x9Llu0vZS6 2024-09-21T22:06:21.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.x9Llu0vZS6 2024-09-21T22:06:21.202 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.x9Llu0vZS6 is 6KB 2024-09-21T22:06:21.217 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-21T22:06:21.251 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.x9Llu0vZS6 2024-09-21T22:06:21.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T22:06:21.337 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T22:06:21.337 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T22:06:21.337 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T22:06:21.337 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T22:06:21.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T22:06:21.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-21T22:06:22.660 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22686: grub2-probe 2024-09-21T22:06:22.660 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22686: grub2-probe 2024-09-21T22:06:22.696 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22686: grub2-probe 2024-09-21T22:06:22.696 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22686: grub2-probe 2024-09-21T22:06:22.901 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22734: grub2-probe 2024-09-21T22:06:22.901 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22734: grub2-probe 2024-09-21T22:06:22.943 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22734: grub2-probe 2024-09-21T22:06:22.943 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22734: grub2-probe 2024-09-21T22:06:23.100 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22782: grub2-probe 2024-09-21T22:06:23.100 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22782: grub2-probe 2024-09-21T22:06:23.137 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22782: grub2-probe 2024-09-21T22:06:23.137 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22782: grub2-probe 2024-09-21T22:06:23.298 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22830: grub2-probe 2024-09-21T22:06:23.298 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22830: grub2-probe 2024-09-21T22:06:23.328 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22830: grub2-probe 2024-09-21T22:06:23.328 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22830: grub2-probe 2024-09-21T22:06:23.494 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22878: grub2-probe 2024-09-21T22:06:23.494 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22878: grub2-probe 2024-09-21T22:06:23.525 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[35621]) leaked on vgs invocation. Parent PID 22878: grub2-probe 2024-09-21T22:06:23.525 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[34286]) leaked on vgs invocation. Parent PID 22878: grub2-probe 2024-09-21T22:06:23.687 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T22:06:23.705 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-21T22:06:23.707 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T22:06:23.723 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.NLIxJcNfOs 2024-09-21T22:06:23.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NLIxJcNfOs 2024-09-21T22:06:23.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.NLIxJcNfOs 2024-09-21T22:06:23.942 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.NLIxJcNfOs is 6KB 2024-09-21T22:06:23.963 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.NLIxJcNfOs 2024-09-21T22:06:23.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T22:06:24.041 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T22:06:24.041 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T22:06:24.041 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T22:06:24.041 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T22:06:24.042 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T22:06:24.201 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-09-21T22:06:51.517 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T22:06:51.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T22:06:51.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:06:54.206 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T22:06:54.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T22:06:54.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:07:10.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-21T22:07:12.627 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T22:07:19.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T22:07:19.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:07:21.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T22:07:21.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:07:22.127 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-21T22:07:24.687 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T22:07:34.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T22:07:34.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:07:36.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T22:07:36.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:07:55.119 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T22:08:06.658 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-21T22:08:06.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T22:08:06.995 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T22:08:06.996 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-21T22:08:07.010 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-508.el9.x86_64 2024-09-21T22:08:07.010 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T22:08:07.010 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T22:08:07.010 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T22:08:08.012 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T22:08:08.012 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T22:08:08.076 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-21T22:08:08.098 DEBUG:teuthology.parallel:result is None 2024-09-21T22:08:10.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T22:08:10.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:08:10.611 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T22:08:11.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T22:08:11.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T22:08:11.019 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T22:08:11.033 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-508.el9.x86_64 2024-09-21T22:08:11.033 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T22:08:11.033 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T22:08:11.033 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T22:08:12.034 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T22:08:12.034 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T22:08:12.130 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-09-21T22:08:12.147 DEBUG:teuthology.parallel:result is None 2024-09-21T22:08:12.147 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T22:08:12.153 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T22:08:12.154 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T22:08:12.156 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T22:08:12.172 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T22:08:12.208 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T22:08:12.271 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T22:08:12.271 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T22:08:12.274 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T22:08:12.306 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T22:08:12.324 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T22:08:12.325 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T22:08:12.345 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T22:08:12.374 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T22:08:12.374 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T22:08:12.384 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T22:08:12.385 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T22:08:12.387 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T22:08:12.393 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T22:08:12.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T22:08:12.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T22:08:12.455 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T22:08:12.463 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T22:08:12.463 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T22:08:12.496 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T22:08:12.511 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T22:08:12.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T22:08:12.651 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T22:08:12.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T22:08:12.775 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:08:12.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T22:08:12.841 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T22:08:12.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T22:08:12.931 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T22:08:13.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T22:08:13.054 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:08:13.054 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T22:08:13.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-21T22:08:13.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-21T22:08:13.165 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T22:08:13.207 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T22:08:13.679 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T22:08:13.687 INFO:teuthology.task.internal:Starting timer... 2024-09-21T22:08:13.687 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T22:08:13.752 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T22:08:13.785 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-21T22:08:13.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-21T22:08:13.831 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-21T22:08:13.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-09-21T22:08:13.899 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-09-21T22:08:13.900 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T22:08:13.900 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-21T22:08:13.927 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-21T22:08:13.927 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-09-21T22:08:14.010 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-09-21T22:08:14.010 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-09-21T22:08:14.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T22:08:14.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:08:14.041 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T22:08:14.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:08:14.067 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T22:08:14.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-21T22:08:14.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-09-21T22:08:14.161 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T22:08:14.171 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T22:08:14.183 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T22:08:14.184 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T22:12:04.411 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-21T22:12:04.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T22:12:04.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:12:04.488 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-21T22:12:04.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T22:12:04.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T22:12:04.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T22:12:04.644 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T22:12:04.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T22:12:04.727 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T22:12:04.737 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T22:12:04.737 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T22:12:04.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T22:12:04.740 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T22:12:04.740 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T22:12:04.767 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T22:12:04.781 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T22:12:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T22:12:04.805 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-21T22:12:04.813 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T22:12:04.817 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-21T22:12:04.831 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T22:12:04.838 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-09-21T22:12:04.844 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T22:12:04.850 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-09-21T22:12:04.864 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T22:12:04.879 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T22:12:04.902 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-21T22:12:04.905 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T22:12:04.905 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-21T22:12:04.905 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.905 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.905 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.905 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.932 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T22:12:04.936 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T22:12:04.936 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T22:12:04.936 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.936 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.936 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.936 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:12:04.937 INFO:teuthology.run_tasks:Running task install... 2024-09-21T22:12:04.953 DEBUG:teuthology.task.install:project ceph 2024-09-21T22:12:04.953 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-21T22:12:04.953 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'} 2024-09-21T22:12:04.953 INFO:teuthology.task.install:Using flavor: default 2024-09-21T22:12:04.959 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T22:12:04.959 INFO:teuthology.task.install:extra packages: [] 2024-09-21T22:12:04.959 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-21T22:12:04.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T22:12:04.961 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-21T22:12:04.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T22:12:05.103 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T22:12:05.103 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T22:12:05.112 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T22:12:05.112 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T22:12:05.215 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T22:12:05.216 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:12:05.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T22:12:05.225 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T22:12:05.226 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:12:05.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T22:12:05.242 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T22:12:05.242 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T22:12:05.253 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T22:12:05.253 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T22:12:05.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T22:12:05.319 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T22:12:05.383 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T22:12:05.394 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T22:12:05.447 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-21T22:12:05.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-21T22:12:05.458 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-09-21T22:12:05.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-09-21T22:12:05.678 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-21T22:12:05.703 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-09-21T22:12:05.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-09-21T22:12:05.733 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw 2024-09-21T22:12:06.263 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-21T22:12:06.284 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-21T22:12:06.549 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T22:12:06.568 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T22:12:06.823 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T22:12:06.836 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T22:12:07.286 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-21T22:12:08.406 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.3 MB 00:01 2024-09-21T22:12:09.104 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-21T22:12:10.349 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-21T22:12:13.588 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.5 MB 00:00 2024-09-21T22:12:14.616 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T22:12:15.156 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-21T22:12:16.793 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-21T22:12:16.834 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-21T22:12:18.554 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-21T22:12:22.224 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T22:12:23.860 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-21T22:12:24.467 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:12:24.471 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:12:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:12:24.471 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:12:24.471 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T22:12:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T22:12:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout:Install 30 Packages 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2024-09-21T22:12:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:24.475 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 60 M 2024-09-21T22:12:24.475 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:12:25.450 INFO:teuthology.orchestra.run.smithi149.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 8.1 MB/s | 5.4 MB 00:00 2024-09-21T22:12:25.558 INFO:teuthology.orchestra.run.smithi149.stdout:(2/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 14 MB/s | 11 MB 00:00 2024-09-21T22:12:25.584 INFO:teuthology.orchestra.run.smithi149.stdout:(3/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 188 kB/s | 25 kB 00:00 2024-09-21T22:12:25.617 INFO:teuthology.orchestra.run.smithi149.stdout:(4/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 13 MB/s | 751 kB 00:00 2024-09-21T22:12:25.643 INFO:teuthology.orchestra.run.smithi149.stdout:(5/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 8.4 MB/s | 507 kB 00:00 2024-09-21T22:12:25.702 INFO:teuthology.orchestra.run.smithi149.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 775 kB/s | 45 kB 00:00 2024-09-21T22:12:25.777 INFO:teuthology.orchestra.run.smithi149.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 1.8 MB/s | 136 kB 00:00 2024-09-21T22:12:25.860 INFO:teuthology.orchestra.run.smithi149.stdout:(8/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 22 MB/s | 5.3 MB 00:00 2024-09-21T22:12:25.886 INFO:teuthology.orchestra.run.smithi149.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 1.5 MB/s | 162 kB 00:00 2024-09-21T22:12:25.919 INFO:teuthology.orchestra.run.smithi149.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 5.4 MB/s | 321 kB 00:00 2024-09-21T22:12:25.944 INFO:teuthology.orchestra.run.smithi149.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-21T22:12:25.970 INFO:teuthology.orchestra.run.smithi149.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T22:12:26.069 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:12:26.086 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T22:12:26.087 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T22:12:26.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:12:26.089 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:12:26.090 INFO:teuthology.orchestra.run.smithi134.stdout:Install 30 Packages 2024-09-21T22:12:26.090 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-09-21T22:12:26.090 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:26.090 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 60 M 2024-09-21T22:12:26.090 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:12:26.170 INFO:teuthology.orchestra.run.smithi149.stdout:(13/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 15 MB/s | 21 MB 00:01 2024-09-21T22:12:26.754 INFO:teuthology.orchestra.run.smithi149.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-21T22:12:26.779 INFO:teuthology.orchestra.run.smithi149.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 128 kB/s | 107 kB 00:00 2024-09-21T22:12:26.821 INFO:teuthology.orchestra.run.smithi149.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 188 kB/s | 160 kB 00:00 2024-09-21T22:12:26.981 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 8.8 MB/s | 5.4 MB 00:00 2024-09-21T22:12:27.028 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 538 kB/s | 25 kB 00:00 2024-09-21T22:12:27.195 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 13 MB/s | 11 MB 00:00 2024-09-21T22:12:27.229 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 3.7 MB/s | 751 kB 00:00 2024-09-21T22:12:27.254 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 8.5 MB/s | 507 kB 00:00 2024-09-21T22:12:27.321 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 676 kB/s | 45 kB 00:00 2024-09-21T22:12:27.388 INFO:teuthology.orchestra.run.smithi149.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 75 kB/s | 42 kB 00:00 2024-09-21T22:12:27.521 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x8 18 MB/s | 21 MB 00:01 2024-09-21T22:12:27.546 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): python3-ceph-common-19.1.1-373.g4e45e6b 605 kB/s | 136 kB 00:00 2024-09-21T22:12:27.547 INFO:teuthology.orchestra.run.smithi149.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 381 kB/s | 292 kB 00:00 2024-09-21T22:12:27.580 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 2.7 MB/s | 162 kB 00:00 2024-09-21T22:12:27.605 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 5.4 MB/s | 321 kB 00:00 2024-09-21T22:12:27.613 INFO:teuthology.orchestra.run.smithi149.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 771 kB/s | 662 kB 00:00 2024-09-21T22:12:27.630 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.9 MB/s | 300 kB 00:00 2024-09-21T22:12:27.656 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T22:12:27.731 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_6 11 MB/s | 5.3 MB 00:00 2024-09-21T22:12:27.873 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2024-09-21T22:12:27.890 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 413 kB/s | 107 kB 00:00 2024-09-21T22:12:27.940 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 564 kB/s | 160 kB 00:00 2024-09-21T22:12:27.998 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 727 kB/s | 42 kB 00:00 2024-09-21T22:12:28.057 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-21T22:12:28.090 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-21T22:12:28.105 INFO:teuthology.orchestra.run.smithi149.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 64 kB/s | 36 kB 00:00 2024-09-21T22:12:28.116 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 612 kB/s | 36 kB 00:00 2024-09-21T22:12:28.141 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-21T22:12:28.147 INFO:teuthology.orchestra.run.smithi149.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 291 kB/s | 221 kB 00:00 2024-09-21T22:12:28.166 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-21T22:12:28.197 INFO:teuthology.orchestra.run.smithi149.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.3 MB/s | 308 kB 00:00 2024-09-21T22:12:28.231 INFO:teuthology.orchestra.run.smithi149.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 786 kB/s | 26 kB 00:00 2024-09-21T22:12:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 505 kB/s | 26 kB 00:00 2024-09-21T22:12:28.256 INFO:teuthology.orchestra.run.smithi149.stdout:(24/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-09-21T22:12:28.259 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-21T22:12:28.281 INFO:teuthology.orchestra.run.smithi149.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 985 kB/s | 49 kB 00:00 2024-09-21T22:12:28.284 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-09-21T22:12:28.300 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-21T22:12:28.340 INFO:teuthology.orchestra.run.smithi149.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 807 kB/s | 67 kB 00:00 2024-09-21T22:12:28.359 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T22:12:28.390 INFO:teuthology.orchestra.run.smithi149.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T22:12:28.440 INFO:teuthology.orchestra.run.smithi149.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-21T22:12:28.484 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-09-21T22:12:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-21T22:12:28.641 INFO:teuthology.orchestra.run.smithi149.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-21T22:12:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 16 MB/s | 3.4 MB 00:00 2024-09-21T22:12:28.741 INFO:teuthology.orchestra.run.smithi149.stdout:(30/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 11 MB/s | 3.4 MB 00:00 2024-09-21T22:12:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-21T22:12:28.800 INFO:teuthology.orchestra.run.smithi149.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-21T22:12:28.860 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 13 MB/s | 3.2 MB 00:00 2024-09-21T22:12:28.866 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:12:28.866 INFO:teuthology.orchestra.run.smithi134.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-21T22:12:28.925 INFO:teuthology.orchestra.run.smithi149.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 11 MB/s | 3.2 MB 00:00 2024-09-21T22:12:28.931 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:12:28.931 INFO:teuthology.orchestra.run.smithi149.stdout:Total 14 MB/s | 60 MB 00:04 2024-09-21T22:12:28.971 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:12:29.006 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:12:29.006 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:12:29.039 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:12:29.075 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:12:29.075 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:12:29.713 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:12:29.713 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:12:29.755 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:12:29.756 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:12:31.190 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:12:31.234 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:12:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T22:12:31.319 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T22:12:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T22:12:31.347 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T22:12:31.372 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T22:12:31.374 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T22:12:31.395 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T22:12:31.397 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T22:12:31.423 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T22:12:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T22:12:31.566 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T22:12:31.614 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T22:12:31.619 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T22:12:31.666 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T22:12:31.948 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T22:12:31.993 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T22:12:32.058 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T22:12:32.107 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T22:12:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T22:12:32.190 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T22:12:32.246 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T22:12:32.277 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T22:12:32.282 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T22:12:32.319 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T22:12:32.331 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T22:12:32.360 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T22:12:32.372 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T22:12:32.409 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T22:12:32.416 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T22:12:32.453 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T22:12:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T22:12:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T22:12:32.523 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T22:12:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T22:12:32.576 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T22:12:32.617 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T22:12:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T22:12:32.651 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T22:12:32.726 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T22:12:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T22:12:32.759 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T22:12:32.793 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T22:12:32.794 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T22:12:32.835 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T22:12:32.845 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T22:12:32.864 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T22:12:32.875 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T22:12:32.904 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T22:12:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T22:12:32.937 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T22:12:33.222 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T22:12:33.251 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T22:12:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T22:12:33.292 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T22:12:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T22:12:33.365 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T22:12:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T22:12:33.397 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T22:12:33.433 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T22:12:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T22:12:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T22:12:33.928 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T22:12:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T22:12:33.961 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T22:12:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T22:12:34.033 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T22:12:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T22:12:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T22:12:34.109 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T22:12:34.138 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T22:12:36.418 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T22:12:36.439 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T22:12:36.459 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T22:12:36.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T22:12:37.037 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T22:12:37.056 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T22:12:37.088 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T22:12:37.097 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T22:12:37.172 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T22:12:37.173 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T22:12:37.173 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T22:12:37.173 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T22:12:37.187 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T22:12:37.187 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T22:12:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:37.206 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T22:12:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-09-21T22:12:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T22:12:47.134 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-21T22:12:47.134 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-21T22:12:47.134 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-21T22:12:47.134 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-21T22:12:47.135 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-21T22:12:47.135 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-21T22:12:47.135 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-21T22:12:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:47.966 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T22:12:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T22:12:47.992 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:12:47.992 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T22:12:47.993 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T22:12:47.993 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T22:12:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T22:12:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T22:12:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T22:12:48.120 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T22:12:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T22:12:48.146 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:12:48.146 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T22:12:48.146 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T22:12:48.146 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T22:12:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T22:12:48.231 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T22:12:48.231 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T22:12:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T22:12:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T22:12:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T22:12:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T22:12:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T22:12:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T22:12:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T22:12:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T22:12:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T22:12:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T22:12:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T22:12:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T22:12:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T22:12:50.554 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T22:12:50.554 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:50.554 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-21T22:12:50.554 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.554 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.554 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:12:50.554 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T22:12:50.555 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.557 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T22:12:50.557 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T22:12:50.557 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T22:12:50.557 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T22:12:50.557 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T22:12:50.557 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:50.557 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:12:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T22:12:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:50.624 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-21T22:12:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T22:12:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:12:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T22:12:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T22:12:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T22:12:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T22:12:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T22:12:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:50.627 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:12:50.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-test 2024-09-21T22:12:50.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-09-21T22:12:51.471 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:29 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:12:51.559 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:12:51.604 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:12:51.604 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-21T22:12:51.605 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:12:51.606 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 49 M 2024-09-21T22:12:51.606 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 209 M 2024-09-21T22:12:51.606 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:12:51.691 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:12:51.692 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:12:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:12:51.692 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:12:51.692 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:12:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T22:12:51.692 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:12:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:12:51.693 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 49 M 2024-09-21T22:12:51.694 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 209 M 2024-09-21T22:12:51.694 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:12:51.784 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-21T22:12:51.851 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 730 kB/s | 163 kB 00:00 2024-09-21T22:12:51.876 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 693 kB/s | 64 kB 00:00 2024-09-21T22:12:52.251 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 542 kB/s | 163 kB 00:00 2024-09-21T22:12:52.584 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 479 kB/s | 304 kB 00:00 2024-09-21T22:12:52.618 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 174 kB/s | 64 kB 00:00 2024-09-21T22:12:53.160 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-21T22:12:53.162 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:12:53.163 INFO:teuthology.orchestra.run.smithi149.stdout:Total 32 MB/s | 49 MB 00:01 2024-09-21T22:12:53.190 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:12:53.210 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:12:53.210 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:12:53.583 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:12:53.584 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:12:54.120 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:12:54.211 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T22:12:54.251 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T22:12:54.278 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T22:12:54.560 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 19 MB/s | 49 MB 00:02 2024-09-21T22:12:54.562 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:12:54.563 INFO:teuthology.orchestra.run.smithi134.stdout:Total 17 MB/s | 49 MB 00:02 2024-09-21T22:12:54.591 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:12:54.610 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:12:54.611 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:12:54.982 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:12:54.982 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:12:55.540 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:12:55.614 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T22:12:55.659 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T22:12:55.687 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T22:12:58.872 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T22:12:58.944 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T22:13:00.323 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T22:13:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T22:13:01.361 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T22:13:01.361 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T22:13:01.361 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T22:13:01.361 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T22:13:01.665 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T22:13:01.665 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:01.666 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:01.666 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:01.666 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:01.666 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T22:13:01.666 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T22:13:01.666 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:01.666 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:01.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph 2024-09-21T22:13:02.539 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:40 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:02.683 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T22:13:02.686 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T22:13:02.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T22:13:02.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout:Install 37 Packages 2024-09-21T22:13:02.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:02.690 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 30 M 2024-09-21T22:13:02.690 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 108 M 2024-09-21T22:13:02.690 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T22:13:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T22:13:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T22:13:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T22:13:03.119 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:03.120 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:03.399 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-09-21T22:13:03.495 INFO:teuthology.orchestra.run.smithi149.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 52 kB/s | 6.6 kB 00:00 2024-09-21T22:13:03.704 INFO:teuthology.orchestra.run.smithi149.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.5 MB/s | 1.5 MB 00:00 2024-09-21T22:13:03.754 INFO:teuthology.orchestra.run.smithi149.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.2 MB/s | 2.4 MB 00:00 2024-09-21T22:13:03.854 INFO:teuthology.orchestra.run.smithi149.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.4 MB/s | 249 kB 00:00 2024-09-21T22:13:03.921 INFO:teuthology.orchestra.run.smithi149.stdout:(5/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-09-21T22:13:03.971 INFO:teuthology.orchestra.run.smithi149.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T22:13:04.000 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:40 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:04.038 INFO:teuthology.orchestra.run.smithi149.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T22:13:04.146 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T22:13:04.149 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T22:13:04.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T22:13:04.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout:Install 37 Packages 2024-09-21T22:13:04.152 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:04.153 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 30 M 2024-09-21T22:13:04.153 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 108 M 2024-09-21T22:13:04.153 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:13:04.222 INFO:teuthology.orchestra.run.smithi149.stdout:(8/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 33 MB/s | 17 MB 00:00 2024-09-21T22:13:04.247 INFO:teuthology.orchestra.run.smithi149.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 648 kB/s | 135 kB 00:00 2024-09-21T22:13:04.281 INFO:teuthology.orchestra.run.smithi149.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 3.4 MB/s | 1.2 MB 00:00 2024-09-21T22:13:04.323 INFO:teuthology.orchestra.run.smithi149.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-21T22:13:04.377 INFO:teuthology.orchestra.run.smithi149.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 810 kB/s | 125 kB 00:00 2024-09-21T22:13:04.410 INFO:teuthology.orchestra.run.smithi149.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-21T22:13:04.452 INFO:teuthology.orchestra.run.smithi149.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-21T22:13:04.477 INFO:teuthology.orchestra.run.smithi149.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 345 kB/s | 35 kB 00:00 2024-09-21T22:13:04.518 INFO:teuthology.orchestra.run.smithi149.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 883 kB/s | 172 kB 00:00 2024-09-21T22:13:04.553 INFO:teuthology.orchestra.run.smithi149.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 507 kB/s | 51 kB 00:00 2024-09-21T22:13:04.578 INFO:teuthology.orchestra.run.smithi149.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 414 kB/s | 42 kB 00:00 2024-09-21T22:13:04.645 INFO:teuthology.orchestra.run.smithi149.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 655 kB/s | 43 kB 00:00 2024-09-21T22:13:04.660 INFO:teuthology.orchestra.run.smithi134.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 52 kB/s | 6.6 kB 00:00 2024-09-21T22:13:04.670 INFO:teuthology.orchestra.run.smithi149.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-21T22:13:04.696 INFO:teuthology.orchestra.run.smithi149.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 126 kB/s | 22 kB 00:00 2024-09-21T22:13:04.730 INFO:teuthology.orchestra.run.smithi149.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T22:13:04.755 INFO:teuthology.orchestra.run.smithi149.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.2 MB/s | 358 kB 00:00 2024-09-21T22:13:04.772 INFO:teuthology.orchestra.run.smithi149.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 141 kB/s | 11 kB 00:00 2024-09-21T22:13:04.798 INFO:teuthology.orchestra.run.smithi149.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 270 kB/s | 18 kB 00:00 2024-09-21T22:13:04.822 INFO:teuthology.orchestra.run.smithi149.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 344 kB/s | 23 kB 00:00 2024-09-21T22:13:04.839 INFO:teuthology.orchestra.run.smithi149.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 289 kB/s | 19 kB 00:00 2024-09-21T22:13:04.864 INFO:teuthology.orchestra.run.smithi149.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 292 kB/s | 20 kB 00:00 2024-09-21T22:13:04.868 INFO:teuthology.orchestra.run.smithi134.stdout:(2/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 7.1 MB/s | 2.4 MB 00:00 2024-09-21T22:13:04.890 INFO:teuthology.orchestra.run.smithi149.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-21T22:13:04.910 INFO:teuthology.orchestra.run.smithi134.stdout:(3/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.1 MB/s | 1.5 MB 00:00 2024-09-21T22:13:04.915 INFO:teuthology.orchestra.run.smithi149.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T22:13:04.932 INFO:teuthology.orchestra.run.smithi149.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 393 kB/s | 16 kB 00:00 2024-09-21T22:13:04.957 INFO:teuthology.orchestra.run.smithi149.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-21T22:13:04.974 INFO:teuthology.orchestra.run.smithi149.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 853 kB/s | 36 kB 00:00 2024-09-21T22:13:04.994 INFO:teuthology.orchestra.run.smithi134.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.9 MB/s | 249 kB 00:00 2024-09-21T22:13:04.999 INFO:teuthology.orchestra.run.smithi149.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-21T22:13:05.025 INFO:teuthology.orchestra.run.smithi149.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-09-21T22:13:05.050 INFO:teuthology.orchestra.run.smithi149.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-09-21T22:13:05.075 INFO:teuthology.orchestra.run.smithi149.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-21T22:13:05.078 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:05.078 INFO:teuthology.orchestra.run.smithi149.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-21T22:13:05.224 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:05.265 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:05.265 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:05.369 INFO:teuthology.orchestra.run.smithi134.stdout:(5/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 34 MB/s | 17 MB 00:00 2024-09-21T22:13:05.436 INFO:teuthology.orchestra.run.smithi134.stdout:(6/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 6.1 MB/s | 4.7 MB 00:00 2024-09-21T22:13:05.678 INFO:teuthology.orchestra.run.smithi134.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 370 kB/s | 253 kB 00:00 2024-09-21T22:13:05.743 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:05.744 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:05.795 INFO:teuthology.orchestra.run.smithi134.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-21T22:13:05.920 INFO:teuthology.orchestra.run.smithi134.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 999 kB/s | 125 kB 00:00 2024-09-21T22:13:05.987 INFO:teuthology.orchestra.run.smithi134.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 193 kB/s | 106 kB 00:00 2024-09-21T22:13:06.037 INFO:teuthology.orchestra.run.smithi134.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-21T22:13:06.204 INFO:teuthology.orchestra.run.smithi134.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 869 kB/s | 188 kB 00:00 2024-09-21T22:13:06.238 INFO:teuthology.orchestra.run.smithi134.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 860 kB/s | 172 kB 00:00 2024-09-21T22:13:06.263 INFO:teuthology.orchestra.run.smithi134.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 594 kB/s | 35 kB 00:00 2024-09-21T22:13:06.288 INFO:teuthology.orchestra.run.smithi134.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-21T22:13:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:(16/37): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-09-21T22:13:06.355 INFO:teuthology.orchestra.run.smithi134.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-21T22:13:06.381 INFO:teuthology.orchestra.run.smithi134.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 451 kB/s | 42 kB 00:00 2024-09-21T22:13:06.439 INFO:teuthology.orchestra.run.smithi134.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 750 kB/s | 43 kB 00:00 2024-09-21T22:13:06.464 INFO:teuthology.orchestra.run.smithi134.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-21T22:13:06.506 INFO:teuthology.orchestra.run.smithi134.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-21T22:13:06.531 INFO:teuthology.orchestra.run.smithi134.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-21T22:13:06.557 INFO:teuthology.orchestra.run.smithi134.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 712 kB/s | 18 kB 00:00 2024-09-21T22:13:06.582 INFO:teuthology.orchestra.run.smithi134.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 934 kB/s | 23 kB 00:00 2024-09-21T22:13:06.607 INFO:teuthology.orchestra.run.smithi134.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2024-09-21T22:13:06.666 INFO:teuthology.orchestra.run.smithi134.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 233 kB/s | 19 kB 00:00 2024-09-21T22:13:06.699 INFO:teuthology.orchestra.run.smithi134.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 214 kB/s | 20 kB 00:00 2024-09-21T22:13:06.725 INFO:teuthology.orchestra.run.smithi134.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 907 kB/s | 46 kB 00:00 2024-09-21T22:13:06.750 INFO:teuthology.orchestra.run.smithi134.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T22:13:06.775 INFO:teuthology.orchestra.run.smithi134.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 682 kB/s | 16 kB 00:00 2024-09-21T22:13:06.809 INFO:teuthology.orchestra.run.smithi134.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-21T22:13:06.843 INFO:teuthology.orchestra.run.smithi134.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-09-21T22:13:06.868 INFO:teuthology.orchestra.run.smithi134.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 611 kB/s | 36 kB 00:00 2024-09-21T22:13:06.910 INFO:teuthology.orchestra.run.smithi134.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-21T22:13:06.943 INFO:teuthology.orchestra.run.smithi134.stdout:(35/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-21T22:13:07.010 INFO:teuthology.orchestra.run.smithi134.stdout:(36/37): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-21T22:13:07.084 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T22:13:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T22:13:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T22:13:07.285 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T22:13:07.330 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T22:13:07.362 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T22:13:07.454 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T22:13:07.534 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T22:13:07.583 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T22:13:07.617 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T22:13:07.647 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T22:13:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T22:13:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T22:13:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T22:13:07.791 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T22:13:07.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T22:13:07.881 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T22:13:07.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T22:13:07.989 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T22:13:08.137 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T22:13:08.217 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T22:13:08.270 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T22:13:08.308 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T22:13:08.374 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T22:13:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T22:13:08.617 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T22:13:08.670 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T22:13:08.749 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T22:13:08.838 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T22:13:08.878 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T22:13:08.952 INFO:teuthology.orchestra.run.smithi134.stdout:(37/37): python3-zc-lockfile-2.0-10.el9.noarch. 9.8 kB/s | 20 kB 00:02 2024-09-21T22:13:08.955 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:08.956 INFO:teuthology.orchestra.run.smithi134.stdout:Total 6.3 MB/s | 30 MB 00:04 2024-09-21T22:13:08.995 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T22:13:09.109 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:13:09.150 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:13:09.150 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:13:09.150 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T22:13:09.180 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T22:13:09.206 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T22:13:09.206 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:09.207 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T22:13:09.207 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T22:13:09.207 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T22:13:09.207 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:09.632 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:13:09.632 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:13:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T22:13:10.666 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T22:13:10.667 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:10.667 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T22:13:10.667 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T22:13:10.667 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T22:13:10.667 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:11.009 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:13:11.066 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T22:13:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T22:13:11.115 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T22:13:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T22:13:11.139 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T22:13:11.139 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:11.139 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T22:13:11.139 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T22:13:11.139 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T22:13:11.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T22:13:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T22:13:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T22:13:11.366 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T22:13:11.366 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T22:13:11.389 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T22:13:11.389 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:11.389 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T22:13:11.390 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T22:13:11.390 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T22:13:11.390 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:11.436 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T22:13:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T22:13:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T22:13:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T22:13:11.542 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T22:13:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T22:13:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T22:13:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T22:13:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T22:13:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T22:13:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T22:13:11.800 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T22:13:11.872 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T22:13:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T22:13:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T22:13:12.144 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T22:13:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T22:13:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T22:13:12.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T22:13:12.489 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T22:13:12.543 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T22:13:12.621 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T22:13:12.709 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T22:13:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T22:13:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T22:13:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T22:13:13.061 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T22:13:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T22:13:13.088 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:13.088 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T22:13:13.088 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T22:13:13.088 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T22:13:13.088 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T22:13:13.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T22:13:13.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T22:13:13.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T22:13:13.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:14.327 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T22:13:14.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T22:13:14.329 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:14.330 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T22:13:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T22:13:14.556 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:14.556 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T22:13:14.556 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T22:13:14.556 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T22:13:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:14.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-base 2024-09-21T22:13:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T22:13:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T22:13:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T22:13:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T22:13:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T22:13:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:15.247 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T22:13:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T22:13:15.271 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:15.271 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T22:13:15.271 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T22:13:15.271 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T22:13:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:15.281 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T22:13:15.371 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:13:15.415 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:15.416 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:13:15.416 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:15.478 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install cephadm 2024-09-21T22:13:16.064 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:16.197 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 765 k 2024-09-21T22:13:16.198 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 772 k 2024-09-21T22:13:16.199 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:16.457 INFO:teuthology.orchestra.run.smithi149.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-21T22:13:16.457 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:16.458 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-21T22:13:16.458 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:16.463 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:16.463 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:16.469 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:16.469 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:16.540 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:17.012 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T22:13:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T22:13:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T22:13:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T22:13:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T22:13:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T22:13:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T22:13:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T22:13:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T22:13:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T22:13:17.121 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:17.480 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:17.739 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:17.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T22:13:17.984 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T22:13:17.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T22:13:17.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:17.987 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:18.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-09-21T22:13:18.553 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:18.691 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:18.691 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:18.691 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T22:13:18.691 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:18.691 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:18.692 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T22:13:18.692 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:18.692 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:18.692 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:18.692 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:13:18.692 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:18.693 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 145 k 2024-09-21T22:13:18.693 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 435 k 2024-09-21T22:13:18.693 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:18.891 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 732 kB/s | 145 kB 00:00 2024-09-21T22:13:18.891 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:18.892 INFO:teuthology.orchestra.run.smithi149.stdout:Total 727 kB/s | 145 kB 00:00 2024-09-21T22:13:18.892 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:18.900 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:18.900 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:18.906 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:18.956 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:18.956 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:18.995 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:13:19.037 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:19.038 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:13:19.038 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:19.100 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:19.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-09-21T22:13:19.167 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T22:13:19.192 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T22:13:19.192 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:19.192 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T22:13:19.192 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:19.683 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:19.814 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:13:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:19.816 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 765 k 2024-09-21T22:13:19.816 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 772 k 2024-09-21T22:13:19.816 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:13:20.069 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T22:13:20.069 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:20.069 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:20.069 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:20.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:20.070 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:20.097 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.7 MB/s | 765 kB 00:00 2024-09-21T22:13:20.098 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:20.098 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-21T22:13:20.098 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:13:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:13:20.104 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:13:20.109 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:13:20.109 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:13:20.183 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:13:20.294 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr 2024-09-21T22:13:20.666 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:20.901 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:20.995 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:13:21.038 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:21.039 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:13:21.039 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:21.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T22:13:21.175 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:21.450 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:13:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:21.450 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:21.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T22:13:21.699 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:21.831 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T22:13:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-09-21T22:13:21.834 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:21.835 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 8.7 M 2024-09-21T22:13:21.835 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 105 M 2024-09-21T22:13:21.835 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:22.265 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:22.400 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:13:22.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:22.402 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 145 k 2024-09-21T22:13:22.402 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 435 k 2024-09-21T22:13:22.402 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:13:22.586 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 787 kB/s | 145 kB 00:00 2024-09-21T22:13:22.587 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:22.587 INFO:teuthology.orchestra.run.smithi134.stdout:Total 780 kB/s | 145 kB 00:00 2024-09-21T22:13:22.587 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:13:22.595 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:13:22.595 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:13:22.652 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:13:22.652 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:13:22.670 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 190 kB/s | 32 kB 00:00 2024-09-21T22:13:22.695 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 85 kB/s | 16 kB 00:00 2024-09-21T22:13:22.802 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:13:22.870 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-09-21T22:13:22.896 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T22:13:22.921 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:22.937 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 8.2 MB/s | 3.6 MB 00:00 2024-09-21T22:13:22.971 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-21T22:13:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 382 kB/s | 19 kB 00:00 2024-09-21T22:13:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.7 MB/s | 863 kB 00:00 2024-09-21T22:13:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.9 MB/s | 548 kB 00:00 2024-09-21T22:13:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.7 MB/s | 31 kB 00:00 2024-09-21T22:13:23.197 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T22:13:23.222 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.1 MB/s | 144 kB 00:00 2024-09-21T22:13:23.373 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.9 MB/s | 2.0 MB 00:00 2024-09-21T22:13:23.377 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:23.377 INFO:teuthology.orchestra.run.smithi149.stdout:Total 5.6 MB/s | 8.7 MB 00:01 2024-09-21T22:13:23.428 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:23.446 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:23.446 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:23.646 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:23.646 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:23.799 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T22:13:23.799 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:23.799 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:13:23.799 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:13:23.799 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:23.799 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:24.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-09-21T22:13:24.201 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:24.298 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T22:13:24.333 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T22:13:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T22:13:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T22:13:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T22:13:24.634 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:24.644 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T22:13:24.725 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:13:24.739 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T22:13:24.767 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:24.768 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:13:24.769 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:24.782 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T22:13:24.811 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T22:13:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T22:13:24.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T22:13:25.422 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:02 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:25.553 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:25.554 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:25.554 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:13:25.554 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:25.554 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:13:25.554 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T22:13:25.554 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:25.555 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:13:25.556 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:25.556 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-09-21T22:13:25.556 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:25.556 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 8.7 M 2024-09-21T22:13:25.556 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 105 M 2024-09-21T22:13:25.556 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:13:25.903 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T22:13:25.945 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T22:13:26.047 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 206 kB/s | 32 kB 00:00 2024-09-21T22:13:26.072 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 91 kB/s | 16 kB 00:00 2024-09-21T22:13:26.239 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-21T22:13:26.306 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 8.6 MB/s | 3.6 MB 00:00 2024-09-21T22:13:26.348 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-21T22:13:26.399 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.3 MB/s | 863 kB 00:00 2024-09-21T22:13:26.432 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 253 kB/s | 19 kB 00:00 2024-09-21T22:13:26.474 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.5 MB/s | 144 kB 00:00 2024-09-21T22:13:26.499 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.8 MB/s | 548 kB 00:00 2024-09-21T22:13:26.525 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 613 kB/s | 31 kB 00:00 2024-09-21T22:13:26.550 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T22:13:26.708 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.7 MB/s | 2.0 MB 00:00 2024-09-21T22:13:26.713 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:26.713 INFO:teuthology.orchestra.run.smithi134.stdout:Total 7.5 MB/s | 8.7 MB 00:01 2024-09-21T22:13:26.761 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:13:26.777 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:13:26.778 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:13:26.984 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:13:26.984 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T22:13:27.096 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T22:13:27.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T22:13:27.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T22:13:27.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T22:13:27.413 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:27.414 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:27.524 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:13:27.592 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T22:13:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T22:13:27.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T22:13:27.673 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T22:13:27.704 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T22:13:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T22:13:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T22:13:28.041 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T22:13:28.091 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T22:13:28.120 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T22:13:28.168 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T22:13:28.235 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:06 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:28.368 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T22:13:28.370 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-09-21T22:13:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:28.372 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 38 M 2024-09-21T22:13:28.372 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 212 M 2024-09-21T22:13:28.372 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:29.114 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-37 16 MB/s | 7.4 MB 00:00 2024-09-21T22:13:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T22:13:29.231 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-21T22:13:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T22:13:29.481 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 230 kB/s | 191 kB 00:00 2024-09-21T22:13:29.565 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 220 kB/s | 18 kB 00:00 2024-09-21T22:13:29.632 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 816 kB/s | 801 kB 00:00 2024-09-21T22:13:29.657 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-21T22:13:29.849 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-21T22:13:29.983 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.0 MB/s | 3.0 MB 00:00 2024-09-21T22:13:30.067 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T22:13:30.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T22:13:30.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T22:13:30.865 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T22:13:30.866 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T22:13:30.867 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T22:13:30.867 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T22:13:30.867 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:30.867 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:30.933 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.8 MB/s | 4.9 MB 00:01 2024-09-21T22:13:31.136 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T22:13:31.375 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-09-21T22:13:31.718 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:08 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:31.850 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T22:13:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-09-21T22:13:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:31.853 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 38 M 2024-09-21T22:13:31.853 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 212 M 2024-09-21T22:13:31.853 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:13:32.315 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-21T22:13:32.423 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-21T22:13:32.457 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-21T22:13:32.590 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): ceph-mgr-diskprediction-local-19.1.1-37 16 MB/s | 7.4 MB 00:00 2024-09-21T22:13:32.607 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 121 kB/s | 18 kB 00:00 2024-09-21T22:13:32.699 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-21T22:13:32.775 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-09-21T22:13:32.776 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:32.777 INFO:teuthology.orchestra.run.smithi149.stdout:Total 8.7 MB/s | 38 MB 00:04 2024-09-21T22:13:32.808 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T22:13:33.131 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:33.158 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:33.159 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:33.491 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-21T22:13:33.616 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:33.616 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:33.633 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-21T22:13:34.407 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:34.479 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T22:13:34.533 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T22:13:34.575 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.5 MB/s | 4.9 MB 00:01 2024-09-21T22:13:34.636 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T22:13:34.650 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.8 MB/s | 5.1 MB 00:01 2024-09-21T22:13:34.667 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T22:13:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T22:13:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T22:13:34.959 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T22:13:35.619 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T22:13:35.747 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T22:13:36.994 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T22:13:38.036 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T22:13:38.066 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T22:13:40.619 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T22:13:40.620 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T22:13:40.620 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T22:13:40.942 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-21T22:13:40.943 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:40.944 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.2 MB/s | 38 MB 00:09 2024-09-21T22:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T22:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T22:13:41.008 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:41.009 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:41.299 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:13:41.326 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:13:41.326 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:13:41.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-rook 2024-09-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:13:41.753 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:13:42.042 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:20 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:42.177 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T22:13:42.178 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout:Install 13 Packages 2024-09-21T22:13:42.179 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:42.180 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 2.2 M 2024-09-21T22:13:42.180 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 26 M 2024-09-21T22:13:42.180 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:42.483 INFO:teuthology.orchestra.run.smithi149.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 281 kB/s | 26 kB 00:00 2024-09-21T22:13:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:13:42.516 INFO:teuthology.orchestra.run.smithi149.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 154 kB/s | 19 kB 00:00 2024-09-21T22:13:42.566 INFO:teuthology.orchestra.run.smithi149.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-21T22:13:42.584 INFO:teuthology.orchestra.run.smithi149.stdout:(4/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 257 kB/s | 49 kB 00:00 2024-09-21T22:13:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T22:13:42.609 INFO:teuthology.orchestra.run.smithi149.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-21T22:13:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T22:13:42.642 INFO:teuthology.orchestra.run.smithi149.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-09-21T22:13:42.668 INFO:teuthology.orchestra.run.smithi149.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 550 kB/s | 32 kB 00:00 2024-09-21T22:13:42.693 INFO:teuthology.orchestra.run.smithi149.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 288 kB/s | 14 kB 00:00 2024-09-21T22:13:42.710 INFO:teuthology.orchestra.run.smithi149.stdout:(9/13): python3-requests-oauthlib-1.3.0-12.el9. 424 kB/s | 54 kB 00:00 2024-09-21T22:13:42.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T22:13:42.744 INFO:teuthology.orchestra.run.smithi149.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.9 MB/s | 220 kB 00:00 2024-09-21T22:13:42.769 INFO:teuthology.orchestra.run.smithi149.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-21T22:13:42.775 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T22:13:42.794 INFO:teuthology.orchestra.run.smithi149.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-21T22:13:42.836 INFO:teuthology.orchestra.run.smithi149.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-21T22:13:42.840 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:42.840 INFO:teuthology.orchestra.run.smithi149.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-21T22:13:42.903 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:42.919 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:42.919 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:42.959 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T22:13:42.990 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T22:13:43.010 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:43.011 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:43.058 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T22:13:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:43.670 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T22:13:43.706 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T22:13:43.729 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T22:13:43.785 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T22:13:43.819 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T22:13:43.838 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T22:13:43.880 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T22:13:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T22:13:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T22:13:44.140 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T22:13:44.881 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T22:13:44.937 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T22:13:44.971 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T22:13:45.019 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T22:13:45.036 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T22:13:45.040 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T22:13:45.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T22:13:45.773 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T22:13:45.773 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T22:13:45.773 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T22:13:45.773 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T22:13:46.068 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T22:13:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T22:13:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:46.109 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:46.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T22:13:46.945 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:24 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:47.081 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2024-09-21T22:13:47.082 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 7.0 M 2024-09-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 33 M 2024-09-21T22:13:47.083 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:47.397 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 701 kB/s | 146 kB 00:00 2024-09-21T22:13:47.522 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-09-21T22:13:47.556 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-21T22:13:47.589 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-21T22:13:48.056 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 286 kB/s | 248 kB 00:00 2024-09-21T22:13:48.634 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T22:13:48.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T22:13:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T22:13:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:49.097 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:13:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T22:13:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T22:13:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:49.098 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:49.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-09-21T22:13:50.073 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.1 MB/s | 6.0 MB 00:02 2024-09-21T22:13:50.075 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:50.075 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.3 MB/s | 7.0 MB 00:02 2024-09-21T22:13:50.093 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:27 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:50.149 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:50.161 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:50.161 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:50.225 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:50.237 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:50.237 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:13:50.237 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:50.237 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:13:50.237 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T22:13:50.237 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:13:50.237 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:50.238 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:13:50.239 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:50.239 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-09-21T22:13:50.239 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:50.239 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.2 M 2024-09-21T22:13:50.239 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-09-21T22:13:50.239 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:13:50.262 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:50.262 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:50.487 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 284 kB/s | 49 kB 00:00 2024-09-21T22:13:50.581 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:50.763 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T22:13:50.807 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T22:13:50.838 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 37 kB/s | 19 kB 00:00 2024-09-21T22:13:50.879 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 45 kB/s | 26 kB 00:00 2024-09-21T22:13:51.263 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 287 kB/s | 222 kB 00:00 2024-09-21T22:13:51.329 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T22:13:51.410 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T22:13:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T22:13:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T22:13:51.546 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-09-21T22:13:51.588 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 780 kB/s | 32 kB 00:00 2024-09-21T22:13:51.605 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 858 kB/s | 14 kB 00:00 2024-09-21T22:13:51.655 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 4.3 MB/s | 220 kB 00:00 2024-09-21T22:13:51.680 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 348 kB/s | 279 kB 00:00 2024-09-21T22:13:51.731 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T22:13:51.781 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-21T22:13:51.864 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 4.9 MB/s | 1.0 MB 00:00 2024-09-21T22:13:51.890 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 86 kB/s | 54 kB 00:00 2024-09-21T22:13:51.894 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:51.894 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-09-21T22:13:51.966 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:13:51.982 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:13:51.982 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:13:52.076 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:13:52.077 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:13:52.296 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T22:13:52.296 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T22:13:52.296 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T22:13:52.296 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T22:13:52.296 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T22:13:52.296 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T22:13:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:52.578 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:13:52.755 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T22:13:52.807 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T22:13:52.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-fuse 2024-09-21T22:13:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T22:13:52.900 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T22:13:52.942 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T22:13:53.053 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T22:13:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T22:13:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T22:13:53.429 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:53.565 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:53.566 INFO:teuthology.orchestra.run.smithi149.stdout:Install 2 Packages 2024-09-21T22:13:53.567 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:53.567 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 976 k 2024-09-21T22:13:53.567 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 2.9 M 2024-09-21T22:13:53.567 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:53.935 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T22:13:53.966 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 2.9 MB/s | 897 kB 00:00 2024-09-21T22:13:53.981 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T22:13:54.006 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T22:13:54.055 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T22:13:54.076 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T22:13:54.300 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-21T22:13:54.300 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:54.301 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.3 MB/s | 976 kB 00:00 2024-09-21T22:13:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:54.335 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:54.335 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:54.416 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:54.417 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:54.600 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:54.736 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T22:13:54.815 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T22:13:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T22:13:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T22:13:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T22:13:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T22:13:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T22:13:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T22:13:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T22:13:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T22:13:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T22:13:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T22:13:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T22:13:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T22:13:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T22:13:55.179 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T22:13:55.180 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:55.180 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:13:55.180 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:55.180 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T22:13:55.180 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T22:13:55.180 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T22:13:55.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T22:13:55.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T22:13:55.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T22:13:55.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T22:13:55.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T22:13:55.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T22:13:55.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T22:13:55.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T22:13:55.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T22:13:55.182 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:55.182 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:13:55.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T22:13:55.504 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T22:13:55.504 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T22:13:55.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T22:13:55.789 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:55.789 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:55.789 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T22:13:55.789 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:55.789 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:56.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-volume 2024-09-21T22:13:56.069 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:13:56.202 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:13:56.202 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:56.202 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-09-21T22:13:56.203 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:13:56.204 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 7.0 M 2024-09-21T22:13:56.204 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 33 M 2024-09-21T22:13:56.204 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:13:56.667 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:56.790 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-21T22:13:56.801 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:56.801 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:13:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:56.803 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 285 k 2024-09-21T22:13:56.803 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 1.3 M 2024-09-21T22:13:56.803 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:56.815 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 663 kB/s | 146 kB 00:00 2024-09-21T22:13:56.874 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 988 kB/s | 58 kB 00:00 2024-09-21T22:13:56.908 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-21T22:13:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.2 MB/s | 548 kB 00:00 2024-09-21T22:13:57.029 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-21T22:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-21T22:13:57.030 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:57.039 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:57.068 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:57.068 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:57.294 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:57.373 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:57.390 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:57.390 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:13:57.390 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T22:13:57.391 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:57.950 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-09-21T22:13:57.952 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:57.953 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-21T22:13:58.024 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:13:58.035 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:13:58.035 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:13:58.135 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:13:58.135 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:13:58.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:13:58.357 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:58.357 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:13:58.357 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:13:58.357 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:58.357 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:13:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:13:58.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T22:13:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T22:13:58.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados-devel 2024-09-21T22:13:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T22:13:59.290 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T22:13:59.300 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:13:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T22:13:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T22:13:59.435 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:13:59.436 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:13:59.437 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 127 k 2024-09-21T22:13:59.437 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 456 k 2024-09-21T22:13:59.437 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:13:59.645 INFO:teuthology.orchestra.run.smithi149.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 610 kB/s | 127 kB 00:00 2024-09-21T22:13:59.645 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:13:59.645 INFO:teuthology.orchestra.run.smithi149.stdout:Total 606 kB/s | 127 kB 00:00 2024-09-21T22:13:59.646 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:13:59.651 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:13:59.651 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:13:59.714 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:13:59.715 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:13:59.873 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:13:59.975 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:00.126 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T22:14:00.126 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T22:14:00.126 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T22:14:00.126 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T22:14:00.126 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T22:14:00.126 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T22:14:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T22:14:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:00.395 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:14:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T22:14:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T22:14:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T22:14:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T22:14:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T22:14:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:00.396 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:00.434 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:00.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-09-21T22:14:00.689 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:00.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:00.689 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:14:00.689 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:00.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:00.689 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:00.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs2 2024-09-21T22:14:01.249 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:01.381 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:01.382 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:14:01.382 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:01.382 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:14:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T22:14:01.382 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T22:14:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T22:14:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:01.383 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:14:01.383 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:01.383 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-09-21T22:14:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:01.384 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 976 k 2024-09-21T22:14:01.384 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 2.9 M 2024-09-21T22:14:01.384 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:14:01.523 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:01.567 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 604 kB/s | 80 kB 00:00 2024-09-21T22:14:01.614 INFO:teuthology.orchestra.run.smithi149.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:01.660 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:01.662 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:14:01.662 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:01.725 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs-devel 2024-09-21T22:14:01.726 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-21T22:14:01.726 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:01.727 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.8 MB/s | 976 kB 00:00 2024-09-21T22:14:01.738 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:14:01.760 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:14:01.760 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:14:01.843 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:14:01.843 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:14:02.048 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:14:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T22:14:02.258 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T22:14:02.318 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:02.452 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:14:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:02.454 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 32 k 2024-09-21T22:14:02.454 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 142 k 2024-09-21T22:14:02.454 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:14:02.614 INFO:teuthology.orchestra.run.smithi149.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 198 kB/s | 32 kB 00:00 2024-09-21T22:14:02.614 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:02.615 INFO:teuthology.orchestra.run.smithi149.stdout:Total 196 kB/s | 32 kB 00:00 2024-09-21T22:14:02.615 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:14:02.618 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:14:02.618 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:14:02.633 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:14:02.634 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:14:02.723 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:14:02.828 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:02.954 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T22:14:02.954 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T22:14:03.212 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:03.219 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T22:14:03.220 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:03.220 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:03.220 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T22:14:03.220 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:03.220 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:03.440 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:03.440 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:03.440 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:14:03.440 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:03.440 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:03.440 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:03.523 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-volume 2024-09-21T22:14:03.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados2 2024-09-21T22:14:04.114 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:04.219 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:04.248 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:04.248 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:04.248 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 285 k 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 1.3 M 2024-09-21T22:14:04.249 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:14:04.310 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:04.355 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:04.356 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:14:04.356 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:04.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librbd1 2024-09-21T22:14:04.488 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-21T22:14:04.488 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:04.489 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-21T22:14:04.489 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:14:04.497 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:14:04.497 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:14:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:14:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:14:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:14:04.806 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:14:04.823 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:14:04.823 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:14:04.823 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T22:14:04.823 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:05.050 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:05.146 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:05.193 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:05.193 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:14:05.194 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:05.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rados 2024-09-21T22:14:05.820 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T22:14:05.820 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:05.820 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:05.820 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T22:14:05.820 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:05.820 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:05.878 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:05.968 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:06.012 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:06.013 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:14:06.013 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:06.077 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rgw 2024-09-21T22:14:06.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-09-21T22:14:06.661 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:06.746 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:06.748 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:06.792 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:06.793 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:14:06.793 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:06.856 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-cephfs 2024-09-21T22:14:06.884 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:06.884 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 127 k 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 456 k 2024-09-21T22:14:06.885 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:14:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 611 kB/s | 127 kB 00:00 2024-09-21T22:14:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:Total 606 kB/s | 127 kB 00:00 2024-09-21T22:14:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:14:07.100 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:14:07.100 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:14:07.164 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:14:07.164 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:14:07.313 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:14:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:07.449 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:07.540 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:07.585 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:07.586 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:14:07.586 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:07.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rbd 2024-09-21T22:14:07.841 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:08.101 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:08.102 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:08.253 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:46 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:08.343 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:08.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-09-21T22:14:08.387 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:08.388 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T22:14:08.388 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:08.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-fuse 2024-09-21T22:14:08.952 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:09.042 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:09.054 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:47 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:09.088 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:09.089 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:14:09.089 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:09.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-09-21T22:14:09.190 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:14:09.191 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:09.192 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 85 k 2024-09-21T22:14:09.192 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 231 k 2024-09-21T22:14:09.192 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:14:09.376 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 464 kB/s | 85 kB 00:00 2024-09-21T22:14:09.376 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:09.377 INFO:teuthology.orchestra.run.smithi149.stdout:Total 461 kB/s | 85 kB 00:00 2024-09-21T22:14:09.377 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:14:09.384 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:14:09.384 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:14:09.447 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:14:09.447 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:14:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:14:09.698 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:09.735 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:46 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:09.869 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:09.870 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:14:09.871 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:09.871 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 32 k 2024-09-21T22:14:09.871 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 142 k 2024-09-21T22:14:09.871 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:14:10.021 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 211 kB/s | 32 kB 00:00 2024-09-21T22:14:10.022 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:10.022 INFO:teuthology.orchestra.run.smithi134.stdout:Total 209 kB/s | 32 kB 00:00 2024-09-21T22:14:10.022 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:14:10.025 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:14:10.026 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:14:10.038 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:14:10.039 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:14:10.102 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:14:10.251 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:10.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:10.359 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:10.629 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:10.647 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-mirror 2024-09-21T22:14:10.867 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:10.868 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:10.868 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:11.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-09-21T22:14:11.245 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:49 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:11.384 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:11.385 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:11.385 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T22:14:11.385 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:11.385 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:14:11.385 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T22:14:11.385 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:11.385 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:14:11.386 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:11.386 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:14:11.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:11.386 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 3.1 M 2024-09-21T22:14:11.386 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 13 M 2024-09-21T22:14:11.386 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:14:11.641 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:11.721 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.3 MB/s | 3.1 MB 00:00 2024-09-21T22:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:Total 9.2 MB/s | 3.1 MB 00:00 2024-09-21T22:14:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:14:11.731 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:11.731 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:14:11.732 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:14:11.774 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:11.775 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:14:11.775 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:11.815 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:14:11.816 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:14:11.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-09-21T22:14:12.239 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:14:12.297 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:12.321 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:12.321 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:14:12.321 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T22:14:12.322 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T22:14:12.322 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T22:14:12.322 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:12.423 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:49 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:12.512 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:12.556 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:12.557 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:14:12.557 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:12.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-09-21T22:14:13.204 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:50 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:13.291 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:13.334 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:13.335 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:14:13.335 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:13.399 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:14:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:13.399 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:13.399 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:13.413 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-09-21T22:14:13.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-nbd 2024-09-21T22:14:13.996 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:50 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:14.085 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:14.128 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:14.129 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:14:14.129 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:14.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-09-21T22:14:14.226 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:52 ago on Sat 21 Sep 2024 10:12:22 PM UTC. 2024-09-21T22:14:14.359 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T22:14:14.360 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:14.360 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T22:14:14.360 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:14.360 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T22:14:14.360 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T22:14:14.360 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:14.361 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T22:14:14.361 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T22:14:14.361 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T22:14:14.361 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:14.361 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 170 k 2024-09-21T22:14:14.361 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 494 k 2024-09-21T22:14:14.361 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T22:14:14.567 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 829 kB/s | 170 kB 00:00 2024-09-21T22:14:14.567 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:14.568 INFO:teuthology.orchestra.run.smithi149.stdout:Total 822 kB/s | 170 kB 00:00 2024-09-21T22:14:14.568 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T22:14:14.576 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T22:14:14.576 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T22:14:14.639 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T22:14:14.639 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T22:14:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T22:14:14.803 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:51 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:14.888 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:14.937 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:14.938 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:14:14.938 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:15.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-09-21T22:14:15.328 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:15.579 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:15.579 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:15.579 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T22:14:15.579 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:15.579 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:15.579 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T22:14:15.600 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:52 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:15.698 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T22:14:15.744 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:15.745 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-21T22:14:15.745 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:15.822 DEBUG:teuthology.parallel:result is None 2024-09-21T22:14:15.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-09-21T22:14:16.434 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:53 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:16.567 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 85 k 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 231 k 2024-09-21T22:14:16.568 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:14:16.749 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 473 kB/s | 85 kB 00:00 2024-09-21T22:14:16.750 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:16.750 INFO:teuthology.orchestra.run.smithi134.stdout:Total 469 kB/s | 85 kB 00:00 2024-09-21T22:14:16.750 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:14:16.757 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:14:16.757 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:14:16.820 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:14:16.820 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:14:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:14:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:17.421 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:17.682 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:17.683 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:17.683 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:17.683 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:17.683 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:17.683 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:17.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-09-21T22:14:18.578 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:55 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:18.711 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:18.712 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:18.712 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-21T22:14:18.712 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:18.712 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:14:18.712 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.1 M 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 13 M 2024-09-21T22:14:18.713 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:14:19.052 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.2 MB/s | 3.1 MB 00:00 2024-09-21T22:14:19.052 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:19.053 INFO:teuthology.orchestra.run.smithi134.stdout:Total 9.1 MB/s | 3.1 MB 00:00 2024-09-21T22:14:19.053 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:14:19.062 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:14:19.062 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:14:19.143 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:14:19.144 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:14:19.573 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:14:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:19.669 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T22:14:19.669 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T22:14:19.669 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T22:14:19.669 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T22:14:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:20.759 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:20.760 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:21.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-09-21T22:14:21.603 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:58 ago on Sat 21 Sep 2024 10:12:23 PM UTC. 2024-09-21T22:14:21.736 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T22:14:21.736 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:21.736 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 170 k 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 494 k 2024-09-21T22:14:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T22:14:21.946 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 817 kB/s | 170 kB 00:00 2024-09-21T22:14:21.946 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T22:14:21.946 INFO:teuthology.orchestra.run.smithi134.stdout:Total 812 kB/s | 170 kB 00:00 2024-09-21T22:14:21.947 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T22:14:21.954 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T22:14:21.955 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T22:14:22.018 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T22:14:22.018 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T22:14:22.173 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T22:14:22.293 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:22.712 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T22:14:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:22.991 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T22:14:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T22:14:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:22.992 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T22:14:23.264 DEBUG:teuthology.parallel:result is None 2024-09-21T22:14:23.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T22:14:23.402 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T22:14:23.423 INFO:teuthology.orchestra.run.smithi134.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T22:14:23.424 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T22:14:23.424 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T22:14:23.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T22:14:23.561 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T22:14:23.588 INFO:teuthology.orchestra.run.smithi149.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T22:14:23.588 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T22:14:23.588 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T22:14:23.590 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T22:14:23.590 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:23.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T22:14:23.616 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:14:23.616 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T22:14:23.656 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T22:14:23.657 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:23.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T22:14:23.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T22:14:23.747 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:14:23.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T22:14:23.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T22:14:23.844 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T22:14:23.844 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:23.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T22:14:23.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T22:14:23.935 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:14:23.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T22:14:23.962 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T22:14:24.029 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T22:14:24.029 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:24.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T22:14:24.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T22:14:24.118 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:14:24.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T22:14:24.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T22:14:24.210 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T22:14:24.284 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T22:14:24.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-21T22:14:24.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-09-21T22:14:24.311 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T22:14:24.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T22:14:24.352 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T22:14:24.377 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T22:14:24.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T22:14:24.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T22:14:24.453 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T22:14:24.453 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T22:14:24.453 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914464', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1478, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'sleep_before_teardown': 0, 'subset': '24/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJY0anuK1kvymuivETBT8HyNUkU2UgXVQMqj7WpKDpdOHnUJPB6lSxdHXB1XB+3KOT+EFUQ419Fwku1uBwYK1hU=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIM2kA0BPj3xV3IQ05Yfm8Wj/1b6GU7Yo4WsprsNqUXinZ9fG0SzwkpnjVEB4AANrcMyuVOLZ9iHjWZ6mGmkdEA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'deep_copy': True, 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_21:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T22:14:24.454 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T22:14:24.483 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T22:14:24.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T22:14:24.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T22:14:24.564 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:24.564 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T22:14:24.617 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T22:14:24.617 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:24.672 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 22:14:19.932430922 +0000 2024-09-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 22:11:37.272449109 +0000 2024-09-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 22:11:37.272449109 +0000 2024-09-21T22:14:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 22:11:37.272449109 +0000 2024-09-21T22:14:24.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T22:14:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T22:14:24.736 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T22:14:24.736 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000199466 s, 2.6 MB/s 2024-09-21T22:14:24.737 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T22:14:24.793 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-21T22:14:24.849 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T22:14:24.849 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T22:14:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 22:14:19.933430900 +0000 2024-09-21T22:14:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 22:11:37.586442265 +0000 2024-09-21T22:14:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 22:11:37.586442265 +0000 2024-09-21T22:14:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 22:11:37.586442265 +0000 2024-09-21T22:14:24.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T22:14:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T22:14:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T22:14:24.913 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000182718 s, 2.8 MB/s 2024-09-21T22:14:24.914 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T22:14:24.970 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-21T22:14:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T22:14:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:25.026 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T22:14:25.026 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:25.026 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:25.026 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 22:14:19.933430900 +0000 2024-09-21T22:14:25.026 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 22:11:37.907435269 +0000 2024-09-21T22:14:25.026 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 22:11:37.907435269 +0000 2024-09-21T22:14:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 22:11:37.907435269 +0000 2024-09-21T22:14:25.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T22:14:25.089 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T22:14:25.089 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T22:14:25.089 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00020659 s, 2.5 MB/s 2024-09-21T22:14:25.091 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T22:14:25.147 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-21T22:14:25.203 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T22:14:25.203 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:25.203 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T22:14:25.203 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:25.204 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:25.204 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 22:14:19.933430900 +0000 2024-09-21T22:14:25.204 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 22:11:38.234428142 +0000 2024-09-21T22:14:25.204 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 22:11:38.234428142 +0000 2024-09-21T22:14:25.204 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 22:11:38.234428142 +0000 2024-09-21T22:14:25.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T22:14:25.266 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T22:14:25.266 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T22:14:25.266 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000244143 s, 2.1 MB/s 2024-09-21T22:14:25.268 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T22:14:25.324 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:25.324 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:14:25.325 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T22:14:25.342 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T22:14:25.342 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-21T22:14:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 811 Links: 1 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 22:14:12.580354799 +0000 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 22:11:46.423489788 +0000 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 22:11:46.423489788 +0000 2024-09-21T22:14:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 22:11:46.423489788 +0000 2024-09-21T22:14:25.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T22:14:25.464 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T22:14:25.464 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T22:14:25.464 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000268654 s, 1.9 MB/s 2024-09-21T22:14:25.465 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T22:14:25.523 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 833 Links: 1 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 22:14:12.580354799 +0000 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 22:11:46.741483578 +0000 2024-09-21T22:14:25.579 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 22:11:46.741483578 +0000 2024-09-21T22:14:25.580 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 22:11:46.741483578 +0000 2024-09-21T22:14:25.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T22:14:25.643 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T22:14:25.643 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T22:14:25.643 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000241774 s, 2.1 MB/s 2024-09-21T22:14:25.644 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T22:14:25.701 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-21T22:14:25.757 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T22:14:25.757 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:25.757 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 849 Links: 1 2024-09-21T22:14:25.758 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:25.758 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:25.758 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 22:14:12.580354799 +0000 2024-09-21T22:14:25.758 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 22:11:47.067477211 +0000 2024-09-21T22:14:25.758 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 22:11:47.067477211 +0000 2024-09-21T22:14:25.758 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 22:11:47.067477211 +0000 2024-09-21T22:14:25.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T22:14:25.821 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T22:14:25.821 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T22:14:25.821 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000202314 s, 2.5 MB/s 2024-09-21T22:14:25.822 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T22:14:25.879 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-21T22:14:25.935 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T22:14:25.935 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T22:14:25.935 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-09-21T22:14:25.935 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T22:14:25.935 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T22:14:25.935 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 22:14:12.581354780 +0000 2024-09-21T22:14:25.935 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 22:11:47.388470942 +0000 2024-09-21T22:14:25.936 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 22:11:47.388470942 +0000 2024-09-21T22:14:25.936 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 22:11:47.388470942 +0000 2024-09-21T22:14:25.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T22:14:25.999 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T22:14:25.999 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T22:14:25.999 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000215629 s, 2.4 MB/s 2024-09-21T22:14:26.000 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T22:14:26.056 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:26.056 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T22:14:26.056 INFO:tasks.ceph:Generating config... 2024-09-21T22:14:26.057 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-21T22:14:26.057 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-21T22:14:26.057 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-21T22:14:26.057 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T22:14:26.057 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T22:14:26.057 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T22:14:26.057 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T22:14:26.058 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-21T22:14:26.058 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T22:14:26.059 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-21T22:14:26.059 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T22:14:26.059 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-21T22:14:26.059 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T22:14:26.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T22:14:26.113 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T22:14:26.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T22:14:26.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T22:14:26.187 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]'), ('mon.b', '172.21.15.149')] 2024-09-21T22:14:26.187 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790],172.21.15.149', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-21T22:14:26.188 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:26.188 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T22:14:26.243 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --add b 172.21.15.149 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: generated fsid aacb52bd-b292-44e0-94ba-ee8e83c0c924 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = quincy 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 0 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:fsid aacb52bd-b292-44e0-94ba-ee8e83c0c924 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:last_changed 2024-09-21T22:14:26.329537+0000 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-09-21T22:14:26.329537+0000 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:min_mon_release 17 (quincy) 2024-09-21T22:14:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:election_strategy: 1 2024-09-21T22:14:26.331 INFO:teuthology.orchestra.run.smithi134.stdout:0: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.a 2024-09-21T22:14:26.331 INFO:teuthology.orchestra.run.smithi134.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-21T22:14:26.331 INFO:teuthology.orchestra.run.smithi134.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2024-09-21T22:14:26.331 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T22:14:26.332 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T22:14:26.346 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aacb52bd-b292-44e0-94ba-ee8e83c0c924... 2024-09-21T22:14:26.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T22:14:26.389 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T22:14:26.429 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-21T22:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-21T22:14:26.431 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.432 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790],172.21.15.149" 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on pool no app = False 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 5000 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = aacb52bd-b292-44e0-94ba-ee8e83c0c924 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-21T22:14:26.433 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.434 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-21T22:14:26.435 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: bluefs allocator = hybrid 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = hybrid 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-09-21T22:14:26.436 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.437 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.438 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:14:26.439 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-21T22:14:26.440 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.441 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T22:14:26.442 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T22:14:26.443 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790],172.21.15.149" 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: mon client directed command retry = 5 2024-09-21T22:14:26.444 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on pool no app = False 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject socket failures = 5000 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = aacb52bd-b292-44e0-94ba-ee8e83c0c924 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-09-21T22:14:26.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.446 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: bluefs allocator = hybrid 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = hybrid 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-09-21T22:14:26.447 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: osd blocked scrub grace period = 3600 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: osd max markdown count = 1000 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: osd shutdown pgref assert = True 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-09-21T22:14:26.448 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-09-21T22:14:26.449 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T22:14:26.450 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T22:14:26.451 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T22:14:26.452 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-09-21T22:14:26.452 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-09-21T22:14:26.452 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-09-21T22:14:26.453 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T22:14:26.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T22:14:26.547 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T22:14:26.548 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:26.548 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T22:14:26.563 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:26.563 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T22:14:26.618 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:14:26.618 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:26.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T22:14:26.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T22:14:26.692 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:26.692 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:26.747 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:14:26.747 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:14:26.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T22:14:26.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T22:14:26.784 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:14:26.784 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:26.839 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T22:14:26.839 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T22:14:26.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T22:14:26.890 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T22:14:26.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T22:14:26.954 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T22:14:26.957 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T22:14:26.957 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T22:14:26.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T22:14:26.998 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T22:14:27.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T22:14:27.052 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T22:14:27.065 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T22:14:27.065 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T22:14:27.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T22:14:27.090 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:27.090 INFO:tasks.ceph:role: osd.0 2024-09-21T22:14:27.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:14:27.090 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T22:14:27.162 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:27.162 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:27.162 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:27.162 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:27.162 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:27.162 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:27.162 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:27.163 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:27.163 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:27.163 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:27.690 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T22:14:27.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T22:14:27.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T22:14:27.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T22:14:27.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T22:14:27.943 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:27.943 INFO:tasks.ceph:role: osd.1 2024-09-21T22:14:27.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:14:27.943 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T22:14:28.015 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:28.016 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:28.016 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:28.016 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:28.016 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:28.477 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T22:14:28.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T22:14:28.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T22:14:28.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T22:14:28.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T22:14:28.666 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:28.667 INFO:tasks.ceph:role: osd.2 2024-09-21T22:14:28.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:14:28.667 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T22:14:28.739 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:29.220 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T22:14:29.222 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T22:14:29.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T22:14:29.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T22:14:29.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T22:14:29.442 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:29.442 INFO:tasks.ceph:role: osd.3 2024-09-21T22:14:29.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:14:29.442 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:29.514 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:29.515 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:30.012 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T22:14:30.014 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T22:14:30.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T22:14:30.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T22:14:30.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:30.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:30.280+0000 7f55ce80d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T22:14:30.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:30.280+0000 7f55ce80d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T22:14:30.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:30.280+0000 7f55ce80d640 -1 bdev(0x55aeac2bb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:30.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:30.280+0000 7f55ce80d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T22:14:33.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T22:14:33.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:33.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:33.805+0000 7f1cf5c9c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T22:14:33.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:33.805+0000 7f1cf5c9c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T22:14:33.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:33.805+0000 7f1cf5c9c640 -1 bdev(0x5583d1557800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:33.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:33.805+0000 7f1cf5c9c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T22:14:37.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T22:14:37.245 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:37.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:37.335+0000 7f8f3b485640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T22:14:37.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:37.335+0000 7f8f3b485640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T22:14:37.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:37.335+0000 7f8f3b485640 -1 bdev(0x555cbad65800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:37.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:37.335+0000 7f8f3b485640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T22:14:40.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T22:14:40.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:40.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:40.358+0000 7fab30444640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T22:14:40.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:40.359+0000 7fab30444640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T22:14:40.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:40.359+0000 7fab30444640 -1 bdev(0x55c73f731800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:40.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:14:40.359+0000 7fab30444640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T22:14:43.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T22:14:43.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T22:14:43.336 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:43.336 INFO:tasks.ceph:role: osd.4 2024-09-21T22:14:43.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:14:43.337 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:43.413 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:43.923 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T22:14:43.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T22:14:43.925 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T22:14:44.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T22:14:44.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T22:14:44.168 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:44.168 INFO:tasks.ceph:role: osd.5 2024-09-21T22:14:44.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:14:44.169 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T22:14:44.241 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:44.241 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:44.241 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:44.241 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:44.241 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:44.242 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:44.242 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:44.242 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:44.242 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:44.242 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:44.687 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T22:14:44.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T22:14:44.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T22:14:44.772 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T22:14:44.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T22:14:44.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:44.907 INFO:tasks.ceph:role: osd.6 2024-09-21T22:14:44.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:14:44.908 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T22:14:44.980 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:44.980 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:44.980 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:44.980 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:44.981 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:44.981 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:44.981 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:44.981 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:44.981 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:44.981 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:45.519 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T22:14:45.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T22:14:45.521 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T22:14:45.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T22:14:45.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T22:14:45.756 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:14:45.756 INFO:tasks.ceph:role: osd.7 2024-09-21T22:14:45.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:14:45.756 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T22:14:45.828 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:14:45.828 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:14:45.828 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:14:45.828 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:14:45.828 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:14:45.828 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:14:45.829 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:14:45.829 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:14:45.829 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:14:45.829 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:14:46.346 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T22:14:46.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T22:14:46.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T22:14:46.445 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T22:14:46.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:46.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:46.576+0000 7f3c085c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T22:14:46.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:46.577+0000 7f3c085c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T22:14:46.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:46.577+0000 7f3c085c5640 -1 bdev(0x55b1c7a09800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:46.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:46.577+0000 7f3c085c5640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T22:14:49.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T22:14:50.003 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:50.088+0000 7f9931417640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T22:14:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:50.089+0000 7f9931417640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T22:14:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:50.089+0000 7f9931417640 -1 bdev(0x55c491e11800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:50.089+0000 7f9931417640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T22:14:53.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T22:14:53.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:53.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:53.115+0000 7fad49ab2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T22:14:53.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:53.116+0000 7fad49ab2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T22:14:53.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:53.116+0000 7fad49ab2640 -1 bdev(0x55a114abf800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:53.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:53.116+0000 7fad49ab2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T22:14:56.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T22:14:56.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:14:56.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:56.399+0000 7f74dc039640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T22:14:56.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:56.400+0000 7f74dc039640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T22:14:56.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:56.400+0000 7f74dc039640 -1 bdev(0x55dd9abed800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T22:14:56.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T22:14:56.400+0000 7f74dc039640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T22:14:59.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T22:14:59.839 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T22:14:59.839 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:59.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T22:14:59.870 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:59.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T22:14:59.940 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:14:59.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T22:15:00.008 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:15:00.008 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T22:15:00.075 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:15:00.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T22:15:00.141 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:00.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T22:15:00.172 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:00.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T22:15:00.241 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:00.241 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T22:15:00.308 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:00.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T22:15:00.375 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:00.375 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T22:15:00.442 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:15:00.442 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T22:15:00.460 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:00.460 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T22:15:00.498 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T22:15:00.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T22:15:00.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBCRe9m0bsRNRAAitL8Xs78G8D4CFnKa2CB0A== 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBGRe9mENu9EBAA0HM03CzKLkGf9wQa7+HNFw== 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBJRe9mUYYPMBAA24HNZ/o7aj5QmLns21vEsw== 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBNRe9m+S8FFBAA5+oNlzEk2EgFIbMFFb1sNQ== 2024-09-21T22:15:00.541 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBQRe9mT4WAFRAAd0drzy5Ue28rBog81LiNqg== 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBCRe9mo6/hOBAAR7OJ5G6fLdJHqB2JByYY7Q== 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBWRe9mcSR3IhAADkUJ1flqlTskeBvzeb4p4A== 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBaRe9m8eViBRAAl1ad/7wYn/dZc4XyEaBbIQ== 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBdRe9mYw3/BhAAMWZCZ8ZRw1tYxvgiCFODfA== 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBgRe9mpQ3sFxAAwAL9C/bVwwxKRiPjQVyqYw== 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBCRe9mkQGAOxAARD/iBYJjB0v5QGwx3wp6tw== 2024-09-21T22:15:00.542 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-09-21T22:15:00.543 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBDRe9mXU4fAxAAINRJDk9TUHXAJKFnhMsuKQ== 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBCRe9m0bsRNRAAitL8Xs78G8D4CFnKa2CB0A== 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBGRe9mENu9EBAA0HM03CzKLkGf9wQa7+HNFw== 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBJRe9mUYYPMBAA24HNZ/o7aj5QmLns21vEsw== 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBNRe9m+S8FFBAA5+oNlzEk2EgFIbMFFb1sNQ== 2024-09-21T22:15:00.562 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBQRe9mT4WAFRAAd0drzy5Ue28rBog81LiNqg== 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBCRe9mo6/hOBAAR7OJ5G6fLdJHqB2JByYY7Q== 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBWRe9mcSR3IhAADkUJ1flqlTskeBvzeb4p4A== 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBaRe9m8eViBRAAl1ad/7wYn/dZc4XyEaBbIQ== 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBdRe9mYw3/BhAAMWZCZ8ZRw1tYxvgiCFODfA== 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBgRe9mpQ3sFxAAwAL9C/bVwwxKRiPjQVyqYw== 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBCRe9mkQGAOxAARD/iBYJjB0v5QGwx3wp6tw== 2024-09-21T22:15:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-21T22:15:00.564 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBDRe9mXU4fAxAAINRJDk9TUHXAJKFnhMsuKQ== 2024-09-21T22:15:00.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:15:00.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:15:00.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.766 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.819 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:15:00.872 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:15:00.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.925 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:00.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:01.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:01.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:01.082 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:01.085 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:15:01.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:15:01.138 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:15:01.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:15:01.194 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:15:01.248 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T22:15:01.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T22:15:01.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T22:15:01.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T22:15:01.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T22:15:01.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T22:15:01.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T22:15:01.577 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T22:15:01.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T22:15:01.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T22:15:01.725 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:15:01.728 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:15:01.781 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T22:15:01.781 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T22:15:01.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T22:15:01.783 INFO:tasks.ceph.mon.a:Started 2024-09-21T22:15:01.783 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T22:15:01.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T22:15:01.785 INFO:tasks.ceph.mon.c:Started 2024-09-21T22:15:01.786 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T22:15:01.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T22:15:01.823 INFO:tasks.ceph.mon.b:Started 2024-09-21T22:15:01.823 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T22:15:01.823 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T22:15:01.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T22:15:01.826 INFO:tasks.ceph.mgr.y:Started 2024-09-21T22:15:01.826 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T22:15:01.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T22:15:01.828 INFO:tasks.ceph.mgr.x:Started 2024-09-21T22:15:01.828 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T22:15:01.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T22:15:07.185 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2024-09-21T22:15:07.198 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T22:15:07.199 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T22:15:07.199 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:15:07.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T22:15:07.215 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:07.214+0000 7f0bb613b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T22:15:07.224 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:15:07.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T22:15:07.258 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:07.257+0000 7f0bb613b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T22:15:07.282 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:15:07.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T22:15:07.348 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T22:15:07.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T22:15:07.399 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:07.398+0000 7f0bb613b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T22:15:07.413 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:07.413 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T22:15:07.443 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:07.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T22:15:07.452 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:07.450+0000 7f0bb613b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T22:15:07.512 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:07.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T22:15:07.578 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T22:15:07.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T22:15:07.614 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:07.613+0000 7f0bb613b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:15:07.645 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 96ad0a5a-c464-448c-b390-6e73c8fb449e 0 2024-09-21T22:15:07.722 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:07.721+0000 7f0bb613b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T22:15:07.867 INFO:teuthology.orchestra.run.smithi149.stdout:0 2024-09-21T22:15:07.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new f2c75579-e93c-44e8-85ed-144ec4ba096d 1 2024-09-21T22:15:08.019 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.019+0000 7f0c02588040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T22:15:08.037 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:08.036+0000 7f0bb613b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T22:15:08.062 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.061+0000 7f0c02588040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T22:15:08.084 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T22:15:08.088 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:08.087+0000 7f0bb613b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T22:15:08.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new a2ae2709-79f1-4a99-b854-d72cfe661be9 2 2024-09-21T22:15:08.215 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.214+0000 7f0c02588040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T22:15:08.239 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:08.238+0000 7f0bb613b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T22:15:08.265 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.264+0000 7f0c02588040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T22:15:08.278 INFO:teuthology.orchestra.run.smithi149.stdout:2 2024-09-21T22:15:08.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 94ed467c-6601-41ec-8bdb-9d1f0d4c078b 3 2024-09-21T22:15:08.436 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.435+0000 7f0c02588040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:15:08.472 INFO:teuthology.orchestra.run.smithi149.stdout:3 2024-09-21T22:15:08.483 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 74e011e7-766b-437a-b71b-09fc990e210d 4 2024-09-21T22:15:08.553 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.552+0000 7f0c02588040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T22:15:08.662 INFO:teuthology.orchestra.run.smithi149.stdout:4 2024-09-21T22:15:08.673 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new e7650da2-cbad-4915-bc9c-d5154151bcc0 5 2024-09-21T22:15:08.850 INFO:teuthology.orchestra.run.smithi149.stdout:5 2024-09-21T22:15:08.861 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new aec4bd84-857e-4cc9-898c-93440ba485c8 6 2024-09-21T22:15:08.902 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.901+0000 7f0c02588040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T22:15:08.952 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:08.951+0000 7f0c02588040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T22:15:09.040 INFO:teuthology.orchestra.run.smithi149.stdout:6 2024-09-21T22:15:09.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new a244e703-8ec9-4edc-b0ca-e33b38bbd99c 7 2024-09-21T22:15:09.109 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:09.108+0000 7f0c02588040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T22:15:09.218 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:09.217+0000 7f0bb613b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T22:15:09.271 INFO:teuthology.orchestra.run.smithi149.stdout:7 2024-09-21T22:15:09.271 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:09.270+0000 7f0bb613b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T22:15:09.283 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T22:15:09.283 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T22:15:09.285 INFO:tasks.ceph.osd.0:Started 2024-09-21T22:15:09.285 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T22:15:09.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T22:15:09.287 INFO:tasks.ceph.osd.1:Started 2024-09-21T22:15:09.287 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T22:15:09.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T22:15:09.289 INFO:tasks.ceph.osd.2:Started 2024-09-21T22:15:09.289 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T22:15:09.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T22:15:09.292 INFO:tasks.ceph.osd.3:Started 2024-09-21T22:15:09.292 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T22:15:09.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T22:15:09.325 INFO:tasks.ceph.osd.4:Started 2024-09-21T22:15:09.325 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T22:15:09.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T22:15:09.327 INFO:tasks.ceph.osd.5:Started 2024-09-21T22:15:09.328 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T22:15:09.329 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T22:15:09.331 INFO:tasks.ceph.osd.6:Started 2024-09-21T22:15:09.331 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T22:15:09.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T22:15:09.333 INFO:tasks.ceph.osd.7:Started 2024-09-21T22:15:09.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:15:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:09.510 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":10,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:15:09.268171+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T22:15:09.268171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:15:09.521 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T22:15:09.522 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T22:15:09.681 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:09.680+0000 7f0bb613b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T22:15:09.767 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:09.765+0000 7f0bb613b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T22:15:09.873 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:09.872+0000 7f0bb613b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:15:09.919 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:09.918+0000 7f0bb613b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T22:15:10.034 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.033+0000 7f0bb613b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T22:15:10.087 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.086+0000 7f0bb613b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T22:15:10.120 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.119+0000 7f0c02588040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T22:15:10.133 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.131+0000 7f0bb613b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T22:15:10.174 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.173+0000 7f0c02588040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T22:15:10.246 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.245+0000 7f0bb613b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T22:15:10.297 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.296+0000 7f0bb613b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T22:15:10.327 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T22:15:10.348 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.347+0000 7f0bb613b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T22:15:10.419 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.418+0000 7f0bb613b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T22:15:10.466 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.465+0000 7f0bb613b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T22:15:10.487 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-21T22:15:10.487 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":10,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:15:09.268171+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T22:15:09.268171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:15:10.497 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T22:15:10.506 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:10.505+0000 7ff726345640 -1 Falling back to public interface 2024-09-21T22:15:10.507 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:10.506+0000 7f9166a1e640 -1 Falling back to public interface 2024-09-21T22:15:10.513 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:10.512+0000 7f0bb613b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T22:15:10.546 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.545+0000 7f0c02588040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T22:15:10.632 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.631+0000 7f0c02588040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T22:15:10.739 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.738+0000 7f0c02588040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:15:10.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:10.752+0000 7f378411b640 -1 Falling back to public interface 2024-09-21T22:15:10.783 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:10.782+0000 7f5e55233640 -1 Falling back to public interface 2024-09-21T22:15:10.784 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:10.783+0000 7fc649a3b640 -1 Falling back to public interface 2024-09-21T22:15:10.786 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.785+0000 7f0c02588040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T22:15:10.901 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.900+0000 7f0c02588040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T22:15:10.954 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.953+0000 7f0c02588040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T22:15:10.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:10.997+0000 7faa32551640 -1 Falling back to public interface 2024-09-21T22:15:10.999 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:10.998+0000 7f0c02588040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T22:15:11.024 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:11.023+0000 7f0f6d61e640 -1 Falling back to public interface 2024-09-21T22:15:11.061 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:11.060+0000 7fe59100b640 -1 Falling back to public interface 2024-09-21T22:15:11.115 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:11.114+0000 7f0c02588040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T22:15:11.164 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:11.163+0000 7f0c02588040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T22:15:11.165 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:11.164+0000 7f0bb613b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T22:15:11.219 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:11.218+0000 7f0c02588040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T22:15:11.287 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:11.286+0000 7f0c02588040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T22:15:11.332 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:11.331+0000 7f0c02588040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T22:15:11.378 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:11.377+0000 7f0c02588040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T22:15:12.030 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T22:15:12.029+0000 7f0c02588040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T22:15:12.177 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:12.175+0000 7f0b56a06640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T22:15:12.180 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:15:12.179+0000 7f0b56a06640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T22:15:14.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:14.513+0000 7faa32551640 -1 osd.1 0 log_to_monitors true 2024-09-21T22:15:14.544 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:14.543+0000 7f0f6d61e640 -1 osd.7 0 log_to_monitors true 2024-09-21T22:15:14.588 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:14.586+0000 7f9166a1e640 -1 osd.3 0 log_to_monitors true 2024-09-21T22:15:14.591 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:14.591+0000 7f5e55233640 -1 osd.4 0 log_to_monitors true 2024-09-21T22:15:14.624 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:14.624+0000 7fc649a3b640 -1 osd.5 0 log_to_monitors true 2024-09-21T22:15:14.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:14.801+0000 7f378411b640 -1 osd.0 0 log_to_monitors true 2024-09-21T22:15:15.099 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:15.097+0000 7ff726345640 -1 osd.2 0 log_to_monitors true 2024-09-21T22:15:15.142 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:15.141+0000 7fe59100b640 -1 osd.6 0 log_to_monitors true 2024-09-21T22:15:17.303 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T22:15:17.616 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-21T22:15:17.616 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":12,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:15:16.189811+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T22:15:09.268171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:15:17.632 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T22:15:18.336 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:18.335+0000 7fc6459ca640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T22:15:18.346 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:18.344+0000 7fc63d7ea640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:18.348 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:18.347+0000 7f0f69820640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T22:15:18.372 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:18.371+0000 7ff7222d4640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T22:15:18.376 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:18.375+0000 7f0f60e2c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:18.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:18.374+0000 7faa2e4e0640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T22:15:18.382 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:18.381+0000 7f37800aa640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T22:15:18.385 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:18.384+0000 7ff71a0f4640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:18.388 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:18.387+0000 7fe58d112640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T22:15:18.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:18.390+0000 7faa26300640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:18.395 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:18.394+0000 7f3777eca640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:18.401 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:18.400+0000 7f916245e640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T22:15:18.407 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:18.407+0000 7fe58471e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:18.418 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:18.417+0000 7f915a27e640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:18.436 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:18.435+0000 7f5e511c2640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T22:15:18.446 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:18.446+0000 7f5e48fe2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:24.439 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T22:15:24.718 INFO:teuthology.misc.health.smithi134.stdout: 2024-09-21T22:15:24.718 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":17,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:15:23.364943+0000","last_up_change":"2024-09-21T22:15:19.339902+0000","last_in_change":"2024-09-21T22:15:09.268171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:15:21.204402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6817","nonce":1738784974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6819","nonce":1738784974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6823","nonce":1738784974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6821","nonce":1738784974}]},"public_addr":"172.21.15.134:6817/1738784974","cluster_addr":"172.21.15.134:6819/1738784974","heartbeat_back_addr":"172.21.15.134:6823/1738784974","heartbeat_front_addr":"172.21.15.134:6821/1738784974","state":["exists","up"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6825","nonce":3328015815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6827","nonce":3328015815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6831","nonce":3328015815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6829","nonce":3328015815}]},"public_addr":"172.21.15.134:6825/3328015815","cluster_addr":"172.21.15.134:6827/3328015815","heartbeat_back_addr":"172.21.15.134:6831/3328015815","heartbeat_front_addr":"172.21.15.134:6829/3328015815","state":["exists","up"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6801","nonce":1987494452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6803","nonce":1987494452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6807","nonce":1987494452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6805","nonce":1987494452}]},"public_addr":"172.21.15.134:6801/1987494452","cluster_addr":"172.21.15.134:6803/1987494452","heartbeat_back_addr":"172.21.15.134:6807/1987494452","heartbeat_front_addr":"172.21.15.134:6805/1987494452","state":["exists","up"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6809","nonce":4151481030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6811","nonce":4151481030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6815","nonce":4151481030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6813","nonce":4151481030}]},"public_addr":"172.21.15.134:6809/4151481030","cluster_addr":"172.21.15.134:6811/4151481030","heartbeat_back_addr":"172.21.15.134:6815/4151481030","heartbeat_front_addr":"172.21.15.134:6813/4151481030","state":["exists","up"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6801","nonce":1724687038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6803","nonce":1724687038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6807","nonce":1724687038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6805","nonce":1724687038}]},"public_addr":"172.21.15.149:6801/1724687038","cluster_addr":"172.21.15.149:6803/1724687038","heartbeat_back_addr":"172.21.15.149:6807/1724687038","heartbeat_front_addr":"172.21.15.149:6805/1724687038","state":["exists","up"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6809","nonce":497583447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6811","nonce":497583447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6815","nonce":497583447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6813","nonce":497583447}]},"public_addr":"172.21.15.149:6809/497583447","cluster_addr":"172.21.15.149:6811/497583447","heartbeat_back_addr":"172.21.15.149:6815/497583447","heartbeat_front_addr":"172.21.15.149:6813/497583447","state":["exists","up"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6825","nonce":1853322645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6827","nonce":1853322645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6831","nonce":1853322645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6829","nonce":1853322645}]},"public_addr":"172.21.15.149:6825/1853322645","cluster_addr":"172.21.15.149:6827/1853322645","heartbeat_back_addr":"172.21.15.149:6831/1853322645","heartbeat_front_addr":"172.21.15.149:6829/1853322645","state":["exists","up"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6817","nonce":1872776196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6819","nonce":1872776196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6823","nonce":1872776196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6821","nonce":1872776196}]},"public_addr":"172.21.15.149:6817/1872776196","cluster_addr":"172.21.15.149:6819/1872776196","heartbeat_back_addr":"172.21.15.149:6823/1872776196","heartbeat_front_addr":"172.21.15.149:6821/1872776196","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.845585+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.467598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.110690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.614040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.594902+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.591315+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.191972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.510686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:15:24.729 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T22:15:24.730 INFO:tasks.ceph:Creating RBD pool 2024-09-21T22:15:24.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-21T22:15:25.387 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'rbd' created 2024-09-21T22:15:25.401 DEBUG:teuthology.orchestra.run.smithi134:> rbd --cluster ceph pool init rbd 2024-09-21T22:15:28.411 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T22:15:28.412 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T22:15:28.412 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T22:15:28.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T22:15:28.412 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T22:15:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:28.757 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3632379118},{"type":"v1","addr":"172.21.15.134:6833","nonce":3632379118}]},"active_addr":"172.21.15.134:6833/3632379118","active_change":"2024-09-21T22:15:11.166515+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4115,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3759572749}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":331422302}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1035316262}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2427017606}]}]} 2024-09-21T22:15:28.764 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T22:15:28.764 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T22:15:28.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:15:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:29.045 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":21,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:15:28.397384+0000","last_up_change":"2024-09-21T22:15:19.339902+0000","last_in_change":"2024-09-21T22:15:09.268171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:15:21.204402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:15:25.020799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6817","nonce":1738784974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6819","nonce":1738784974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6823","nonce":1738784974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6821","nonce":1738784974}]},"public_addr":"172.21.15.134:6817/1738784974","cluster_addr":"172.21.15.134:6819/1738784974","heartbeat_back_addr":"172.21.15.134:6823/1738784974","heartbeat_front_addr":"172.21.15.134:6821/1738784974","state":["exists","up"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6825","nonce":3328015815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6827","nonce":3328015815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6831","nonce":3328015815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6829","nonce":3328015815}]},"public_addr":"172.21.15.134:6825/3328015815","cluster_addr":"172.21.15.134:6827/3328015815","heartbeat_back_addr":"172.21.15.134:6831/3328015815","heartbeat_front_addr":"172.21.15.134:6829/3328015815","state":["exists","up"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6801","nonce":1987494452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6803","nonce":1987494452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6807","nonce":1987494452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6805","nonce":1987494452}]},"public_addr":"172.21.15.134:6801/1987494452","cluster_addr":"172.21.15.134:6803/1987494452","heartbeat_back_addr":"172.21.15.134:6807/1987494452","heartbeat_front_addr":"172.21.15.134:6805/1987494452","state":["exists","up"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6809","nonce":4151481030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6811","nonce":4151481030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6815","nonce":4151481030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6813","nonce":4151481030}]},"public_addr":"172.21.15.134:6809/4151481030","cluster_addr":"172.21.15.134:6811/4151481030","heartbeat_back_addr":"172.21.15.134:6815/4151481030","heartbeat_front_addr":"172.21.15.134:6813/4151481030","state":["exists","up"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6801","nonce":1724687038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6803","nonce":1724687038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6807","nonce":1724687038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6805","nonce":1724687038}]},"public_addr":"172.21.15.149:6801/1724687038","cluster_addr":"172.21.15.149:6803/1724687038","heartbeat_back_addr":"172.21.15.149:6807/1724687038","heartbeat_front_addr":"172.21.15.149:6805/1724687038","state":["exists","up"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6809","nonce":497583447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6811","nonce":497583447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6815","nonce":497583447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6813","nonce":497583447}]},"public_addr":"172.21.15.149:6809/497583447","cluster_addr":"172.21.15.149:6811/497583447","heartbeat_back_addr":"172.21.15.149:6815/497583447","heartbeat_front_addr":"172.21.15.149:6813/497583447","state":["exists","up"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6825","nonce":1853322645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6827","nonce":1853322645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6831","nonce":1853322645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6829","nonce":1853322645}]},"public_addr":"172.21.15.149:6825/1853322645","cluster_addr":"172.21.15.149:6827/1853322645","heartbeat_back_addr":"172.21.15.149:6831/1853322645","heartbeat_front_addr":"172.21.15.149:6829/1853322645","state":["exists","up"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6817","nonce":1872776196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6819","nonce":1872776196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6823","nonce":1872776196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6821","nonce":1872776196}]},"public_addr":"172.21.15.149:6817/1872776196","cluster_addr":"172.21.15.149:6819/1872776196","heartbeat_back_addr":"172.21.15.149:6823/1872776196","heartbeat_front_addr":"172.21.15.149:6821/1872776196","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.845585+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.467598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.110690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.614040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.594902+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.591315+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.191972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.510686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:15:29.058 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T22:15:29.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:15:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:29.332 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":21,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:15:28.397384+0000","last_up_change":"2024-09-21T22:15:19.339902+0000","last_in_change":"2024-09-21T22:15:09.268171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:15:21.204402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:15:25.020799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6817","nonce":1738784974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6819","nonce":1738784974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6823","nonce":1738784974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6821","nonce":1738784974}]},"public_addr":"172.21.15.134:6817/1738784974","cluster_addr":"172.21.15.134:6819/1738784974","heartbeat_back_addr":"172.21.15.134:6823/1738784974","heartbeat_front_addr":"172.21.15.134:6821/1738784974","state":["exists","up"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6825","nonce":3328015815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6827","nonce":3328015815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6831","nonce":3328015815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6829","nonce":3328015815}]},"public_addr":"172.21.15.134:6825/3328015815","cluster_addr":"172.21.15.134:6827/3328015815","heartbeat_back_addr":"172.21.15.134:6831/3328015815","heartbeat_front_addr":"172.21.15.134:6829/3328015815","state":["exists","up"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6801","nonce":1987494452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6803","nonce":1987494452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6807","nonce":1987494452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6805","nonce":1987494452}]},"public_addr":"172.21.15.134:6801/1987494452","cluster_addr":"172.21.15.134:6803/1987494452","heartbeat_back_addr":"172.21.15.134:6807/1987494452","heartbeat_front_addr":"172.21.15.134:6805/1987494452","state":["exists","up"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6809","nonce":4151481030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6811","nonce":4151481030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6815","nonce":4151481030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":4151481030},{"type":"v1","addr":"172.21.15.134:6813","nonce":4151481030}]},"public_addr":"172.21.15.134:6809/4151481030","cluster_addr":"172.21.15.134:6811/4151481030","heartbeat_back_addr":"172.21.15.134:6815/4151481030","heartbeat_front_addr":"172.21.15.134:6813/4151481030","state":["exists","up"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6801","nonce":1724687038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6803","nonce":1724687038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6807","nonce":1724687038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6805","nonce":1724687038}]},"public_addr":"172.21.15.149:6801/1724687038","cluster_addr":"172.21.15.149:6803/1724687038","heartbeat_back_addr":"172.21.15.149:6807/1724687038","heartbeat_front_addr":"172.21.15.149:6805/1724687038","state":["exists","up"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6809","nonce":497583447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6811","nonce":497583447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6815","nonce":497583447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6813","nonce":497583447}]},"public_addr":"172.21.15.149:6809/497583447","cluster_addr":"172.21.15.149:6811/497583447","heartbeat_back_addr":"172.21.15.149:6815/497583447","heartbeat_front_addr":"172.21.15.149:6813/497583447","state":["exists","up"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6825","nonce":1853322645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6827","nonce":1853322645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6831","nonce":1853322645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6829","nonce":1853322645}]},"public_addr":"172.21.15.149:6825/1853322645","cluster_addr":"172.21.15.149:6827/1853322645","heartbeat_back_addr":"172.21.15.149:6831/1853322645","heartbeat_front_addr":"172.21.15.149:6829/1853322645","state":["exists","up"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6817","nonce":1872776196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6819","nonce":1872776196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6823","nonce":1872776196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6821","nonce":1872776196}]},"public_addr":"172.21.15.149:6817/1872776196","cluster_addr":"172.21.15.149:6819/1872776196","heartbeat_back_addr":"172.21.15.149:6823/1872776196","heartbeat_front_addr":"172.21.15.149:6821/1872776196","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.845585+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.467598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.110690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.614040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.594902+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.591315+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.191972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.510686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:15:29.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T22:15:29.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T22:15:29.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T22:15:29.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T22:15:29.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T22:15:29.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T22:15:29.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T22:15:29.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T22:15:29.582 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-09-21T22:15:29.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:15:29.584 INFO:teuthology.orchestra.run.smithi134.stdout:55834574854 2024-09-21T22:15:29.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:15:29.588 INFO:teuthology.orchestra.run.smithi134.stdout:55834574853 2024-09-21T22:15:29.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:15:29.591 INFO:teuthology.orchestra.run.smithi134.stdout:55834574852 2024-09-21T22:15:29.591 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:15:29.593 INFO:teuthology.orchestra.run.smithi134.stdout:55834574853 2024-09-21T22:15:29.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:15:29.595 INFO:teuthology.orchestra.run.smithi134.stdout:55834574851 2024-09-21T22:15:29.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:15:29.596 INFO:teuthology.orchestra.run.smithi134.stdout:55834574852 2024-09-21T22:15:29.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:15:29.601 INFO:teuthology.orchestra.run.smithi134.stdout:55834574854 2024-09-21T22:15:29.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:15:30.148 INFO:teuthology.orchestra.run.smithi134.stdout:55834574852 2024-09-21T22:15:30.155 INFO:teuthology.orchestra.run.smithi134.stdout:55834574851 2024-09-21T22:15:30.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2024-09-21T22:15:30.170 INFO:teuthology.orchestra.run.smithi134.stdout:55834574850 2024-09-21T22:15:30.170 INFO:teuthology.orchestra.run.smithi134.stdout:55834574853 2024-09-21T22:15:30.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-09-21T22:15:30.183 INFO:teuthology.orchestra.run.smithi134.stdout:55834574851 2024-09-21T22:15:30.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2024-09-21T22:15:30.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2024-09-21T22:15:30.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.7 2024-09-21T22:15:30.200 INFO:teuthology.orchestra.run.smithi134.stdout:55834574851 2024-09-21T22:15:30.200 INFO:teuthology.orchestra.run.smithi134.stdout:55834574851 2024-09-21T22:15:30.212 INFO:teuthology.orchestra.run.smithi134.stdout:55834574852 2024-09-21T22:15:30.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-09-21T22:15:30.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.4 2024-09-21T22:15:30.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2024-09-21T22:15:31.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:15:31.177 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:15:31.193 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:15:31.193 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:15:31.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:15:31.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:15:31.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:15:31.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:15:31.724 INFO:teuthology.orchestra.run.smithi134.stdout:55834574854 2024-09-21T22:15:31.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-21T22:15:31.744 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.780 INFO:teuthology.orchestra.run.smithi134.stdout:55834574853 2024-09-21T22:15:31.785 INFO:teuthology.orchestra.run.smithi134.stdout:55834574853 2024-09-21T22:15:31.787 INFO:teuthology.orchestra.run.smithi134.stdout:55834574853 2024-09-21T22:15:31.794 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-09-21T22:15:31.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-09-21T22:15:31.801 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-09-21T22:15:31.805 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.807 INFO:teuthology.orchestra.run.smithi134.stdout:55834574852 2024-09-21T22:15:31.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2024-09-21T22:15:31.809 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-21T22:15:31.815 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.816 INFO:teuthology.orchestra.run.smithi134.stdout:55834574853 2024-09-21T22:15:31.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.1 2024-09-21T22:15:31.824 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.2 2024-09-21T22:15:31.830 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.846 INFO:teuthology.orchestra.run.smithi134.stdout:55834574854 2024-09-21T22:15:31.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-21T22:15:31.856 DEBUG:teuthology.parallel:result is None 2024-09-21T22:15:31.856 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T22:15:31.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:15:32.172 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:15:32.184 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-21T22:15:31.869930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219084,"kb_used_data":2828,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2895872,"data_stored":1751898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.476748"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:29.004098+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:15:29.004098+0000","last_peered":"2024-09-21T22:15:29.004098+0000","last_clean":"2024-09-21T22:15:29.004098+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:15:29.004098+0000","last_undegraded":"2024-09-21T22:15:29.004098+0000","last_fullsized":"2024-09-21T22:15:29.004098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408718+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:15:28.408718+0000","last_peered":"2024-09-21T22:15:28.408718+0000","last_clean":"2024-09-21T22:15:28.408718+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:15:28.408718+0000","last_undegraded":"2024-09-21T22:15:28.408718+0000","last_fullsized":"2024-09-21T22:15:28.408718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402054+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:15:28.402054+0000","last_peered":"2024-09-21T22:15:28.402054+0000","last_clean":"2024-09-21T22:15:28.402054+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:15:28.402054+0000","last_undegraded":"2024-09-21T22:15:28.402054+0000","last_fullsized":"2024-09-21T22:15:28.402054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408704+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:15:28.408704+0000","last_peered":"2024-09-21T22:15:28.408704+0000","last_clean":"2024-09-21T22:15:28.408704+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:15:28.408704+0000","last_undegraded":"2024-09-21T22:15:28.408704+0000","last_fullsized":"2024-09-21T22:15:28.408704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.405504+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:15:28.405504+0000","last_peered":"2024-09-21T22:15:28.405504+0000","last_clean":"2024-09-21T22:15:28.405504+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:15:28.405504+0000","last_undegraded":"2024-09-21T22:15:28.405504+0000","last_fullsized":"2024-09-21T22:15:28.405504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401457+0000","last_change":"2024-09-21T22:15:28.401457+0000","last_active":"2024-09-21T22:15:28.401457+0000","last_peered":"2024-09-21T22:15:28.401457+0000","last_clean":"2024-09-21T22:15:28.401457+0000","last_became_active":"2024-09-21T22:15:26.635131+0000","last_became_peered":"2024-09-21T22:15:26.635131+0000","last_unstale":"2024-09-21T22:15:28.401457+0000","last_undegraded":"2024-09-21T22:15:28.401457+0000","last_fullsized":"2024-09-21T22:15:28.401457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:21.691936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402053+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:15:28.402053+0000","last_peered":"2024-09-21T22:15:28.402053+0000","last_clean":"2024-09-21T22:15:28.402053+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:15:28.402053+0000","last_undegraded":"2024-09-21T22:15:28.402053+0000","last_fullsized":"2024-09-21T22:15:28.402053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.404062+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:15:28.404062+0000","last_peered":"2024-09-21T22:15:28.404062+0000","last_clean":"2024-09-21T22:15:28.404062+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:15:28.404062+0000","last_undegraded":"2024-09-21T22:15:28.404062+0000","last_fullsized":"2024-09-21T22:15:28.404062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401627+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:15:28.401627+0000","last_peered":"2024-09-21T22:15:28.401627+0000","last_clean":"2024-09-21T22:15:28.401627+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:15:28.401627+0000","last_undegraded":"2024-09-21T22:15:28.401627+0000","last_fullsized":"2024-09-21T22:15:28.401627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:15:32.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:15:32.458 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:32.459 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:15:32.471 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-21T22:15:31.869930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219084,"kb_used_data":2828,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2895872,"data_stored":1751898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.476748"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:29.004098+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:15:29.004098+0000","last_peered":"2024-09-21T22:15:29.004098+0000","last_clean":"2024-09-21T22:15:29.004098+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:15:29.004098+0000","last_undegraded":"2024-09-21T22:15:29.004098+0000","last_fullsized":"2024-09-21T22:15:29.004098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408718+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:15:28.408718+0000","last_peered":"2024-09-21T22:15:28.408718+0000","last_clean":"2024-09-21T22:15:28.408718+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:15:28.408718+0000","last_undegraded":"2024-09-21T22:15:28.408718+0000","last_fullsized":"2024-09-21T22:15:28.408718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402054+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:15:28.402054+0000","last_peered":"2024-09-21T22:15:28.402054+0000","last_clean":"2024-09-21T22:15:28.402054+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:15:28.402054+0000","last_undegraded":"2024-09-21T22:15:28.402054+0000","last_fullsized":"2024-09-21T22:15:28.402054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408704+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:15:28.408704+0000","last_peered":"2024-09-21T22:15:28.408704+0000","last_clean":"2024-09-21T22:15:28.408704+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:15:28.408704+0000","last_undegraded":"2024-09-21T22:15:28.408704+0000","last_fullsized":"2024-09-21T22:15:28.408704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.405504+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:15:28.405504+0000","last_peered":"2024-09-21T22:15:28.405504+0000","last_clean":"2024-09-21T22:15:28.405504+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:15:28.405504+0000","last_undegraded":"2024-09-21T22:15:28.405504+0000","last_fullsized":"2024-09-21T22:15:28.405504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401457+0000","last_change":"2024-09-21T22:15:28.401457+0000","last_active":"2024-09-21T22:15:28.401457+0000","last_peered":"2024-09-21T22:15:28.401457+0000","last_clean":"2024-09-21T22:15:28.401457+0000","last_became_active":"2024-09-21T22:15:26.635131+0000","last_became_peered":"2024-09-21T22:15:26.635131+0000","last_unstale":"2024-09-21T22:15:28.401457+0000","last_undegraded":"2024-09-21T22:15:28.401457+0000","last_fullsized":"2024-09-21T22:15:28.401457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:21.691936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402053+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:15:28.402053+0000","last_peered":"2024-09-21T22:15:28.402053+0000","last_clean":"2024-09-21T22:15:28.402053+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:15:28.402053+0000","last_undegraded":"2024-09-21T22:15:28.402053+0000","last_fullsized":"2024-09-21T22:15:28.402053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.404062+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:15:28.404062+0000","last_peered":"2024-09-21T22:15:28.404062+0000","last_clean":"2024-09-21T22:15:28.404062+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:15:28.404062+0000","last_undegraded":"2024-09-21T22:15:28.404062+0000","last_fullsized":"2024-09-21T22:15:28.404062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401627+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:15:28.401627+0000","last_peered":"2024-09-21T22:15:28.401627+0000","last_clean":"2024-09-21T22:15:28.401627+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:15:28.401627+0000","last_undegraded":"2024-09-21T22:15:28.401627+0000","last_fullsized":"2024-09-21T22:15:28.401627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:15:32.472 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T22:15:32.472 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T22:15:32.472 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T22:15:32.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T22:15:32.783 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:32.783 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T22:15:32.796 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T22:15:32.796 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-21T22:15:32.805 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-21T22:15:32.806 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-21T22:15:32.806 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-21T22:15:32.806 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-21T22:15:33.102 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-21T22:15:33.102 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T22:15:33.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:15:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:33.378 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:15:33.390 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T22:15:33.174534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219084,"kb_used_data":2828,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2895872,"data_stored":1751898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001151"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:29.004098+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:15:29.004098+0000","last_peered":"2024-09-21T22:15:29.004098+0000","last_clean":"2024-09-21T22:15:29.004098+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:15:29.004098+0000","last_undegraded":"2024-09-21T22:15:29.004098+0000","last_fullsized":"2024-09-21T22:15:29.004098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408718+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:15:28.408718+0000","last_peered":"2024-09-21T22:15:28.408718+0000","last_clean":"2024-09-21T22:15:28.408718+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:15:28.408718+0000","last_undegraded":"2024-09-21T22:15:28.408718+0000","last_fullsized":"2024-09-21T22:15:28.408718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402054+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:15:28.402054+0000","last_peered":"2024-09-21T22:15:28.402054+0000","last_clean":"2024-09-21T22:15:28.402054+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:15:28.402054+0000","last_undegraded":"2024-09-21T22:15:28.402054+0000","last_fullsized":"2024-09-21T22:15:28.402054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408704+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:15:28.408704+0000","last_peered":"2024-09-21T22:15:28.408704+0000","last_clean":"2024-09-21T22:15:28.408704+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:15:28.408704+0000","last_undegraded":"2024-09-21T22:15:28.408704+0000","last_fullsized":"2024-09-21T22:15:28.408704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.405504+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:15:28.405504+0000","last_peered":"2024-09-21T22:15:28.405504+0000","last_clean":"2024-09-21T22:15:28.405504+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:15:28.405504+0000","last_undegraded":"2024-09-21T22:15:28.405504+0000","last_fullsized":"2024-09-21T22:15:28.405504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401457+0000","last_change":"2024-09-21T22:15:28.401457+0000","last_active":"2024-09-21T22:15:28.401457+0000","last_peered":"2024-09-21T22:15:28.401457+0000","last_clean":"2024-09-21T22:15:28.401457+0000","last_became_active":"2024-09-21T22:15:26.635131+0000","last_became_peered":"2024-09-21T22:15:26.635131+0000","last_unstale":"2024-09-21T22:15:28.401457+0000","last_undegraded":"2024-09-21T22:15:28.401457+0000","last_fullsized":"2024-09-21T22:15:28.401457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:21.691936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402053+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:15:28.402053+0000","last_peered":"2024-09-21T22:15:28.402053+0000","last_clean":"2024-09-21T22:15:28.402053+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:15:28.402053+0000","last_undegraded":"2024-09-21T22:15:28.402053+0000","last_fullsized":"2024-09-21T22:15:28.402053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.404062+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:15:28.404062+0000","last_peered":"2024-09-21T22:15:28.404062+0000","last_clean":"2024-09-21T22:15:28.404062+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:15:28.404062+0000","last_undegraded":"2024-09-21T22:15:28.404062+0000","last_fullsized":"2024-09-21T22:15:28.404062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401627+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:15:28.401627+0000","last_peered":"2024-09-21T22:15:28.401627+0000","last_clean":"2024-09-21T22:15:28.401627+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:15:28.401627+0000","last_undegraded":"2024-09-21T22:15:28.401627+0000","last_fullsized":"2024-09-21T22:15:28.401627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:15:33.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:33.664 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T22:15:33.174534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219084,"kb_used_data":2828,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2895872,"data_stored":1751898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001151"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:29.004098+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:15:29.004098+0000","last_peered":"2024-09-21T22:15:29.004098+0000","last_clean":"2024-09-21T22:15:29.004098+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:15:29.004098+0000","last_undegraded":"2024-09-21T22:15:29.004098+0000","last_fullsized":"2024-09-21T22:15:29.004098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408718+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:15:28.408718+0000","last_peered":"2024-09-21T22:15:28.408718+0000","last_clean":"2024-09-21T22:15:28.408718+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:15:28.408718+0000","last_undegraded":"2024-09-21T22:15:28.408718+0000","last_fullsized":"2024-09-21T22:15:28.408718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402054+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:15:28.402054+0000","last_peered":"2024-09-21T22:15:28.402054+0000","last_clean":"2024-09-21T22:15:28.402054+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:15:28.402054+0000","last_undegraded":"2024-09-21T22:15:28.402054+0000","last_fullsized":"2024-09-21T22:15:28.402054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.408704+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:15:28.408704+0000","last_peered":"2024-09-21T22:15:28.408704+0000","last_clean":"2024-09-21T22:15:28.408704+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:15:28.408704+0000","last_undegraded":"2024-09-21T22:15:28.408704+0000","last_fullsized":"2024-09-21T22:15:28.408704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.405504+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:15:28.405504+0000","last_peered":"2024-09-21T22:15:28.405504+0000","last_clean":"2024-09-21T22:15:28.405504+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:15:28.405504+0000","last_undegraded":"2024-09-21T22:15:28.405504+0000","last_fullsized":"2024-09-21T22:15:28.405504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401457+0000","last_change":"2024-09-21T22:15:28.401457+0000","last_active":"2024-09-21T22:15:28.401457+0000","last_peered":"2024-09-21T22:15:28.401457+0000","last_clean":"2024-09-21T22:15:28.401457+0000","last_became_active":"2024-09-21T22:15:26.635131+0000","last_became_peered":"2024-09-21T22:15:26.635131+0000","last_unstale":"2024-09-21T22:15:28.401457+0000","last_undegraded":"2024-09-21T22:15:28.401457+0000","last_fullsized":"2024-09-21T22:15:28.401457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:21.691936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.402053+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:15:28.402053+0000","last_peered":"2024-09-21T22:15:28.402053+0000","last_clean":"2024-09-21T22:15:28.402053+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:15:28.402053+0000","last_undegraded":"2024-09-21T22:15:28.402053+0000","last_fullsized":"2024-09-21T22:15:28.402053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.404062+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:15:28.404062+0000","last_peered":"2024-09-21T22:15:28.404062+0000","last_clean":"2024-09-21T22:15:28.404062+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:15:28.404062+0000","last_undegraded":"2024-09-21T22:15:28.404062+0000","last_fullsized":"2024-09-21T22:15:28.404062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:15:28.401627+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:15:28.401627+0000","last_peered":"2024-09-21T22:15:28.401627+0000","last_clean":"2024-09-21T22:15:28.401627+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:15:28.401627+0000","last_undegraded":"2024-09-21T22:15:28.401627+0000","last_fullsized":"2024-09-21T22:15:28.401627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:15:33.677 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T22:15:33.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-21T22:15:33.950 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 22 2024-09-21T22:15:33.950 INFO:teuthology.orchestra.run.smithi134.stdout:fsid aacb52bd-b292-44e0-94ba-ee8e83c0c924 2024-09-21T22:15:33.950 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-09-21T22:15:07.092340+0000 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-09-21T22:15:31.867361+0000 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:crush_version 4 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:full_ratio 0.95 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:backfillfull_ratio 0.9 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:nearfull_ratio 0.85 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:require_min_compat_client luminous 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:min_compat_client jewel 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:require_osd_release squid 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:stretch_mode_enabled false 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:max_osd 8 2024-09-21T22:15:33.951 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/1738784974,v1:172.21.15.134:6817/1738784974] [v2:172.21.15.134:6818/1738784974,v1:172.21.15.134:6819/1738784974] exists,up 96ad0a5a-c464-448c-b390-6e73c8fb449e 2024-09-21T22:15:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/3328015815,v1:172.21.15.134:6825/3328015815] [v2:172.21.15.134:6826/3328015815,v1:172.21.15.134:6827/3328015815] exists,up f2c75579-e93c-44e8-85ed-144ec4ba096d 2024-09-21T22:15:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/1987494452,v1:172.21.15.134:6801/1987494452] [v2:172.21.15.134:6802/1987494452,v1:172.21.15.134:6803/1987494452] exists,up a2ae2709-79f1-4a99-b854-d72cfe661be9 2024-09-21T22:15:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/4151481030,v1:172.21.15.134:6809/4151481030] [v2:172.21.15.134:6810/4151481030,v1:172.21.15.134:6811/4151481030] exists,up 94ed467c-6601-41ec-8bdb-9d1f0d4c078b 2024-09-21T22:15:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/1724687038,v1:172.21.15.149:6801/1724687038] [v2:172.21.15.149:6802/1724687038,v1:172.21.15.149:6803/1724687038] exists,up 74e011e7-766b-437a-b71b-09fc990e210d 2024-09-21T22:15:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6808/497583447,v1:172.21.15.149:6809/497583447] [v2:172.21.15.149:6810/497583447,v1:172.21.15.149:6811/497583447] exists,up e7650da2-cbad-4915-bc9c-d5154151bcc0 2024-09-21T22:15:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6824/1853322645,v1:172.21.15.149:6825/1853322645] [v2:172.21.15.149:6826/1853322645,v1:172.21.15.149:6827/1853322645] exists,up aec4bd84-857e-4cc9-898c-93440ba485c8 2024-09-21T22:15:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6816/1872776196,v1:172.21.15.149:6817/1872776196] [v2:172.21.15.149:6818/1872776196,v1:172.21.15.149:6819/1872776196] exists,up a244e703-8ec9-4edc-b0ca-e33b38bbd99c 2024-09-21T22:15:33.963 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/1738784974,v1:172.21.15.134:6817/1738784974] [v2:172.21.15.134:6818/1738784974,v1:172.21.15.134:6819/1738784974] exists,up 96ad0a5a-c464-448c-b390-6e73c8fb449e', 'osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/3328015815,v1:172.21.15.134:6825/3328015815] [v2:172.21.15.134:6826/3328015815,v1:172.21.15.134:6827/3328015815] exists,up f2c75579-e93c-44e8-85ed-144ec4ba096d', 'osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/1987494452,v1:172.21.15.134:6801/1987494452] [v2:172.21.15.134:6802/1987494452,v1:172.21.15.134:6803/1987494452] exists,up a2ae2709-79f1-4a99-b854-d72cfe661be9', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/4151481030,v1:172.21.15.134:6809/4151481030] [v2:172.21.15.134:6810/4151481030,v1:172.21.15.134:6811/4151481030] exists,up 94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/1724687038,v1:172.21.15.149:6801/1724687038] [v2:172.21.15.149:6802/1724687038,v1:172.21.15.149:6803/1724687038] exists,up 74e011e7-766b-437a-b71b-09fc990e210d', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6808/497583447,v1:172.21.15.149:6809/497583447] [v2:172.21.15.149:6810/497583447,v1:172.21.15.149:6811/497583447] exists,up e7650da2-cbad-4915-bc9c-d5154151bcc0', 'osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6824/1853322645,v1:172.21.15.149:6825/1853322645] [v2:172.21.15.149:6826/1853322645,v1:172.21.15.149:6827/1853322645] exists,up aec4bd84-857e-4cc9-898c-93440ba485c8', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6816/1872776196,v1:172.21.15.149:6817/1872776196] [v2:172.21.15.149:6818/1872776196,v1:172.21.15.149:6819/1872776196] exists,up a244e703-8ec9-4edc-b0ca-e33b38bbd99c'] 2024-09-21T22:15:33.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "mon.a", 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster": "ceph", 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "admin_socket_mode": "", 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_client_required": "cephx, none", 2024-09-21T22:15:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_cluster_required": "cephx", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_debug": "true", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_service_required": "cephx", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "auth_supported": "cephx", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio": "true", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio_poll_ms": "250", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_aio_reap_max": "16", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_async_discard": "false", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_block_size": "4096", 2024-09-21T22:15:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_aio": "false", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_debug_inflight_ios": "false", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_enable_discard": "false", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_flock_retry": "3", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_inject_crash": "0", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_ioring": "false", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_ioring_hipri": "false", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-21T22:15:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bdev_type": "", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_alloc_size": "1048576", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_allocator": "hybrid", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_buffered_io": "true", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_check_for_zeros": "false", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_compact_log_sync": "false", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-21T22:15:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_max_log_runway": "4194304", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_max_prefetch": "1048576", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_min_flush_size": "524288", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_min_log_runway": "1048576", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_replay_recovery": "false", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_sync_write": "false", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_allocation_from_file": "true", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_allocator": "hybrid", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-21T22:15:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bdev_label_multi": "true", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_create": "true", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_db_create": "false", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_db_path": "", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_db_size": "0", 2024-09-21T22:15:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_path": "", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_preallocate_file": "false", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_size": "107374182400", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_wal_create": "false", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_wal_path": "", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_block_wal_size": "100663296", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs": "true", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-21T22:15:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_autotune": "true", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_size": "0", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_type": "2q", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_clone_cow": "true", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-21T22:15:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_mode": "none", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_csum_type": "crc32c", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_freelist": "false", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-21T22:15:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_small_allocations": "0", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_default_buffered_read": "true", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_default_buffered_write": "false", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-21T22:15:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fail_eio": "false", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-21T22:15:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mount": "false", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_umount": "false", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_ignore_data_csum": "false", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-21T22:15:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_log_op_age": "5.000000", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_alloc_size": "0", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_blob_size": "0", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_max_deferred_txc": "32", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_min_alloc_size": "0", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_nid_prealloc": "1024", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-21T22:15:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_retry_disk_reads": "3", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_cf": "true", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-21T22:15:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_spdk_mem": "512", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_tracing": "false", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-21T22:15:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_zero_block_detection": "false", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-21T22:15:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_cluster_require_signatures": "false", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_cluster_require_version": "2", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_require_signatures": "false", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_require_version": "2", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_service_require_signatures": "false", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_service_require_version": "2", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "cephx_sign_messages": "true", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "chdir": "", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_acl_type": "", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_asio_thread_count": "2", 2024-09-21T22:15:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_cache_mid": "0.750000", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_cache_size": "16384", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_caps_release_delay": "5", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_check_pool_perm": "true", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_force_sync_read": "false", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_getattr_caps": "false", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_inject_features": "", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_debug_inject_tick_delay": "0", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_die_on_failed_remount": "false", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_dirsize_rbytes": "true", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_force_lazyio": "false", 2024-09-21T22:15:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_fs": "", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_inject_release_failure": "false", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_max_inline_size": "4096", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mds_namespace": "", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_metadata": "", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mount_gid": "-1", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mount_timeout": "300", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mount_uid": "-1", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_mountpoint": "/", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_notify_timeout": "10", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc": "true", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_max_dirty": "104857600", 2024-09-21T22:15:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_max_objects": "1000", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_size": "209715200", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_oc_target_dirty": "8388608", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_permissions": "true", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_quota": "true", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_quota_df": "true", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_readahead_max_bytes": "0", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_readahead_max_periods": "4", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_readahead_min": "131072", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_reconnect_stale": "false", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_shutdown_timeout": "30", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_snapdir": ".snap", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_tick_interval": "1", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_trace": "", 2024-09-21T22:15:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_try_dentry_invalidate": "false", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_use_faked_inos": "false", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_use_random_mds": "false", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_graylog": "false", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_graylog_port": "12201", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_monitors": "default=true", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_syslog": "false", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "clog_to_syslog_level": "info", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "-", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_network": "", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_network_interface": "", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zlib_isal": "false", 2024-09-21T22:15:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zlib_level": "5", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zlib_winsize": "-15", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "compressor_zstd_level": "1", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_alien_op_num_threads": "6", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_osd_stat_interval": "0", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_seastar_cpu_cores": "", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crimson_seastar_num_threads": "0", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_location": "", 2024-09-21T22:15:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_location_hook": "", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_location_hook_timeout": "10", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "daemonize": "false", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "daos_pool": "tank", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_alienstore": "0/5", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_allow_any_pool_priority": "false", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_asok": "1/5", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_asok_assert_abort": "false", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_asserts_on_shutdown": "true", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_auth": "20/20", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_bdev": "1/3", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_bluefs": "1/5", 2024-09-21T22:15:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_bluestore": "1/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_buffer": "0/1", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_ceph_exporter": "1/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_cephfs_mirror": "0/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_cephsqlite": "0/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_client": "0/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_compressor": "1/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_context": "0/1", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_crimson_interrupt": "0/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_crush": "1/1", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_crypto": "1/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_cyanstore": "0/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_deliberately_leak_memory": "false", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_disable_randomized_ping": "false", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_dpdk": "1/5", 2024-09-21T22:15:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_eventtrace": "1/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_filer": "0/1", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_filestore": "1/3", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_finisher": "1/1", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_fuse": "1/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_heartbeat_testing_span": "0", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_heartbeatmap": "1/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_javaclient": "1/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_journal": "1/3", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_journaler": "0/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_kstore": "1/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_lockdep": "0/1", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mclock": "1/5", 2024-09-21T22:15:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_balancer": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_locker": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_log": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_log_expire": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_migrator": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mds_quiesce": "3/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_memstore": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mgr": "2/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mgrc": "1/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_mon": "20/20", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_monc": "0/10", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_ms": "1/1", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_none": "0/5", 2024-09-21T22:15:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_objclass": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_objectcacher": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_objecter": "0/1", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_optracker": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_osd": "1/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_paxos": "20/20", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_perfcounter": "1/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_prioritycache": "1/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rados": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd_mirror": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd_pwl": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rbd_replay": "0/5", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_refs": "0/0", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_reserver": "1/1", 2024-09-21T22:15:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw": "1/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_access": "1/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_datacache": "1/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_dbstore": "1/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_flight": "1/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rgw_sync": "1/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_rocksdb": "4/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore": "0/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_backref": "0/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_cache": "0/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_cleaner": "0/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_device": "0/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_epm": "0/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-21T22:15:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_journal": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_lba": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_odata": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_omap": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_onode": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_t": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_seastore_tm": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_striper": "0/1", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_test": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_throttle": "1/1", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_timer": "0/1", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_tp": "0/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "debug_trace": "1/5", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-21T22:15:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "device_failure_prediction_mode": "none", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_graylog": "false", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_journald": "false", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_stderr": "true", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "err_to_syslog": "false", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event_tracing": "false", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_addr": "0.0.0.0", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_http_port": "9926", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_prio_limit": "5", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_sort_metrics": "true", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "exporter_stats_period": "5", 2024-09-21T22:15:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "fake_statfs_for_testing": "0", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "fatal_signal_handlers": "true", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filer_max_purge_ops": "10", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filer_max_truncate_ops": "128", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_apply_finisher_threads": "1", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_blackhole": "false", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_btrfs_clone_range": "true", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_btrfs_snap": "true", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_caller_concurrency": "10", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_collect_device_partition_information": "true", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_commit_timeout": "600.000000", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_inject_read_err": "false", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_omap_check": "false", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-21T22:15:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_debug_verify_split": "false", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_dump_file": "", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fadvise": "true", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fail_eio": "true", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fd_cache_shards": "16", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fd_cache_size": "128", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fiemap": "false", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fiemap_threshold": "4096", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_inject_stall": "0", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_journal_parallel": "false", 2024-09-21T22:15:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_journal_trailing": "false", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_journal_writeahead": "false", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_kill_at": "0", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs": "0", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-21T22:15:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size": "0", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_merge_threshold": "-10", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_odsync_write": "false", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_omap_backend": "rocksdb", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_omap_backend_path": "", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-21T22:15:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_op_thread_timeout": "60", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_op_threads": "2", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_punch_hole": "false", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_queue_max_ops": "50", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-21T22:15:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_seek_data_hole": "false", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_sloppy_crc": "false", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_splice": "false", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_split_multiple": "2", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_split_rand_factor": "20", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_update_to": "1000", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-21T22:15:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_enable": "true", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_xfs_extsize": "false", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "filestore_zfs_snap": "false", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "fio_dir": "/tmp/fio", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_allow_other": "true", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_atomic_o_trunc": "true", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_big_writes": "true", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_debug": "false", 2024-09-21T22:15:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_default_permissions": "false", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_disable_pagecache": "false", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_max_write": "0", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_multithreaded": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_require_active_mds": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_set_user_groups": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_splice_move": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_splice_read": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_splice_write": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "fuse_use_invalidate_cb": "true", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "gss_target_name": "ceph", 2024-09-21T22:15:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_file": "", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_inject_failure": "0", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_interval": "5", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "host": "smithi134", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-21T22:15:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "inject_early_sigterm": "false", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "jaeger_agent_port": "6799", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "jaeger_tracing_enable": "false", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_aio": "true", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_align_min_size": "65536", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_block_align": "true", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_block_size": "4096", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_dio": "true", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_discard": "false", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_force_aio": "false", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_ignore_corruption": "false", 2024-09-21T22:15:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_max_write_bytes": "10485760", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_max_write_entries": "100", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_replay_from": "0", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_write_header_frequency": "0", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journal_zero_on_create": "false", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journaler_prefetch_periods": "10", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journaler_prezero_periods": "5", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "journaler_write_head_interval": "15", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "keyfile": "", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-21T22:15:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_backend": "rocksdb", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_default_stripe_size": "65536", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_fsck_on_mount": "false", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_max_bytes": "67108864", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_max_ops": "512", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_nid_prealloc": "1024", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_onode_map_size": "1024", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_sync_submit_transaction": "false", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "kstore_sync_transaction": "false", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "librados_thread_count": "2", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "lockdep": "false", 2024-09-21T22:15:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "lockdep_force_backtrace": "false", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_coarse_timestamps": "true", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_flush_on_exit": "false", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_graylog_host": "127.0.0.1", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_graylog_port": "12201", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_max_new": "1000", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_max_recent": "10000", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_stderr_prefix": "", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_stop_at_utilization": "0.970000", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_file": "true", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_graylog": "false", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_journald": "false", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_stderr": "false", 2024-09-21T22:15:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "log_to_syslog": "false", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "max_rotating_auth_attempts": "10", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_action_on_write_error": "1", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_alternate_name_max": "8192", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_asio_thread_count": "2", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_export_pin": "true", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_dirs": "true", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_interval": "5", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_interval": "10", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_max": "-1", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_max_until": "-1", 2024-09-21T22:15:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_merge_size": "50", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_midchunk": "0.300000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_min_start": "0.200000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_minchunk": "0.001000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_mode": "0", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_need_max": "1.200000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_need_min": "0.800000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_overload_epochs": "2", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_bits": "3", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_size": "10000", 2024-09-21T22:15:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_target_decay": "10.000000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_beacon_grace": "15.000000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_beacon_interval": "4.000000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_mid": "0.700000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_delay": "0", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_release_free_interval": "10", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_reservation": "0.050000", 2024-09-21T22:15:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_trim_interval": "1", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache_trim_threshold": "262144", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_client_prealloc_inos": "1000", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_connect_bootstrapping": "false", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_damage_table_max_entries": "10000", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_auth_pins": "false", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_frag": "false", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_scatterstat": "false", 2024-09-21T22:15:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_debug_subtrees": "false", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_decay_halflife": "5.000000", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_default_dir_hash": "2", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_defer_session_stale": "true", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_deny_all_reconnect": "false", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_keys_per_op": "16384", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_max_commit_size": "10", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_max_entries": "0", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dir_prefetch": "true", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_on_map": "false", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_early_reply": "true", 2024-09-21T22:15:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_enable_op_tracker": "true", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_enforce_unique_name": "true", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_random": "true", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_health_summarize_threshold": "10", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-21T22:15:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_health_dummy": "false", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_migrator_session_race": "false", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_join_fs": "", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_journal_format": "1", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_create_at": "0", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_export_at": "0", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_import_at": "0", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_journal_at": "0", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_journal_expire_at": "0", 2024-09-21T22:15:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_journal_replay_at": "0", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_link_at": "0", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_mdstable_at": "0", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_openc_at": "0", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_rename_at": "0", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_kill_shutdown_at": "0", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_event_large_threshold": "524288", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_events_per_segment": "1024", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_max_events": "-1", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_max_segments": "128", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_pause": "false", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_segment_size": "0", 2024-09-21T22:15:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_trim_threshold": "128", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log_warn_factor": "2.000000", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_caps_per_client": "1048576", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_completed_flushes": "100000", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_completed_requests": "100000", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_export_size": "20971520", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_file_recover": "32", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_purge_files": "64", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_purge_ops": "8192", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-21T22:15:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_max_snaps_per_dir": "100", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_metrics_update_interval": "2", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_min_caps_per_client": "100", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_min_caps_working_set": "10000", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_numa_node": "-1", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_complaint_time": "30.000000", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_duration": "600", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_size": "20", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_slow_op_size": "20", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_op_log_threshold": "5", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_ping_grace": "15", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_ping_interval": "5", 2024-09-21T22:15:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_max_caps": "30000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_recall_warning_threshold": "262144", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_replay_interval": "1.000000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_root_ino_gid": "0", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_root_ino_uid": "0", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-21T22:15:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_shutdown_check": "0", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_skip_ino": "0", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_snap_max_uid": "4294967294", 2024-09-21T22:15:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_snap_min_uid": "0", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_snap_rstat": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_standby_replay_damaged": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_symlink_recovery": "true", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_thrash_exports": "0", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_thrash_fragments": "0", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_tick_interval": "5.000000", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_valgrind_exit": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_verify_backtrace": "1", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_verify_scatter": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_wipe_sessions": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool_debug": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-21T22:15:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_device_bytes": "1073741824", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_page_set": "false", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "memstore_page_size": "65536", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_client_bytes": "134217728", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_client_messages": "512", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_disabled_modules": "", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_enable_op_tracker": "true", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_max_pg_num_change": "128", 2024-09-21T22:15:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mds_bytes": "134217728", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mds_messages": "128", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mon_bytes": "134217728", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_mon_messages": "128", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_duration": "600", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_size": "20", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_op_log_threshold": "5", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_osd_bytes": "536870912", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_osd_messages": "8192", 2024-09-21T22:15:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_pool": "true", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_standby_modules": "true", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_stats_period": "5", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_stats_threshold": "5", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_tick_period": "2", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_allow_pool_delete": "true", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_allow_pool_size_one": "true", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_auth_validate_all_caps": "true", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_bytes": "104857600", 2024-09-21T22:15:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_directed_command_retry": "5", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_hunt_parallel": "3", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_log_interval": "1.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_ping_interval": "10.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_client_target_rank": "-1", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-21T22:15:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_file_level": "debug", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_file": "true", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_journald": "false", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_compact_on_bootstrap": "false", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_compact_on_start": "false", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_compact_on_trim": "true", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-21T22:15:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_cpu_threads": "4", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_crush_min_required_version": "hammer", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_daemon_bytes": "419430400", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data_avail_crit": "5", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data_avail_warn": "5", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_data_size_warn": "16106127360", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_dump_json": "false", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-21T22:15:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_dump_transactions": "false", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_extra_checks": "false", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_require_reef": "false", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_no_require_squid": "false", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_down_mkfs_grace": "120", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_down_uptime_grace": "60", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_election_default_strategy": "1", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_election_timeout": "5.000000", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-21T22:15:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_elector_ping_divisor": "2", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_enable_op_tracker": "true", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_fake_pool_delete": "false", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_force_quorum_join": "false", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_globalid_prealloc": "10000", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_detail_to_clog": "false", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_log_update_period": "5", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_max_detail": "50", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_to_clog": "true", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_to_clog_interval": "600", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-21T22:15:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_host": "172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790],172.21.15.149", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_host_override": "", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_initial_members": "", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_lease": "5.000000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_log_full_interval": "50", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_log_max": "10000", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_log_max_summary": "50", 2024-09-21T22:15:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_log_epochs": "500", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_osd": "10000", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_pg_per_osd": "10000", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_pool_pg_num": "65536", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mds_force_trim_to": "0", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mds_skip_sanity": "false", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_memory_autotune": "true", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_memory_target": "2147483648", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_beacon_grace": "30", 2024-09-21T22:15:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_digest_period": "5", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_inactive_grace": "60", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_min_osdmap_epochs": "500", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_complaint_time": "30", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_duration": "600", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_size": "20", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_slow_op_size": "20", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_op_log_threshold": "5", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-21T22:15:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_auto_mark_in": "false", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_cache_size": "500", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_down_out_interval": "600", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_force_trim_to": "0", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-21T22:15:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_min_down_reporters": "2", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_report_timeout": "900", 2024-09-21T22:15:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_stuck_threshold": "60", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-21T22:15:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_probe_timeout": "2.000000", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_max_change": "0.050000", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_max_osds": "4", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_interval": "86400", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_max_keys": "100", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_scrub_timeout": "300", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_session_timeout": "300", 2024-09-21T22:15:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_smart_report_timeout": "5", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stat_smooth_intervals": "6", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_pool_min_size": "2", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_pool_size": "4", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_debug": "false", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_provider_kill_at": "0", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_requester_kill_at": "0", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_sync_timeout": "60.000000", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_target_pg_per_osd": "100", 2024-09-21T22:15:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_tick_interval": "5", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_timecheck_interval": "300.000000", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_use_min_delay_socket": "false", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_older_version_delay": "604800", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_misplaced": "false", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_older_version": "true", 2024-09-21T22:15:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "monmap": "", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T22:15:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "motr_tracing_enabled": "false", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_op_threads": "3", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_cm": "false", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_device_name": "", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_dscp": "96", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_local_gid": "", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_port_num": "1", 2024-09-21T22:15:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_sl": "3", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_support_srq": "true", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_rdma_type": "ib", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_async_reap_threshold": "5", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_before_connect": "false", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_ipv4": "true", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_ipv6": "false", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_msgr1": "true", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_msgr2": "true", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_port_max": "7568", 2024-09-21T22:15:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_port_min": "6800", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_retry_count": "3", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_bind_retry_delay": "5", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_client": "false", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_mds": "false", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_mgr": "false", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_mon": "false", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_blackhole_osd": "false", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_client_mode": "crc secure", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_cluster_mode": "crc secure", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_cluster_type": "", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_compress_secure": "false", 2024-09-21T22:15:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_connection_idle_timeout": "900", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_connection_ready_timeout": "10", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_crc_data": "true", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_crc_header": "true", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_bad_msg": "false", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_bug": "true", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_old_message": "true", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_skipped_message": "false", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_coremask": "0xF", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_enable_tso": "true", 2024-09-21T22:15:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_hugepages": "", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_lro": "true", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_memory_channel": "4", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_pmd": "", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_port_id": "0", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_dump_on_send": "false", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_initial_backoff": "0.200000", 2024-09-21T22:15:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_delay_max": "1.000000", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_delay_type": "", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_network_congestion": "0", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_inject_socket_failures": "5000", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_learn_addr_from_peer": "true", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_max_accept_failures": "4", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_max_backoff": "15.000000", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_mon_client_mode": "secure crc", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_mon_service_mode": "secure crc", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_osd_compress_min_size": "1024", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_osd_compress_mode": "none", 2024-09-21T22:15:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_pq_min_cost": "65536", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_public_type": "", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_service_mode": "crc secure", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_listen_backlog": "512", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_nodelay": "true", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_tcp_rcvbuf": "0", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "ms_type": "async+posix", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "no_config_file": "false", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_completion_locks_per_session": "32", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-21T22:15:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_inflight_ops": "1024", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_tick_interval": "5.000000", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter_timeout": "10.000000", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "objectstore_blackhole": "false", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "openssl_engine_opts": "", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_delay_time": "5.000000", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_hist_halflife": "1000", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_max_low_ops": "2", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_max_ops": "4", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-21T22:15:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_agent_slop": "0.020000", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_asio_thread_count": "2", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_async_recovery_min_cost": "100", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backfill_scan_max": "512", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backfill_scan_min": "64", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backoff_on_degraded": "false", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backoff_on_peering": "false", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_backoff_on_unfound": "true", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_beacon_report_interval": "300", 2024-09-21T22:15:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_duration": "30", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_max_block_size": "67108864", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_blkin_trace_all": "false", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_check_for_log_corruption": "false", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_class_update_on_start": "true", 2024-09-21T22:15:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_message_cap": "256", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_message_size_cap": "524288000", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_op_priority": "63", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_client_watch_timeout": "30", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_command_max_records": "256", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_compact_on_start": "false", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_update_on_start": "true", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_crush_update_weight_set": "true", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-21T22:15:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_feed_pullee": "-1", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_misdirected_ops": "false", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_no_acting_change": "false", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_no_purge_strays": "false", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_op_order": "false", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-21T22:15:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_shutdown": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_trim_objects": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_snaps": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_keys": "1024", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_stride": "524288", 2024-09-21T22:15:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_default_notify_timeout": "30", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep": "0.000000", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_discard_disconnected_ops": "true", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_enable_op_tracker": "true", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-21T22:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_info": "true", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_shutdown": "true", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_function_tracing": "false", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_grace": "20", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_interval": "6", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_min_peers": "10", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_min_size": "2000", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_stale": "600", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-21T22:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_hit_set_max_size": "100000", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_hit_set_min_size": "1000", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_journal_size": "5120", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_kill_backfill_at": "0", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_cache_size": "50", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_dedup": "true", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_message_max": "40", 2024-09-21T22:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_map_share_max_epochs": "40", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_attr_name_len": "100", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_attr_size": "0", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_backfills": "1", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_markdown_count": "5", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_markdown_period": "600", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_object_name_len": "2048", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_object_namespace_len": "256", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_object_size": "134217728", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pg_blocked_by": "16", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pg_log_entries": "10000", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-21T22:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_pgls": "1024", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_push_cost": "8388608", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_push_objects": "10", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_scrubs": "3", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_trimming_pgs": "2", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_write_op_reply_len": "64", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_max_write_size": "90", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-21T22:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_profile": "balanced", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-21T22:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_base": "805306368", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_cache_min": "134217728", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_target": "4294967296", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_target_autotune": "false", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_min_pg_log_entries": "250", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_min_recovery_priority": "0", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_report_interval": "5", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-21T22:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_num_cache_shards": "32", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_num_op_tracker_shard": "32", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_numa_auto_affinity": "true", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_numa_node": "-1", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_numa_prefer_iface": "true", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objecter_finishers": "1", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objectstore": "bluestore", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objectstore_fuse": "false", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_objectstore_tracing": "false", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_complaint_time": "30.000000", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_duration": "600", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_size": "20", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_slow_op_size": "20", 2024-09-21T22:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_log_threshold": "5", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_shards": "0", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_shards_hdd": "5", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_shards_ssd": "8", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_pq_min_cost": "65536", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_queue_cut_off": "high", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_op_thread_timeout": "15", 2024-09-21T22:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_open_classes_on_start": "true", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_os_flags": "0", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_peering_op_priority": "255", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_delete_cost": "1048576", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_delete_priority": "5", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_log_trim_max": "10000", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_log_trim_min": "100", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-21T22:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_crimson": "false", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-21T22:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_flags": "0", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_min_size": "0", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_pg_num": "32", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_pgp_num": "0", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_read_ratio": "70", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_size": "2", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_default_type": "replicated", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_push_per_object_cost": "1000", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-21T22:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recover_clone_overlap": "true", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_cost": "20971520", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_active": "0", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_max_single_start": "1", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_op_priority": "3", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_priority": "5", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep": "0.000000", 2024-09-21T22:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_repair_during_recovery": "false", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_requested_scrub_priority": "120", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_auto_repair": "false", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_begin_hour": "0", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_begin_week_day": "0", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_chunk_max": "25", 2024-09-21T22:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_chunk_min": "5", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_cost": "52428800", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_during_recovery": "false", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_end_hour": "0", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_end_week_day": "0", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_event_cost": "4096", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_invalid_stats": "true", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_max_preemptions": "5", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-21T22:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_priority": "5", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_scrub_sleep": "0.000000", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_skip_data_digest": "false", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_smart_report_timeout": "5", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_cost": "1048576", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_priority": "5", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-21T22:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_target_transaction_size": "30", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_tracing": "false", 2024-09-21T22:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_use_stale_snap": "false", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "osdc_blkin_trace_all": "false", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_kill_at": "0", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_max_join_drift": "10", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_min": "500", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_min_wait": "0.050000", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_propose_interval": "1.000000", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_service_trim_max": "500", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_service_trim_min": "250", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_stash_full_interval": "25", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_trim_max": "500", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "paxos_trim_min": "250", 2024-09-21T22:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "perf": "true", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "-", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrv": "", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "public_bind_addr": "-", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "public_network": "", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "public_network_interface": "", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "qat_compressor_busy_polling": "false", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "qat_compressor_enabled": "false", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "qat_compressor_session_max_number": "256", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "rados_mon_op_timeout": "0", 2024-09-21T22:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "rados_osd_op_timeout": "0", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rados_tracing": "false", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_atime_update_interval": "60", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_balance_parent_reads": "false", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_balance_snap_reads": "false", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_blkin_trace_all": "false", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache": "true", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-21T22:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_policy": "writearound", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_size": "33554432", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_clone_copy_on_read": "false", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_compression_hint": "none", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_concurrent_management_ops": "10", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_clone_format": "auto", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_data_pool": "", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_features": "61", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_format": "2", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_map_options": "", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_order": "22", 2024-09-21T22:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_pool": "rbd", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_stripe_count": "0", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_default_stripe_unit": "0", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_enable_alloc_hint": "true", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_io_scheduler": "simple", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-21T22:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_order": "24", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_pool": "", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_journal_splay_width": "4", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_localize_parent_reads": "false", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_localize_snap_reads": "false", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-21T22:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-21T22:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-21T22:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_mtime_update_interval": "60", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_non_blocking_aio": "true", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_op_thread_timeout": "60", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_op_threads": "1", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_parent_cache_enabled": "false", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_plugins": "", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_bps_burst": "0", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_bps_limit": "0", 2024-09-21T22:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_exclude_ops": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_iops_burst": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_iops_limit": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-21T22:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_read_from_replica_policy": "default", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_skip_partial_discard": "true", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_tracing": "false", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_validate_names": "true", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd_validate_pool": "true", 2024-09-21T22:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "restapi_base_url": "", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "restapi_log_level": "", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_acl_grants_max_num": "100", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_admin_entry": "admin", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_backend_store": "rados", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_barbican_url": "", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_beast_enable_async": "true", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_counters_cache": "false", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-21T22:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cache_enabled": "true", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cache_expiry_interval": "900", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cache_lru_size": "25000", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_config_store": "rados", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_content_length_compat": "false", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_copy_obj_progress": "true", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cors_rules_max_num": "100", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_cross_domain_policy": "", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-21T22:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_addr": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_password": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_kmip_username": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_require_ssl": "true", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-21T22:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_addr": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_auth": "token", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_namespace": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_prefix": "", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-21T22:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_token_file": "", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_buffersize": "524288", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_low_speed_time": "300", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-21T22:15:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_d4n_port": "6379", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_changes_size": "1000", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_num_shards": "128", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_log_window": "30", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-21T22:15:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-21T22:15:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dns_name": "", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dns_s3website_name": "", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_dynamic_resharding": "true", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_gc_threads": "true", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_lc_threads": "true", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_ops_log": "false", 2024-09-21T22:15:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_quota_threads": "true", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_static_website": "false", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enable_usage_log": "false", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_enforce_swift_acls": "true", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_exit_timeout_secs": "120", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_expose_bucket": "false", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_extended_http_attrs": "", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_filter": "none", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_frontends": "beast port=7480", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_deferred": "50", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_objs": "32", 2024-09-21T22:15:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_gc_processor_period": "3600", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_init_timeout": "300", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_kafka_connection_idle": "300", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-21T22:15:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_domain": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_password": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_password_path": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_project": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_tenant": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_token": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_token_path": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_admin_user": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_api_version": "2", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_domain": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_password": "", 2024-09-21T22:15:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_project": "", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_barbican_user": "", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_url": "", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_debug_interval": "-1", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_lock_max_time": "90", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_objs": "32", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_rules": "1000", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_worker": "3", 2024-09-21T22:15:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lc_thread_delay": "0", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_dnattr": "uid", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_searchfilter": "", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ldap_uri": "", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_http_headers": "", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-21T22:15:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_log_object_name_utc": "false", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_attr_name_len": "0", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_attr_size": "0", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_chunk_size": "4194304", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_listing_results": "1000", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_notify_retries": "10", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_put_param_size": "1048576", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_put_size": "5368709120", 2024-09-21T22:15:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_max_slo_entries": "1000", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_md_log_max_shards": "64", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_mp_lock_max_time": "600", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-21T22:15:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_max_gc": "300", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_num_async_rados_threads": "32", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_num_control_oids": "8", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_numa_node": "-1", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-21T22:15:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_objexp_chunk_size": "100", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_objexp_gc_interval": "600", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_op_thread_timeout": "600", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_op_tracing": "false", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_opa_token": "", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_opa_url": "", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_opa_verify_ssl": "true", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_rados": "false", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_ops_log_socket_path": "", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-21T22:15:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_push_interval": "2.000000", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_lanes": "3", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_cache_partitions": "3", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_print_continue": "true", 2024-09-21T22:15:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rados_tracing": "false", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_realm": "", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_realm_id": "", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_region": "", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-21T22:15:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_request_uri": "", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_batch_size": "64", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_max_aio": "128", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_num_logs": "16", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_reshard_thread_interval": "600", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_resolve_cname": "false", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_run_sync_thread": "true", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-21T22:15:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_scheduler_type": "throttler", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_script_uri": "", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_service_provider_name": "", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_client_id": "", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_client_secret": "", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_entry": "sts", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_key": "sts", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_min_session_duration": "900", 2024-09-21T22:15:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sts_token_introspection_url": "", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_account_in_url": "false", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_auth_entry": "auth", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_auth_url": "", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_custom_header": "", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_need_stats": "true", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_tenant_name": "", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_token_expiration": "86400", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_url": "", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_url_prefix": "swift", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-21T22:15:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_lease_period": "120", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_thread_pool_size": "512", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-21T22:15:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_comment": "", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_createby": "", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_encoding": "", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_flag": "false", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_origin": "", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_torrent_tracker": "", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_trust_forwarded_https": "false", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_max_shards": "32", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_usage_max_user_shards": "1", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_use_opa_authz": "false", 2024-09-21T22:15:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_counters_cache": "false", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_max_buckets": "1000", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_policies_max_num": "100", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_user_unique_email": "true", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_verify_ssl": "true", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zone": "", 2024-09-21T22:15:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zone_id": "", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zonegroup": "", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zonegroup_id": "", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rgwlc_auto_session_clear": "true", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_block_size": "4096", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_size": "536870912", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-21T22:15:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_index_type": "binary_search", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_partition_filters": "false", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_perf": "false", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-21T22:15:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "run_dir": "/var/run/ceph", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_block_create": "true", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_cache_lru_size": "67108864", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_default_max_object_size": "16777216", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_device_size": "53687091200", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_full_integrity_check": "false", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_batch_capacity": "16", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-21T22:15:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_main_device_type": "SSD", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "seastore_segment_size": "67108864", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "set_keepcaps": "false", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "setgroup": "", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "setuser": "", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "setuser_match_path": "", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-21T22:15:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "thp": "false", 2024-09-21T22:15:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "threadpool_default_timeout": "60", 2024-09-21T22:15:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-21T22:15:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "throttler_perf_counter": "true" 2024-09-21T22:15:34.205 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:34.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-21T22:15:34.318 INFO:teuthology.orchestra.run.smithi134.stdout:mon.a: {} 2024-09-21T22:15:34.319 INFO:teuthology.orchestra.run.smithi134.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:15:34.327 INFO:teuthology.orchestra.run.smithi134.stdout:mon.b: {} 2024-09-21T22:15:34.328 INFO:teuthology.orchestra.run.smithi134.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:15:34.336 INFO:teuthology.orchestra.run.smithi134.stdout:mon.c: {} 2024-09-21T22:15:34.336 INFO:teuthology.orchestra.run.smithi134.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:15:34.347 DEBUG:teuthology.orchestra.run.smithi149:> type ceph-objectstore-tool 2024-09-21T22:15:34.365 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T22:15:34.365 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-09-21T22:15:34.380 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T22:15:34.380 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-21T22:15:34.398 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-21T22:15:34.398 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-21T22:15:34.398 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:15:34.398 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:15:34.398 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:15:34.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:15:34.399 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-21T22:15:34.399 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-21T22:15:34.399 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:15:34.400 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-21T22:15:34.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:34.400 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-21T22:15:34.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:15:34.401 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -g pool_client.0 image_client.0 2024-09-21T22:15:34.421 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:34.419+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:34.457 INFO:teuthology.orchestra.run.smithi134.stdout:mapped writes DISABLED 2024-09-21T22:15:34.457 INFO:teuthology.orchestra.run.smithi134.stdout:mapped reads DISABLED 2024-09-21T22:15:34.457 INFO:teuthology.orchestra.run.smithi134.stdout:Seed set to 7482 2024-09-21T22:15:34.501 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:34.498+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:34.539 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:34.539 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:34.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:34.568 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:34.568 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:34.587 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:34.602 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:34.600+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:34.605 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:15:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:34.641 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:34.658 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:34.675 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:34.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:34.693 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:34.702 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:34.701+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 22, 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:15:31.867361+0000", 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:19.339902+0000", 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:15:09.268171+0000", 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:15:34.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5799936, 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 4, 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 2, 2024-09-21T22:15:34.727 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "jewel", 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:15:34.728 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:15:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:15:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:15:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:15:34.732 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:15:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 8, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 8, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.25, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:15:34.734 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:15:34.735 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:15:34.736 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:15:34.737 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:15:34.738 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:15:34.739 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.9900000095367432, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.9900000095367432, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 1.75, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 1.75, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:15:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 0, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.741 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.742 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.743 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.744 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:15:34.745 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.746 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 18, 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:15:34.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:15:34.751 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 18, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.752 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.754 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.755 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:15:34.756 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.757 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 0, 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.759 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:15:34.760 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:15:34.761 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 4151481030 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/4151481030", 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/4151481030", 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/4151481030", 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/4151481030", 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.762 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 0, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.764 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.765 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.766 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.767 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.768 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 18, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:15:34.769 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:15:34.773 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.774 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 18, 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.775 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:15:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:15:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:15:34.778 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.779 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 18, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.780 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.782 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:15:34.784 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.785 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.786 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:15:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [], 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:15:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [], 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [], 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [ 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 2, 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:15:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:34.794 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:34.795 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:15:31.867361+0000', 'last_up_change': '2024-09-21T22:15:19.339902+0000', 'last_in_change': '2024-09-21T22:15:09.268171+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 4151481030}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 4151481030}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 4151481030}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 4151481030}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 4151481030}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 4151481030}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 4151481030}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 4151481030}]}, 'public_addr': '172.21.15.134:6809/4151481030', 'cluster_addr': '172.21.15.134:6811/4151481030', 'heartbeat_back_addr': '172.21.15.134:6815/4151481030', 'heartbeat_front_addr': '172.21.15.134:6813/4151481030', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:15:34.795 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-21T22:15:34.798 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:34.798 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:34.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:34.801+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:34.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:34.905 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:34.903+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:34.949 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:34.949 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:34.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:35.005 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:35.003+0000 7f9163473640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33211) UID: 0 2024-09-21T22:15:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:35.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:35.113 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:35.110+0000 7f9163473640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33211) UID: 0 2024-09-21T22:15:35.207 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:35.206+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:35.213 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:35.213 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:35.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:35.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:35.306+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:35.325 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:35.325 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:35.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:35.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:35.417+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:15:35.485 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:35.485 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:35.494 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:35.535 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:35.533+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:35.610 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:35.608+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:35.638 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:35.638 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:35.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:15:35.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:35.708+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:35.750 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:35.750 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:35.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:15:35.812 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:35.810+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:35.901 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:35.901 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:35.909 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:15:35.953 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:35.951+0000 7f9163473640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33211) UID: 0 2024-09-21T22:15:36.012 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.012 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.013 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:36.011+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:36.021 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:36.114 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:36.113+0000 7f9163473640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33211) UID: 0 2024-09-21T22:15:36.137 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.137 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:36.214 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:36.213+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:36.248 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.249 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:36.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:36.314+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:36.361 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.361 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:15:36.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:36.415+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:36.482 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.482 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:15:36.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:36.516+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:36.595 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.595 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:15:36.648 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:36.646+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:36.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:15:36.708 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.708 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:36.750 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:36.749+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:36.818 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:36.817+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:36.828 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:36.829 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:36.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:36.845 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:36.861 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:36.861 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:36.861 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:36.861 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:36.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:36.877 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:15:36.877 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:15:36.894 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:36.894 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:36.910 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:36.910 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:36.926 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:36.926 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:36.942 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:36.943 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:36.954 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:36.952+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:37.014 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:37.014 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:37.014 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:37.014 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:37.014 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:37.020 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:37.018+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:37.023 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:37.121 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:37.119+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:37.167 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:37.167 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:37.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:37.167 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [] 2024-09-21T22:15:37.167 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:37.176 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:37.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:37.221+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:37.320 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:37.320 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:37.320 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:37.320 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:37.323 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:37.322+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:37.329 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:37.424 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:37.423+0000 7f9163473640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33211) UID: 0 2024-09-21T22:15:37.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:15:37.474 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:37.474 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:37.474 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:37.474 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:37.474 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:37.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:37.526 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:37.525+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.440560+0000", 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.144925248, 2024-09-21T22:15:37.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068039800000000003, 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 69 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.440560+0000", 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.440560+0000", 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.440560+0000", 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0200000000000002e-07 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.440661+0000", 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100666 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.440670+0000", 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8179999999999993e-06 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.440676+0000", 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0299999999999999e-06 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.441286+0000", 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000610119 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.441332+0000", 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5732000000000002e-05 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.441401+0000", 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9647000000000006e-05 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.442471+0000", 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010692799999999999 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.447306+0000", 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048355680000000002 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.447340+0000", 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3444e-05 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.447364+0000", 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4074e-05 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576118+0000", 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.009366555, 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069055339999999996, 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 109 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576118+0000", 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576118+0000", 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576119+0000", 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1099999999999995e-07 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576206+0000", 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6586000000000001e-05 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576214+0000", 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7760000000000003e-06 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576220+0000", 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.614e-06 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.577892+0000", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001672361 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.577935+0000", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2592999999999997e-05 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.578014+0000", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9283000000000006e-05 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580605+0000", 2024-09-21T22:15:37.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002590354 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.582891+0000", 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002285942 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.582964+0000", 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3742e-05 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583024+0000", 2024-09-21T22:15:37.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9672000000000001e-05 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576231+0000", 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.009253783, 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069147130000000003, 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.599 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 110 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576231+0000", 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576231+0000", 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576232+0000", 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0100000000000005e-07 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576236+0000", 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576243+0000", 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0269999999999998e-06 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576248+0000", 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2129999999999999e-06 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.578450+0000", 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022025230000000001 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.578494+0000", 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3964999999999997e-05 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.578564+0000", 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0172000000000005e-05 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580609+0000", 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002044522 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583104+0000", 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002494671 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583127+0000", 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3643e-05 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583146+0000", 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.857e-05 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576257+0000", 2024-09-21T22:15:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.009228439999999, 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069678739999999998, 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 111 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576257+0000", 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576257+0000", 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576257+0000", 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576260+0000", 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1640000000000001e-06 2024-09-21T22:15:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576266+0000", 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0530000000000003e-06 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576271+0000", 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7979999999999996e-06 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.578800+0000", 2024-09-21T22:15:37.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025289959999999999 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.578847+0000", 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7363e-05 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.578918+0000", 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0396999999999997e-05 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581468+0000", 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025505839999999998 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583179+0000", 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017105320000000001 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583205+0000", 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6179000000000001e-05 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583224+0000", 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9372e-05 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576285+0000", 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.009200345, 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.007012697, 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.610 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 112 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576285+0000", 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576285+0000", 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576285+0000", 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576358+0000", 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2486999999999999e-05 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576365+0000", 2024-09-21T22:15:37.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8050000000000007e-06 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576371+0000", 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1359999999999996e-06 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.579298+0000", 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002927051 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.579377+0000", 2024-09-21T22:15:37.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9429000000000001e-05 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.579512+0000", 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013536700000000001 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581475+0000", 2024-09-21T22:15:37.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001962793 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583254+0000", 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017793310000000001 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583280+0000", 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5130000000000002e-05 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583297+0000", 2024-09-21T22:15:37.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7680999999999999e-05 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576380+0000", 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.009104517000001, 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0069913079999999999, 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 113 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576380+0000", 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576380+0000", 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576381+0000", 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576385+0000", 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5870000000000001e-06 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576391+0000", 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4099999999999996e-06 2024-09-21T22:15:37.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576396+0000", 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.639e-06 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.579898+0000", 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003502687 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.579954+0000", 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5921000000000002e-05 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580031+0000", 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6347000000000006e-05 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581487+0000", 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014568610000000001 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583326+0000", 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018390360000000001 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583352+0000", 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5488999999999999e-05 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583372+0000", 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9850000000000001e-05 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.621 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576403+0000", 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.009081746, 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0070397460000000004, 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 114 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576403+0000", 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576403+0000", 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576404+0000", 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7100000000000002e-07 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576407+0000", 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.597e-06 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576418+0000", 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1100999999999999e-05 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576424+0000", 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8900000000000004e-06 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580272+0000", 2024-09-21T22:15:37.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0038475990000000002 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580318+0000", 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5794999999999998e-05 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580389+0000", 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1111000000000004e-05 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581785+0000", 2024-09-21T22:15:37.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0013963809999999999 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583402+0000", 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001616496 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583425+0000", 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3836e-05 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583443+0000", 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7469000000000002e-05 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576439+0000", 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.00904575, 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0070720699999999997, 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.627 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 115 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576439+0000", 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576439+0000", 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576440+0000", 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576515+0000", 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5675999999999998e-05 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576527+0000", 2024-09-21T22:15:37.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1493e-05 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576532+0000", 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2769999999999996e-06 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580635+0000", 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041029980000000001 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580680+0000", 2024-09-21T22:15:37.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4926999999999999e-05 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.580758+0000", 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8104999999999998e-05 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581788+0000", 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010302519999999999 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583469+0000", 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00168042 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583494+0000", 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4854e-05 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.583511+0000", 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7537000000000002e-05 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.632 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576552+0000", 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.008933034, 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088073400000000003, 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.633 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 116 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576552+0000", 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576552+0000", 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576552+0000", 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9999999999999998e-07 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576556+0000", 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-06 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576563+0000", 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5509999999999996e-06 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576568+0000", 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0590000000000002e-06 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581143+0000", 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0045757819999999996 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581188+0000", 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4773e-05 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581255+0000", 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7127999999999998e-05 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.584245+0000", 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029900930000000001 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.585302+0000", 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010569349999999999 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.585335+0000", 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2258999999999997e-05 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.585359+0000", 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4598000000000001e-05 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.638 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.576576+0000", 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.008909194999999, 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011369944999999999, 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 117 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576576+0000", 2024-09-21T22:15:37.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576576+0000", 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576576+0000", 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576585+0000", 2024-09-21T22:15:37.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8340000000000005e-06 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576592+0000", 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7530000000000004e-06 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.576608+0000", 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5749000000000001e-05 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581507+0000", 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00489954 2024-09-21T22:15:37.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581553+0000", 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6177999999999997e-05 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.581632+0000", 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9107e-05 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.584520+0000", 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0028875010000000002 2024-09-21T22:15:37.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.587893+0000", 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003373395 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.587924+0000", 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1047000000000003e-05 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.587946+0000", 2024-09-21T22:15:37.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1404999999999999e-05 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.910755+0000", 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.674729575000001, 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0074127660000000003, 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.644 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 136 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910755+0000", 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910755+0000", 2024-09-21T22:15:37.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910756+0000", 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910758+0000", 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910761+0000", 2024-09-21T22:15:37.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3450000000000002e-06 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910764+0000", 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6809999999999998e-06 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.913624+0000", 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002860741 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.913664+0000", 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9354000000000003e-05 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.913725+0000", 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1483999999999996e-05 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.916701+0000", 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002975278 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.918120+0000", 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014198080000000001 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.918147+0000", 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6342e-05 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.918168+0000", 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1398000000000001e-05 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.910781+0000", 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.674704143, 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088187790000000005, 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 137 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.650 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910781+0000", 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910781+0000", 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910781+0000", 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8799999999999998e-07 2024-09-21T22:15:37.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910833+0000", 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1437999999999998e-05 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910837+0000", 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8960000000000002e-06 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910844+0000", 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4470000000000003e-06 2024-09-21T22:15:37.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.913958+0000", 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003114604 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.913999+0000", 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0086999999999998e-05 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.914063+0000", 2024-09-21T22:15:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3979999999999994e-05 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917618+0000", 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035555959999999998 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919555+0000", 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0019370780000000001 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919581+0000", 2024-09-21T22:15:37.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6186e-05 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919600+0000", 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8179e-05 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.910849+0000", 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.674635467, 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088275990000000002, 2024-09-21T22:15:37.655 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 138 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910849+0000", 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910849+0000", 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910850+0000", 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:15:37.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910852+0000", 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910856+0000", 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4070000000000002e-06 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910858+0000", 2024-09-21T22:15:37.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.768e-06 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.916397+0000", 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055381900000000001 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.916434+0000", 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7972000000000002e-05 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.916505+0000", 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0919000000000003e-05 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917926+0000", 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00142041 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919633+0000", 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017068109999999999 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919658+0000", 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5446999999999999e-05 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919677+0000", 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9020000000000001e-05 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.910862+0000", 2024-09-21T22:15:37.661 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.674623097, 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088882160000000009, 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 139 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910862+0000", 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910862+0000", 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910862+0000", 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.16e-07 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910865+0000", 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4430000000000002e-06 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910868+0000", 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2509999999999999e-06 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910870+0000", 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4889999999999998e-06 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.916738+0000", 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058680759999999998 2024-09-21T22:15:37.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.916777+0000", 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9155e-05 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.916842+0000", 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4719000000000002e-05 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917931+0000", 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001089071 2024-09-21T22:15:37.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919708+0000", 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017767989999999999 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919732+0000", 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3685000000000001e-05 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919750+0000", 2024-09-21T22:15:37.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8312e-05 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.910874+0000", 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.674611261999999, 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0089430780000000001, 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 140 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910874+0000", 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910874+0000", 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910874+0000", 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1e-07 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910923+0000", 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9497999999999999e-05 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910928+0000", 2024-09-21T22:15:37.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4490000000000001e-06 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910931+0000", 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.038e-06 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917060+0000", 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061289439999999999 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917100+0000", 2024-09-21T22:15:37.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0092000000000002e-05 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917163+0000", 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2768999999999995e-05 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917934+0000", 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00077147299999999995 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919775+0000", 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001840819 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919798+0000", 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2962000000000001e-05 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919817+0000", 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8824000000000001e-05 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.672 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:22.910936+0000", 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.674549089999999, 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095598669999999997, 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 141 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.673 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910936+0000", 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910936+0000", 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910936+0000", 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:15:37.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910938+0000", 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.979e-06 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910947+0000", 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2609999999999999e-06 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.910954+0000", 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9700000000000002e-06 2024-09-21T22:15:37.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917638+0000", 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066832860000000001 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917678+0000", 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0713999999999997e-05 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.917743+0000", 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4504000000000004e-05 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.919843+0000", 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020999389999999999 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.920441+0000", 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000597958 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.920479+0000", 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7891e-05 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:22.920496+0000", 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7119e-05 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:23.366544+0000", 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.218941414, 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006794596, 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.678 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 156 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366544+0000", 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366544+0000", 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366544+0000", 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366547+0000", 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1499999999999999e-06 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366551+0000", 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.63e-06 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366555+0000", 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8419999999999998e-06 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.367753+0000", 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011984350000000001 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.367800+0000", 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7472999999999998e-05 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.367869+0000", 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8450999999999999e-05 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.369382+0000", 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001513435 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373281+0000", 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0038989799999999998 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373313+0000", 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1874e-05 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373338+0000", 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4975000000000001e-05 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.683 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:23.366559+0000", 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.218926328, 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0070760989999999998, 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 157 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366559+0000", 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366559+0000", 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366559+0000", 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366561+0000", 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.962e-06 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366565+0000", 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2529999999999998e-06 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366568+0000", 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6249999999999999e-06 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.368163+0000", 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001595583 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.368239+0000", 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5747999999999994e-05 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.368360+0000", 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000120671 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.369943+0000", 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015834340000000001 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373583+0000", 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003639555 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373609+0000", 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6676999999999999e-05 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373635+0000", 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5352999999999999e-05 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.689 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:23.366573+0000", 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.218912205000001, 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071541089999999996, 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 158 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366573+0000", 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366573+0000", 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366573+0000", 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.36e-07 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366616+0000", 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3028000000000002e-05 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366620+0000", 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2710000000000003e-06 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366623+0000", 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9890000000000001e-06 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.368717+0000", 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020932669999999998 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.368764+0000", 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7484999999999997e-05 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.368844+0000", 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0123000000000005e-05 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.370240+0000", 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001395994 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373673+0000", 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003432502 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373704+0000", 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1127999999999997e-05 2024-09-21T22:15:37.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373727+0000", 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3085999999999999e-05 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4178.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:23.366628+0000", 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.218856714999999, 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0071788800000000003, 2024-09-21T22:15:37.695 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4178", 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/331422302", 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 159 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366628+0000", 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366628+0000", 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366629+0000", 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.96e-07 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366631+0000", 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0959999999999999e-06 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366640+0000", 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8820000000000007e-06 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.366643+0000", 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.878e-06 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.369492+0000", 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0028486850000000001 2024-09-21T22:15:37.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.369532+0000", 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9898000000000003e-05 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.369599+0000", 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7032000000000005e-05 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.370251+0000", 2024-09-21T22:15:37.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00065186499999999995 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373760+0000", 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035092470000000001 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373785+0000", 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5273e-05 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:23.373807+0000", 2024-09-21T22:15:37.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1727999999999999e-05 2024-09-21T22:15:37.701 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.701 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.701 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.701 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:37.701 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:37.701 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:37.702 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:37.701+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:37.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:37.803 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:37.801+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:37.806 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:37.806 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:37.806 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:37.807 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:37.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:37.904 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:37.902+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:37.918 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:37.918 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:37.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:38.005 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:38.004+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:38.032 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.420405+0000", 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.610132226999999, 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031301839999999998, 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420405+0000", 2024-09-21T22:15:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420405+0000", 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420406+0000", 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420410+0000", 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0029999999999996e-06 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420417+0000", 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5920000000000003e-06 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420423+0000", 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2850000000000002e-06 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420453+0000", 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0888e-05 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420465+0000", 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1182000000000001e-05 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.423489+0000", 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003023941 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.423535+0000", 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6774000000000003e-05 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.420835+0000", 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.609702042, 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053538980000000002, 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420835+0000", 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420835+0000", 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420836+0000", 2024-09-21T22:15:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7599999999999997e-07 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420900+0000", 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4466000000000002e-05 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420909+0000", 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420915+0000", 2024-09-21T22:15:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6250000000000004e-06 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420950+0000", 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5395999999999998e-05 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.420961+0000", 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1212999999999999e-05 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.426146+0000", 2024-09-21T22:15:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051845809999999997 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.426189+0000", 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3180000000000003e-05 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:56 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'34, mlcod=16'29)", 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.421355+0000", 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.609182067999999, 2024-09-21T22:15:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048594839999999999, 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421355+0000", 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421355+0000", 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421356+0000", 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7199999999999999e-07 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421360+0000", 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4259999999999996e-06 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421368+0000", 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6599999999999995e-06 2024-09-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421373+0000", 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1830000000000002e-06 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421404+0000", 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0922e-05 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.421420+0000", 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6082999999999998e-05 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.426192+0000", 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004771572 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.426215+0000", 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3065999999999999e-05 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:59 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'37, mlcod=16'33)", 2024-09-21T22:15:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.427891+0000", 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.60264649, 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044107950000000003, 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427891+0000", 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427891+0000", 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427891+0000", 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4099999999999999e-07 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427896+0000", 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6249999999999998e-06 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427904+0000", 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9340000000000006e-06 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427910+0000", 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.733e-06 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427948+0000", 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8614e-05 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.427961+0000", 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3091000000000001e-05 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.432260+0000", 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042982879999999999 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.432302+0000", 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1968999999999997e-05 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.441137+0000", 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.589399953000001, 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036662109999999999, 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441137+0000", 2024-09-21T22:15:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441137+0000", 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441138+0000", 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7700000000000004e-07 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441143+0000", 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3449999999999996e-06 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441154+0000", 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0932e-05 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441159+0000", 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8879999999999996e-06 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441203+0000", 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3659999999999999e-05 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441217+0000", 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3974e-05 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.444764+0000", 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003546876 2024-09-21T22:15:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.444804+0000", 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9858999999999999e-05 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.441528+0000", 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.589009385000001, 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056674660000000003, 2024-09-21T22:15:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441528+0000", 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441528+0000", 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441529+0000", 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1600000000000001e-07 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441562+0000", 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3380999999999998e-05 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441573+0000", 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1007e-05 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441578+0000", 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.972e-06 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441611+0000", 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2926999999999998e-05 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.441622+0000", 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1371e-05 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.447163+0000", 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055404390000000003 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.447195+0000", 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2653000000000001e-05 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.442112+0000", 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.588425694, 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051029910000000003, 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442112+0000", 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442112+0000", 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442112+0000", 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4399999999999999e-07 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442119+0000", 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442129+0000", 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0242e-05 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442136+0000", 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442170+0000", 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3986000000000003e-05 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.442181+0000", 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0637e-05 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.447197+0000", 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050162339999999996 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.447215+0000", 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7618e-05 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.577249+0000", 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.453288121, 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048713860000000001, 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577249+0000", 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577249+0000", 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577250+0000", 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3e-07 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577256+0000", 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8119999999999996e-06 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577266+0000", 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0209e-05 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577276+0000", 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0079e-05 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577315+0000", 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8791000000000002e-05 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577326+0000", 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1361e-05 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582075+0000", 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047488119999999998 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582121+0000", 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5692000000000002e-05 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'65)", 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.577695+0000", 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.452842842000001, 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044440080000000002, 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577695+0000", 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577695+0000", 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577695+0000", 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4499999999999997e-07 2024-09-21T22:15:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577700+0000", 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.259e-06 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577710+0000", 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2289999999999992e-06 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577715+0000", 2024-09-21T22:15:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.789e-06 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577751+0000", 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5769999999999998e-05 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.577764+0000", 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2731000000000001e-05 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582122+0000", 2024-09-21T22:15:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043585760000000003 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582139+0000", 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6109000000000001e-05 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'65)", 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.578107+0000", 2024-09-21T22:15:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.452430072, 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044905029999999999, 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578107+0000", 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578107+0000", 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578108+0000", 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2300000000000002e-07 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578171+0000", 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3128999999999998e-05 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578177+0000", 2024-09-21T22:15:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0109999999999997e-06 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578181+0000", 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7589999999999999e-06 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578218+0000", 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7477e-05 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578232+0000", 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3664e-05 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582578+0000", 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004346562 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582598+0000", 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9477999999999999e-05 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'65)", 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.578640+0000", 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.451897631, 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039738120000000002, 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578640+0000", 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578640+0000", 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578640+0000", 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0900000000000002e-07 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578645+0000", 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4000000000000002e-06 2024-09-21T22:15:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578650+0000", 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8139999999999997e-06 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578654+0000", 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578680+0000", 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578692+0000", 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2034e-05 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582599+0000", 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003906578 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582614+0000", 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4786999999999999e-05 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'65)", 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.578998+0000", 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.451539267999999, 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036318219999999998, 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578998+0000", 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578998+0000", 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.578998+0000", 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.579003+0000", 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3839999999999999e-06 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.579008+0000", 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5690000000000004e-06 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.579011+0000", 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.999e-06 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.579040+0000", 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8150999999999999e-05 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.579051+0000", 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1736000000000001e-05 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582614+0000", 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035630369999999998 2024-09-21T22:15:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582630+0000", 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.562e-05 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'67)", 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.581344+0000", 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.449193813000001, 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038322, 2024-09-21T22:15:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581344+0000", 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581344+0000", 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581344+0000", 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.75e-07 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581349+0000", 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581359+0000", 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0557000000000001e-05 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581366+0000", 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5640000000000002e-06 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582173+0000", 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00080688299999999999 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582195+0000", 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1976000000000001e-05 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.585124+0000", 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029295559999999998 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.585176+0000", 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1468999999999998e-05 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'67)", 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.581711+0000", 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.44882655, 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060293300000000003, 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581711+0000", 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581711+0000", 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581711+0000", 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0299999999999999e-07 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581715+0000", 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0470000000000004e-06 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581723+0000", 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4699999999999996e-06 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.581728+0000", 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582456+0000", 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072771499999999998 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.582467+0000", 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1017e-05 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.587709+0000", 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052423349999999999 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.587740+0000", 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1177999999999999e-05 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:136 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'94, mlcod=16'90)", 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.913790+0000", 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.116746905999999, 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042627699999999999, 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913790+0000", 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913790+0000", 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913791+0000", 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4999999999999998e-07 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913794+0000", 2024-09-21T22:15:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3400000000000002e-06 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913801+0000", 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8580000000000002e-06 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913808+0000", 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913840+0000", 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2203999999999999e-05 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.913852+0000", 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2269000000000001e-05 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.918027+0000", 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041749339999999999 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.918053+0000", 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6100000000000001e-05 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:137 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'95, mlcod=16'90)", 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:22.914151+0000", 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.116386812, 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052789239999999999, 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914151+0000", 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914151+0000", 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914151+0000", 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914218+0000", 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7197000000000001e-05 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914227+0000", 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914232+0000", 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0100000000000003e-06 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914261+0000", 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8900000000000001e-05 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.914272+0000", 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1576000000000001e-05 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.919402+0000", 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051291870000000003 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:22.919430+0000", 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7854000000000001e-05 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:156 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'110, mlcod=16'105)", 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:23.367972+0000", 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.662565707000001, 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052022120000000003, 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.367972+0000", 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.367972+0000", 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.367972+0000", 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.367976+0000", 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5750000000000001e-06 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.367982+0000", 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8440000000000003e-06 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.367985+0000", 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.157e-06 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368026+0000", 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1221999999999999e-05 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368042+0000", 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6359e-05 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373142+0000", 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051000580000000002 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373174+0000", 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1576999999999999e-05 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:157 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'111, mlcod=16'105)", 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:23.368470+0000", 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.662067625000001, 2024-09-21T22:15:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050424939999999998, 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368470+0000", 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368470+0000", 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368470+0000", 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7199999999999999e-07 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368475+0000", 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8609999999999997e-06 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368482+0000", 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1280000000000002e-06 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368492+0000", 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2110000000000004e-06 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368547+0000", 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5760999999999997e-05 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368564+0000", 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6327000000000001e-05 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373478+0000", 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049139070000000003 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373512+0000", 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4727000000000001e-05 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'105)", 2024-09-21T22:15:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:23.368933+0000", 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.661604269, 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046100150000000003, 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368933+0000", 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368933+0000", 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.368934+0000", 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369005+0000", 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1870000000000001e-05 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369014+0000", 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2519999999999999e-06 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369018+0000", 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2080000000000002e-06 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369054+0000", 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5883999999999997e-05 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369066+0000", 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2445e-05 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373515+0000", 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044483760000000004 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373543+0000", 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8486000000000001e-05 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4178.0:159 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'113, mlcod=16'108)", 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:23.369680+0000", 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.660857081, 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038891500000000001, 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369680+0000", 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369680+0000", 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369681+0000", 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369684+0000", 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2229999999999999e-06 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369690+0000", 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369693+0000", 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0620000000000001e-06 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369722+0000", 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8856e-05 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.369733+0000", 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.128e-05 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373544+0000", 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038112369999999999 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:23.373569+0000", 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5134e-05 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.118 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:38.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:38.120 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:38.118+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:38.220 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:38.219+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:38.264 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:38.265 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:38.265 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:38.265 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:38.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:38.321 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:38.319+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:38.416 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:38.416 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:38.416 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:38.417 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:38.417 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:38.421 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:38.419+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:38.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:38.440 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:15:38.522 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:38.521+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:38.535 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4241.0:5 2.2 e20/18 2:5cea7035:::rbd_info:head v 20'1, mlcod=0'0)", 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:27.403841+0000", 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.130977164000001, 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012523020000000001, 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.403841+0000", 2024-09-21T22:15:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.403841+0000", 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.403842+0000", 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.44e-07 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.403853+0000", 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1518999999999999e-05 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.403888+0000", 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4422999999999999e-05 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.403908+0000", 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0299999999999999e-05 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.404076+0000", 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016845900000000001 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.404134+0000", 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7612000000000003e-05 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.405053+0000", 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00091856999999999996 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:27.405093+0000", 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0775000000000002e-05 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4241.0:7 2.2 e21/18 2:5cea7035:::rbd_info:head v 21'2, mlcod=0'0)", 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:28.404273+0000", 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.130545544, 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001034627, 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404273+0000", 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404273+0000", 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404273+0000", 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7700000000000001e-07 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404285+0000", 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.184e-05 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404305+0000", 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9921000000000001e-05 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404317+0000", 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1749999999999999e-05 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404385+0000", 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8796999999999999e-05 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.404405+0000", 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9341999999999999e-05 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.405252+0000", 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00084741999999999999 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:28.405307+0000", 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5279999999999999e-05 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:7 3.1a e25/23 3:5cea7035:::rbd_info:head v 25'1, mlcod=0'0)", 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:37.441733+0000", 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.0930857460000001, 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073383599999999997, 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441733+0000", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441733+0000", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441733+0000", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441740+0000", 2024-09-21T22:15:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8809999999999998e-06 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441754+0000", 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4358999999999999e-05 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441763+0000", 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.524e-06 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441822+0000", 2024-09-21T22:15:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9444000000000002e-05 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.441842+0000", 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9619999999999998e-05 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.442403+0000", 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056148999999999999 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:37.442466+0000", 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3311000000000004e-05 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.091337728000000007, 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043089249999999999, 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443484+0000", 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5140000000000002e-06 2024-09-21T22:15:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443492+0000", 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4259999999999997e-06 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443501+0000", 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3980000000000005e-06 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443536+0000", 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4604000000000003e-05 2024-09-21T22:15:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443551+0000", 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5387999999999999e-05 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447726+0000", 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041748530000000001 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447789+0000", 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3540000000000005e-05 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:38.552 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:38.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:38.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:38.636+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:38.698 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:38.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:38.698 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:38.698 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:38.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:38.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:38.747+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:38.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:38.823+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:38.852 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:38.852 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:38.852 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:38.852 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:38.852 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:38.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:38.925 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:38.924+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:38.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:15:39.008 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4241.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.602210203, 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014863680000000001, 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405618+0000", 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3549999999999998e-06 2024-09-21T22:15:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405626+0000", 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4700000000000002e-06 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405634+0000", 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405678+0000", 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4338999999999997e-05 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405702+0000", 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3952e-05 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.407062+0000", 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013596599999999999 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.407099+0000", 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7709000000000001e-05 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:12 3.9 e26/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 26'1, mlcod=0'0)", 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.463223+0000", 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.54460045899999998, 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055530599999999999, 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463223+0000", 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463223+0000", 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463223+0000", 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.17e-07 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463227+0000", 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5820000000000003e-06 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463240+0000", 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2346e-05 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463247+0000", 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6420000000000007e-06 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463300+0000", 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2967999999999998e-05 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463322+0000", 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1702e-05 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463743+0000", 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042077299999999999 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.463778+0000", 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5076000000000001e-05 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:25 3.9 e26/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 26'2, mlcod=0'0)", 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.476972+0000", 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.53085122200000001, 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058995599999999999, 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476972+0000", 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476972+0000", 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476973+0000", 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476982+0000", 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3699999999999995e-06 2024-09-21T22:15:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476998+0000", 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477008+0000", 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0173000000000001e-05 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477068+0000", 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0109000000000003e-05 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477086+0000", 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8275e-05 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477526+0000", 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043987200000000001 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477562+0000", 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5710999999999997e-05 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:39.021 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:39.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:15:39.026 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:39.025+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:39.082 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:39.082 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:39.099 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:39.099 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:39.117 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:39.117 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:39.126 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:39.125+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:39.131 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:39.132 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:39.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:15:39.228 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:39.226+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:39.286 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:39.286 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:39.286 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:39.286 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:39.286 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:39.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:15:39.335 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:15:39.336 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:15:39.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:39.335+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:39.352 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:39.353 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:39.370 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:39.370 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:39.387 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:39.388 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:39.401 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:39.401 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:39.404 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:39.405 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:39.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:39.458 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:39.457+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:39.529 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:39.529 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:39.530 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:39.528+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:39.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:39.631 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:39.629+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:39.683 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:39.684 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:39.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:39.731 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:39.730+0000 7f9163473640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33211) UID: 0 2024-09-21T22:15:39.796 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:15:39.796 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:15:39.796 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:15:39.796 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T22:15:39.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:15:39.830 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T22:15:39.831 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.3 2024-09-21T22:15:39.831 INFO:tasks.thrashosds.thrasher:remote for osd 3 is ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:15:39.831 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-09-21T22:15:39.833 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:39.831+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:39.837 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:39.837 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:39.847 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:39.885 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T22:15:39.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --op list-pgs 2024-09-21T22:15:39.933 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:39.932+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:39.991 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:39.992 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:40.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:40.034+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:40.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:40.134+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:40.145 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:40.145 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:40.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:40.235+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:40.257 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:40.257 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:40.337 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:40.336+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:40.369 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:40.369 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:40.438 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:40.437+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:40.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:15:40.483 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:40.484 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.492 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:40.539 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:40.538+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:40.637 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:40.637 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:40.639+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:40.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:40.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:40.740+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:40.753 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:40.753 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.762 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:40.843 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:40.842+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:40.904 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:40.904 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:40.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:40.957 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:40.956+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:41.016 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:41.016 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:41.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:41.044 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:41.042+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:41.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:41.143+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:41.168 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:41.168 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:41.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:41.260 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:41.259+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:41.321 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:41.321 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:41.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:41.346 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:41.345+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:41.368 INFO:teuthology.orchestra.run.smithi134.stdout:3.c 2024-09-21T22:15:41.368 INFO:teuthology.orchestra.run.smithi134.stdout:3.7 2024-09-21T22:15:41.368 INFO:teuthology.orchestra.run.smithi134.stdout:3.2 2024-09-21T22:15:41.368 INFO:teuthology.orchestra.run.smithi134.stdout:3.8 2024-09-21T22:15:41.369 INFO:teuthology.orchestra.run.smithi134.stdout:3.1e 2024-09-21T22:15:41.369 INFO:teuthology.orchestra.run.smithi134.stdout:3.b 2024-09-21T22:15:41.369 INFO:teuthology.orchestra.run.smithi134.stdout:3.5 2024-09-21T22:15:41.369 INFO:teuthology.orchestra.run.smithi134.stdout:3.18 2024-09-21T22:15:41.369 INFO:teuthology.orchestra.run.smithi134.stdout:3.15 2024-09-21T22:15:41.369 INFO:teuthology.orchestra.run.smithi134.stdout:3.19 2024-09-21T22:15:41.369 INFO:teuthology.orchestra.run.smithi134.stdout:2.1 2024-09-21T22:15:41.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:15:41.461 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:41.460+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:41.462 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:15:41.479 INFO:teuthology.orchestra.run.smithi134.stdout:skipping zero size read 2024-09-21T22:15:41.479 INFO:teuthology.orchestra.run.smithi134.stdout:skipping zero length punch hole 2024-09-21T22:15:41.479 INFO:teuthology.orchestra.run.smithi134.stdout:skipping zero size read 2024-09-21T22:15:41.479 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.479 INFO:teuthology.orchestra.run.smithi134.stdout:skipping zero length punch hole 2024-09-21T22:15:41.480 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:41.480 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:41.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:7 writesame 0xd5137da thru 0xd5213d4 data_size 0x7(0xdbfb bytes) 2024-09-21T22:15:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:9 read 0x6f4f740 thru 0x6f53f87 (0x4848 bytes) 2024-09-21T22:15:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:11 punch from 0x52fc7be to 0x52ff425, (0x2c67 bytes) 2024-09-21T22:15:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:12 punch from 0x6388d7f to 0x6393646, (0xa8c7 bytes) 2024-09-21T22:15:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:13 write 0x739dde7 thru 0x73a9bd1 (0xbdeb bytes) 2024-09-21T22:15:41.503 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.503 INFO:teuthology.orchestra.run.smithi134.stdout:15 read 0x5331269 thru 0x533bafa (0xa892 bytes) 2024-09-21T22:15:41.503 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.503 INFO:teuthology.orchestra.run.smithi134.stdout:17 writesame 0x6467854 thru 0x6473be5 data_size 0x1(0xc392 bytes) 2024-09-21T22:15:41.536 INFO:teuthology.orchestra.run.smithi134.stdout:19 write 0xe8135ce thru 0xe813e66 (0x899 bytes) 2024-09-21T22:15:41.539 INFO:teuthology.orchestra.run.smithi134.stdout:21 write 0x8b2d36a thru 0x8b3cd04 (0xf99b bytes) 2024-09-21T22:15:41.541 INFO:teuthology.orchestra.run.smithi134.stdout:23 read 0x5c46a9e thru 0x5c5110d (0xa670 bytes) 2024-09-21T22:15:41.541 INFO:teuthology.orchestra.run.smithi134.stdout:24 write 0x95d3a6e thru 0x95e0309 (0xc89c bytes) 2024-09-21T22:15:41.544 INFO:teuthology.orchestra.run.smithi134.stdout:25 write 0x1e0648f thru 0x1e0fcc1 (0x9833 bytes) 2024-09-21T22:15:41.547 INFO:teuthology.orchestra.run.smithi134.stdout:26 read 0x17b499d thru 0x17be37c (0x99e0 bytes) 2024-09-21T22:15:41.547 INFO:teuthology.orchestra.run.smithi134.stdout:27 read 0x4854403 thru 0x48589ad (0x45ab bytes) 2024-09-21T22:15:41.547 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.547 INFO:teuthology.orchestra.run.smithi134.stdout:30 punch from 0xa7e5d57 to 0xa7efb7e, (0x9e27 bytes) 2024-09-21T22:15:41.547 INFO:teuthology.orchestra.run.smithi134.stdout:31 write 0x7f08c37 thru 0x7f0ac27 (0x1ff1 bytes) 2024-09-21T22:15:41.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:41.547+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:41.549 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.549 INFO:teuthology.orchestra.run.smithi134.stdout:33 writesame 0xdbaa326 thru 0xdbb8ef0 data_size 0x39(0xebcb bytes) 2024-09-21T22:15:41.551 INFO:teuthology.orchestra.run.smithi134.stdout:34 write 0x8f2eb36 thru 0x8f394e3 (0xa9ae bytes) 2024-09-21T22:15:41.553 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:41.554 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:41.554 INFO:teuthology.orchestra.run.smithi134.stdout:35 read 0x6ca1a68 thru 0x6cadd84 (0xc31d bytes) 2024-09-21T22:15:41.554 INFO:teuthology.orchestra.run.smithi134.stdout:truncating to largest ever: 0x5087848 2024-09-21T22:15:41.568 INFO:teuthology.orchestra.run.smithi134.stdout:36 trunc from 0xe813e67 to 0x5087848 2024-09-21T22:15:41.582 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:41.582 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:41.583 INFO:teuthology.orchestra.run.smithi134.stdout:37 punch from 0x9a41ae to 0x9b2ba5, (0xe9f7 bytes) 2024-09-21T22:15:41.583 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.583 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.587 INFO:teuthology.orchestra.run.smithi134.stdout:42 trunc from 0x5087848 to 0x2084676 2024-09-21T22:15:41.605 INFO:teuthology.orchestra.run.smithi134.stdout:43 writesame 0x7c8474e thru 0x7c8d5cb data_size 0x2(0x8e7e bytes) 2024-09-21T22:15:41.608 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:41.609 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:41.609 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:41.612 INFO:teuthology.orchestra.run.smithi134.stdout:44 trunc from 0x7c8d5cc to 0x2305715 2024-09-21T22:15:41.617 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:41.617 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:41.617 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:41.618 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:41.618 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.618 INFO:teuthology.orchestra.run.smithi134.stdout:46 read 0x180aac3 thru 0x18197a1 (0xecdf bytes) 2024-09-21T22:15:41.618 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.627 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:41.627 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:41.629 INFO:teuthology.orchestra.run.smithi134.stdout:49 write 0x72a3534 thru 0x72a5949 (0x2416 bytes) 2024-09-21T22:15:41.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:41.632 INFO:teuthology.orchestra.run.smithi134.stdout:51 read 0x3417803 thru 0x341f6a3 (0x7ea1 bytes) 2024-09-21T22:15:41.632 INFO:teuthology.orchestra.run.smithi134.stdout:52 read 0x103ca88 thru 0x10496a4 (0xcc1d bytes) 2024-09-21T22:15:41.642 INFO:teuthology.orchestra.run.smithi134.stdout:53 write 0xb4451c9 thru 0xb4539ee (0xe826 bytes) 2024-09-21T22:15:41.644 INFO:teuthology.orchestra.run.smithi134.stdout:56 read 0x7bb6c45 thru 0x7bc00ba (0x9476 bytes) 2024-09-21T22:15:41.645 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.645 INFO:teuthology.orchestra.run.smithi134.stdout:60 read 0xc2bf91 thru 0xc2e276 (0x22e6 bytes) 2024-09-21T22:15:41.645 INFO:teuthology.orchestra.run.smithi134.stdout:62 read 0x956f46c thru 0x957e58a (0xf11f bytes) 2024-09-21T22:15:41.645 INFO:teuthology.orchestra.run.smithi134.stdout:63 writesame 0xb3e7851 thru 0xb3e8ab0 data_size 0x2a(0x1260 bytes) 2024-09-21T22:15:41.645 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:41.645 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:41.648 INFO:teuthology.orchestra.run.smithi134.stdout:65 read 0x90f30e9 thru 0x90fecbb (0xbbd3 bytes) 2024-09-21T22:15:41.648 INFO:teuthology.orchestra.run.smithi134.stdout:66 writesame 0x35cb7c1 thru 0x35cb8fa data_size 0x1(0x13a bytes) 2024-09-21T22:15:41.649 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:41.647+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:41.653 INFO:teuthology.orchestra.run.smithi134.stdout:68 punch from 0x7e48f07 to 0x7e4c680, (0x3779 bytes) 2024-09-21T22:15:41.653 INFO:teuthology.orchestra.run.smithi134.stdout:69 read 0x699e738 thru 0x69a58ae (0x7177 bytes) 2024-09-21T22:15:41.654 INFO:teuthology.orchestra.run.smithi134.stdout:71 punch from 0x6d9570a to 0x6d99e87, (0x477d bytes) 2024-09-21T22:15:41.654 INFO:teuthology.orchestra.run.smithi134.stdout:truncating to largest ever: 0x6e6ad98 2024-09-21T22:15:41.659 INFO:teuthology.orchestra.run.smithi134.stdout:73 trunc from 0xb4539ef to 0x6e6ad98 2024-09-21T22:15:41.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:41.666 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:74 trunc from 0x6e6ad98 to 0x4be1009 2024-09-21T22:15:41.681 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.681 INFO:teuthology.orchestra.run.smithi134.stdout:79 read 0x4a3a290 thru 0x4a3b784 (0x14f5 bytes) 2024-09-21T22:15:41.681 INFO:teuthology.orchestra.run.smithi134.stdout:81 read 0x46f6046 thru 0x46fdb90 (0x7b4b bytes) 2024-09-21T22:15:41.681 INFO:teuthology.orchestra.run.smithi134.stdout:83 write 0x68c382 thru 0x6949f3 (0x8672 bytes) 2024-09-21T22:15:41.685 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:41.685 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:41.687 INFO:teuthology.orchestra.run.smithi134.stdout:86 trunc from 0x4be1009 to 0x17b4cfc 2024-09-21T22:15:41.690 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:41.690 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:41.696 INFO:teuthology.orchestra.run.smithi134.stdout:87 read 0x1101be3 thru 0x110d5cc (0xb9ea bytes) 2024-09-21T22:15:41.711 INFO:teuthology.orchestra.run.smithi134.stdout:89 write 0x9429ae8 thru 0x942e04b (0x4564 bytes) 2024-09-21T22:15:41.713 INFO:teuthology.orchestra.run.smithi134.stdout:91 write 0x5ca0201 thru 0x5ca3ea6 (0x3ca6 bytes) 2024-09-21T22:15:41.717 INFO:teuthology.orchestra.run.smithi134.stdout:92 write 0x3118de3 thru 0x311f28a (0x64a8 bytes) 2024-09-21T22:15:41.727 INFO:teuthology.orchestra.run.smithi134.stdout:93 write 0xbf8ae3f thru 0xbf95337 (0xa4f9 bytes) 2024-09-21T22:15:41.729 INFO:teuthology.orchestra.run.smithi134.stdout:95 writesame 0x94b0d82 thru 0x94b30a3 data_size 0x3(0x2322 bytes) 2024-09-21T22:15:41.732 INFO:teuthology.orchestra.run.smithi134.stdout:96 read 0x42b285e thru 0x42bebfb (0xc39e bytes) 2024-09-21T22:15:41.740 INFO:teuthology.orchestra.run.smithi134.stdout:97 write 0xea4e613 thru 0xea58e77 (0xa865 bytes) 2024-09-21T22:15:41.747 INFO:teuthology.orchestra.run.smithi134.stdout:99 write 0xed38f7f thru 0xed3e1c5 (0x5247 bytes) 2024-09-21T22:15:41.748 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:41.748 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:41.748 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:41.748 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:41.749 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:41.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:41.748+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:41.750 INFO:teuthology.orchestra.run.smithi134.stdout:101 punch from 0x3a795c0 to 0x3a833ee, (0x9e2e bytes) 2024-09-21T22:15:41.750 INFO:teuthology.orchestra.run.smithi134.stdout:102 punch from 0x3d30871 to 0x3d3be7c, (0xb60b bytes) 2024-09-21T22:15:41.750 INFO:teuthology.orchestra.run.smithi134.stdout:103 write 0xc969645 thru 0xc970a6c (0x7428 bytes) 2024-09-21T22:15:41.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:41.763 INFO:teuthology.orchestra.run.smithi134.stdout:104 trunc from 0xed3e1c6 to 0x629f7ea 2024-09-21T22:15:41.774 INFO:teuthology.orchestra.run.smithi134.stdout:106 write 0x13c5a51 thru 0x13d432f (0xe8df bytes) 2024-09-21T22:15:41.777 INFO:teuthology.orchestra.run.smithi134.stdout:108 write 0x478b543 thru 0x478ddac (0x286a bytes) 2024-09-21T22:15:41.781 INFO:teuthology.orchestra.run.smithi134.stdout:109 punch from 0x912cbb to 0x91547c, (0x27c1 bytes) 2024-09-21T22:15:41.781 INFO:teuthology.orchestra.run.smithi134.stdout:truncating to largest ever: 0xea27cac 2024-09-21T22:15:41.791 INFO:teuthology.orchestra.run.smithi134.stdout:110 trunc from 0x629f7ea to 0xea27cac 2024-09-21T22:15:41.796 INFO:teuthology.orchestra.run.smithi134.stdout:112 read 0xdabf7f2 thru 0xdac92f8 (0x9b07 bytes) 2024-09-21T22:15:41.796 INFO:teuthology.orchestra.run.smithi134.stdout:113 punch from 0xb2a8fca to 0xb2b61a7, (0xd1dd bytes) 2024-09-21T22:15:41.796 INFO:teuthology.orchestra.run.smithi134.stdout:115 writesame 0x6149cf9 thru 0x61592b3 data_size 0xd(0xf5bb bytes) 2024-09-21T22:15:41.800 INFO:teuthology.orchestra.run.smithi134.stdout:116 read 0x9909f3a thru 0x990dc66 (0x3d2d bytes) 2024-09-21T22:15:41.800 INFO:teuthology.orchestra.run.smithi134.stdout:117 read 0x4d8c1ad thru 0x4d9b916 (0xf76a bytes) 2024-09-21T22:15:41.803 INFO:teuthology.orchestra.run.smithi134.stdout:118 trunc from 0xea27cac to 0xc58c671 2024-09-21T22:15:41.807 INFO:teuthology.orchestra.run.smithi134.stdout:120 read 0x99ab137 thru 0x99b1d95 (0x6c5f bytes) 2024-09-21T22:15:41.808 INFO:teuthology.orchestra.run.smithi134.stdout:121 read 0x405bc3b thru 0x406237d (0x6743 bytes) 2024-09-21T22:15:41.810 INFO:teuthology.orchestra.run.smithi134.stdout:122 trunc from 0xc58c671 to 0xa6cda30 2024-09-21T22:15:41.815 INFO:teuthology.orchestra.run.smithi134.stdout:123 write 0x6839425 thru 0x68492d9 (0xfeb5 bytes) 2024-09-21T22:15:41.817 INFO:teuthology.orchestra.run.smithi134.stdout:125 punch from 0xcd2b13 to 0xcda23f, (0x772c bytes) 2024-09-21T22:15:41.817 INFO:teuthology.orchestra.run.smithi134.stdout:128 punch from 0x7610959 to 0x761c878, (0xbf1f bytes) 2024-09-21T22:15:41.817 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.817 INFO:teuthology.orchestra.run.smithi134.stdout:130 punch from 0x2f2d4f8 to 0x2f37df6, (0xa8fe bytes) 2024-09-21T22:15:41.818 INFO:teuthology.orchestra.run.smithi134.stdout:131 punch from 0x25c9ec3 to 0x25d194a, (0x7a87 bytes) 2024-09-21T22:15:41.818 INFO:teuthology.orchestra.run.smithi134.stdout:132 trunc from 0xa6cda30 to 0xaa0d4fa 2024-09-21T22:15:41.822 INFO:teuthology.orchestra.run.smithi134.stdout:136 trunc from 0xaa0d4fa to 0xb69ba2f 2024-09-21T22:15:41.828 INFO:teuthology.orchestra.run.smithi134.stdout:137 write 0x48209b0 thru 0x482efa2 (0xe5f3 bytes) 2024-09-21T22:15:41.836 INFO:teuthology.orchestra.run.smithi134.stdout:139 write 0xc4aafc4 thru 0xc4b4814 (0x9851 bytes) 2024-09-21T22:15:41.839 INFO:teuthology.orchestra.run.smithi134.stdout:140 read 0x2d8ada5 thru 0x2d96404 (0xb660 bytes) 2024-09-21T22:15:41.844 INFO:teuthology.orchestra.run.smithi134.stdout:141 trunc from 0xc4b4815 to 0x7d80cb5 2024-09-21T22:15:41.849 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:41.848+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:41.852 INFO:teuthology.orchestra.run.smithi134.stdout:142 read 0x3c55630 thru 0x3c5cc34 (0x7605 bytes) 2024-09-21T22:15:41.853 INFO:teuthology.orchestra.run.smithi134.stdout:143 punch from 0x69f5e1b to 0x69f78f4, (0x1ad9 bytes) 2024-09-21T22:15:41.853 INFO:teuthology.orchestra.run.smithi134.stdout:144 punch from 0x480738e to 0x4815d27, (0xe999 bytes) 2024-09-21T22:15:41.853 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.861 INFO:teuthology.orchestra.run.smithi134.stdout:146 trunc from 0x7d80cb5 to 0xccc430 2024-09-21T22:15:41.880 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4241.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.472850268, 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014863680000000001, 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405613+0000", 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405618+0000", 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3549999999999998e-06 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405626+0000", 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4700000000000002e-06 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405634+0000", 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405678+0000", 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4338999999999997e-05 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.405702+0000", 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3952e-05 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.407062+0000", 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013596599999999999 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:26.407099+0000", 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7709000000000001e-05 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:25 3.9 e26/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 26'2, mlcod=0'0)", 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.476972+0000", 2024-09-21T22:15:41.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.4014912869999998, 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058995599999999999, 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476972+0000", 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476972+0000", 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476973+0000", 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476982+0000", 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3699999999999995e-06 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.476998+0000", 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477008+0000", 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0173000000000001e-05 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477068+0000", 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0109000000000003e-05 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477086+0000", 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8275e-05 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477526+0000", 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043987200000000001 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.477562+0000", 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5710999999999997e-05 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:131 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'11, mlcod=28'9)", 2024-09-21T22:15:41.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.612764+0000", 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.265699146, 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081289700000000003, 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612764+0000", 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612764+0000", 2024-09-21T22:15:41.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612766+0000", 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612787+0000", 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0942e-05 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612811+0000", 2024-09-21T22:15:41.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4304999999999999e-05 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612831+0000", 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9374000000000001e-05 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612895+0000", 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4636999999999998e-05 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.612913+0000", 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7931000000000002e-05 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.613524+0000", 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00061055699999999996 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.613577+0000", 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2973999999999998e-05 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:141 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'12, mlcod=28'10)", 2024-09-21T22:15:41.893 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.625782+0000", 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.252681247, 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077769099999999995, 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625782+0000", 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625782+0000", 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625784+0000", 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1220000000000002e-06 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625798+0000", 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4181e-05 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625817+0000", 2024-09-21T22:15:41.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8335999999999999e-05 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625826+0000", 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.363e-06 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625887+0000", 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0826999999999999e-05 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.625905+0000", 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8312e-05 2024-09-21T22:15:41.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.626529+0000", 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062437300000000001 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.626560+0000", 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0176999999999999e-05 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:152 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'13, mlcod=28'11)", 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.638528+0000", 2024-09-21T22:15:41.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.239935548, 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082156500000000001, 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638528+0000", 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638528+0000", 2024-09-21T22:15:41.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638530+0000", 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638560+0000", 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9830000000000001e-05 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638583+0000", 2024-09-21T22:15:41.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3762000000000001e-05 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638596+0000", 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2330000000000001e-05 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638662+0000", 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5967e-05 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.638681+0000", 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9536000000000001e-05 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.639297+0000", 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00061578700000000002 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.639349+0000", 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2111999999999998e-05 2024-09-21T22:15:41.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:171 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'14, mlcod=28'12)", 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.667159+0000", 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.21130449500000001, 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078463999999999997, 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667159+0000", 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667159+0000", 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667161+0000", 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667175+0000", 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4326e-05 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667198+0000", 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2748e-05 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667212+0000", 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4800000000000001e-05 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667279+0000", 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6049000000000004e-05 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667298+0000", 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9171e-05 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667891+0000", 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059309900000000004 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.667943+0000", 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2568000000000002e-05 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:180 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'15, mlcod=28'13)", 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.675731+0000", 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.202732194, 2024-09-21T22:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089986999999999999, 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675731+0000", 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675731+0000", 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675733+0000", 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0849999999999999e-06 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675748+0000", 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5065000000000001e-05 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675782+0000", 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4252999999999999e-05 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675806+0000", 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999998e-05 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675871+0000", 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5660999999999994e-05 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.675890+0000", 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9211999999999998e-05 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.676577+0000", 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068668199999999998 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.676631+0000", 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3752000000000003e-05 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:195 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'16, mlcod=28'14)", 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.692041+0000", 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.186422227, 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056112999999999996, 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692041+0000", 2024-09-21T22:15:41.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692041+0000", 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692042+0000", 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017e-06 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692050+0000", 2024-09-21T22:15:41.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1810000000000001e-06 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692064+0000", 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3495e-05 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692070+0000", 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692118+0000", 2024-09-21T22:15:41.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7859999999999999e-05 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692132+0000", 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4946999999999999e-05 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692560+0000", 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042774499999999999 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.692602+0000", 2024-09-21T22:15:41.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1879999999999999e-05 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:205 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'17, mlcod=28'15)", 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.707421+0000", 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.17104253899999999, 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073326499999999998, 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707421+0000", 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707421+0000", 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707422+0000", 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3239999999999999e-06 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707447+0000", 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5196999999999999e-05 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707463+0000", 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5928999999999999e-05 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707472+0000", 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1230000000000006e-06 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707530+0000", 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7765e-05 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.707549+0000", 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8802000000000001e-05 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.708109+0000", 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056023100000000001 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.708154+0000", 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4894000000000001e-05 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:220 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'18, mlcod=28'16)", 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.724157+0000", 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.15430613500000001, 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079165500000000005, 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.919 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724157+0000", 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724157+0000", 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724159+0000", 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5430000000000001e-06 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724173+0000", 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4497e-05 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724192+0000", 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9338999999999999e-05 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724202+0000", 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769999999999995e-06 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724262+0000", 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9802000000000001e-05 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724282+0000", 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0120999999999999e-05 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724894+0000", 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00061176600000000002 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.724949+0000", 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4610000000000001e-05 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:232 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'19, mlcod=28'17)", 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.736924+0000", 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.14153912399999999, 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074796800000000001, 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.736924+0000", 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.736924+0000", 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.736926+0000", 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:15:41.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.736938+0000", 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2150000000000001e-05 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.736958+0000", 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0106e-05 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.736967+0000", 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1840000000000005e-06 2024-09-21T22:15:41.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.737026+0000", 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9142999999999999e-05 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.737046+0000", 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9939e-05 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.737626+0000", 2024-09-21T22:15:41.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057992099999999995 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.737672+0000", 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5995000000000003e-05 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:241 3.4 e28/23 3:226e6cb4:::rbd_data.11856a5cf33b.000000000000003a:head v 28'5, mlcod=28'3)", 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.741673+0000", 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.13679026, 2024-09-21T22:15:41.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070271699999999995, 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741673+0000", 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741673+0000", 2024-09-21T22:15:41.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741674+0000", 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2500000000000004e-07 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741724+0000", 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9974e-05 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741736+0000", 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2147000000000001e-05 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741743+0000", 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410000000000003e-06 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741796+0000", 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3597000000000002e-05 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.741814+0000", 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8102e-05 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.742348+0000", 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053379000000000002 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.742376+0000", 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7540999999999999e-05 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:259 3.4 e28/23 3:226e6cb4:::rbd_data.11856a5cf33b.000000000000003a:head v 28'6, mlcod=28'4)", 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.11338308499999999, 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030935889999999999, 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765082+0000", 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9350000000000001e-06 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765094+0000", 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2045000000000001e-05 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765114+0000", 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9556999999999999e-05 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765136+0000", 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2257999999999999e-05 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765208+0000", 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2192000000000003e-05 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765232+0000", 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4107000000000001e-05 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768126+0000", 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028939159999999998 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768174+0000", 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7579e-05 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:276 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'22, mlcod=28'20)", 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.792805+0000", 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.085658620000000005, 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000655249, 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792805+0000", 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792805+0000", 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792806+0000", 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.609e-06 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792822+0000", 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5832e-05 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792842+0000", 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9871999999999999e-05 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792852+0000", 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9259999999999995e-06 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792914+0000", 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2563000000000004e-05 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.792934+0000", 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9777000000000001e-05 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.793424+0000", 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000489512 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.793460+0000", 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6158000000000002e-05 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:286 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'23, mlcod=28'21)", 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.803455+0000", 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.075007942999999994, 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068432400000000004, 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803455+0000", 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803455+0000", 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803457+0000", 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5659999999999999e-06 2024-09-21T22:15:41.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803470+0000", 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2714000000000001e-05 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803488+0000", 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8255000000000001e-05 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803497+0000", 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3540000000000006e-06 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803566+0000", 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8678999999999998e-05 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.803584+0000", 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8471999999999999e-05 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.804104+0000", 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051967500000000004 2024-09-21T22:15:41.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.804140+0000", 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5608999999999997e-05 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:295 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'24, mlcod=28'22)", 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.810698+0000", 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.067765032000000003, 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078909900000000003, 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.944 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810698+0000", 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810698+0000", 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810700+0000", 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6270000000000001e-06 2024-09-21T22:15:41.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810715+0000", 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5688999999999998e-05 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810735+0000", 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9043999999999999e-05 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810745+0000", 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0017000000000001e-05 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810834+0000", 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9066000000000004e-05 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.810853+0000", 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9525e-05 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.811453+0000", 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059973700000000003 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.811487+0000", 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4394000000000003e-05 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:307 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'25, mlcod=28'23)", 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.818838+0000", 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.059625152000000001, 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00064212799999999995, 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.948 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818838+0000", 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818838+0000", 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818839+0000", 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4130000000000001e-06 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818853+0000", 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3069e-05 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818870+0000", 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.702e-05 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818878+0000", 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5450000000000003e-06 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818941+0000", 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2539999999999994e-05 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.818959+0000", 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8031000000000001e-05 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.819449+0000", 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049062400000000005 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.819480+0000", 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0886000000000002e-05 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:316 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'26, mlcod=28'24)", 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.824683+0000", 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.053779893000000002, 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00069855500000000001, 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824683+0000", 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824683+0000", 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824685+0000", 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.618e-06 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824697+0000", 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2214e-05 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824714+0000", 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7181999999999999e-05 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824724+0000", 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6730000000000004e-06 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824795+0000", 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0559e-05 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.824815+0000", 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0670999999999999e-05 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.825343+0000", 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000527646 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.825382+0000", 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8992000000000002e-05 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:327 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'27, mlcod=28'25)", 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.833284+0000", 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.045179089999999998, 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078568900000000001, 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.956 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833284+0000", 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833284+0000", 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833286+0000", 2024-09-21T22:15:41.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.547e-06 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833298+0000", 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1851999999999999e-05 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833318+0000", 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0208999999999999e-05 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833345+0000", 2024-09-21T22:15:41.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7025999999999998e-05 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833438+0000", 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3331000000000005e-05 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.833457+0000", 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8666999999999999e-05 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.834034+0000", 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057742700000000004 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.834070+0000", 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5630000000000003e-05 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:340 3.9 e28/23 3:97e5b7ca:::rbd_header.11856a5cf33b:head v 28'28, mlcod=28'26)", 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.848376+0000", 2024-09-21T22:15:41.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.030086853, 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073338299999999999, 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848376+0000", 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848376+0000", 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:41.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848378+0000", 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.517e-06 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848389+0000", 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0871e-05 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848407+0000", 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8238000000000001e-05 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848428+0000", 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0695000000000001e-05 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848517+0000", 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8855000000000002e-05 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.848536+0000", 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9641999999999999e-05 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.849069+0000", 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053281800000000001 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.849110+0000", 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0747000000000001e-05 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:41.964 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:41.965 INFO:teuthology.orchestra.run.smithi134.stdout:148 write 0x8e3393a thru 0x8e3b68a (0x7d51 bytes) 2024-09-21T22:15:41.966 INFO:teuthology.orchestra.run.smithi134.stdout:149 punch from 0x482a378 to 0x4831115, (0x6d9d bytes) 2024-09-21T22:15:41.966 INFO:teuthology.orchestra.run.smithi134.stdout:150 writesame 0x35bb2b5 thru 0x35bc7d8 data_size 0x2c(0x1524 bytes) 2024-09-21T22:15:41.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:41.967 INFO:teuthology.orchestra.run.smithi134.stdout:151 write 0x5658dd4 thru 0x565d187 (0x43b4 bytes) 2024-09-21T22:15:41.967 INFO:teuthology.orchestra.run.smithi134.stdout:152 read 0x8fbce0 thru 0x90015e (0x447f bytes) 2024-09-21T22:15:41.967 INFO:teuthology.orchestra.run.smithi134.stdout:154 read 0xf3784a thru 0xf37ec2 (0x679 bytes) 2024-09-21T22:15:41.968 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.968 INFO:teuthology.orchestra.run.smithi134.stdout:159 write 0x498afc6 thru 0x498f7d1 (0x480c bytes) 2024-09-21T22:15:41.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --op export --pgid 3.c --file /var/log/ceph/exp.3.c.3 2024-09-21T22:15:41.969 INFO:teuthology.orchestra.run.smithi134.stdout:160 punch from 0x4cf5fd0 to 0x4cf65f1, (0x621 bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:161 punch from 0x6cd8d35 to 0x6cdd76f, (0x4a3a bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:163 writesame 0xa51c36d thru 0xa529ef8 data_size 0x2(0xdb8c bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:164 write 0xa62a85e thru 0xa63a552 (0xfcf5 bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:166 write 0x3a231ae thru 0x3a2f7c5 (0xc618 bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:167 trunc from 0xa63a553 to 0x9394d7c 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:168 trunc from 0x9394d7c to 0xb66729 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:169 read 0x7f7087 thru 0x7f9cf2 (0x2c6c bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:170 trunc from 0xb66729 to 0xe4366a3 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:171 write 0x3aa4050 thru 0x3aa5c48 (0x1bf9 bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:172 read 0x16af929 thru 0x16bc168 (0xc840 bytes) 2024-09-21T22:15:41.970 INFO:teuthology.orchestra.run.smithi134.stdout:174 write 0x3e096e thru 0x3f0236 (0xf8c9 bytes) 2024-09-21T22:15:41.971 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:41.964+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:41.971 INFO:teuthology.orchestra.run.smithi134.stdout:175 write 0x3ac93d8 thru 0x3acf2c4 (0x5eed bytes) 2024-09-21T22:15:41.974 INFO:teuthology.orchestra.run.smithi134.stdout:176 read 0x7265a0c thru 0x7266359 (0x94e bytes) 2024-09-21T22:15:41.974 INFO:teuthology.orchestra.run.smithi134.stdout:179 write 0xe0553be thru 0xe064458 (0xf09b bytes) 2024-09-21T22:15:41.977 INFO:teuthology.orchestra.run.smithi134.stdout:180 writesame 0x1ee2691 thru 0x1eeb188 data_size 0x4(0x8af8 bytes) 2024-09-21T22:15:41.982 INFO:teuthology.orchestra.run.smithi134.stdout:182 read 0xd081194 thru 0xd08c824 (0xb691 bytes) 2024-09-21T22:15:41.983 INFO:teuthology.orchestra.run.smithi134.stdout:183 read 0xb6efd9 thru 0xb7de83 (0xeeab bytes) 2024-09-21T22:15:41.983 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:41.983 INFO:teuthology.orchestra.run.smithi134.stdout:186 write 0x34e582c thru 0x34ec39f (0x6b74 bytes) 2024-09-21T22:15:41.985 INFO:teuthology.orchestra.run.smithi134.stdout:188 punch from 0x20e7fa4 to 0x20f307f, (0xb0db bytes) 2024-09-21T22:15:41.995 INFO:teuthology.orchestra.run.smithi134.stdout:189 trunc from 0xe4366a3 to 0x6b00b3f 2024-09-21T22:15:42.013 INFO:teuthology.orchestra.run.smithi134.stdout:190 trunc from 0x6b00b3f to 0xcea6486 2024-09-21T22:15:42.019 INFO:teuthology.orchestra.run.smithi134.stdout:191 read 0x8759b85 thru 0x875a707 (0xb83 bytes) 2024-09-21T22:15:42.019 INFO:teuthology.orchestra.run.smithi134.stdout:192 read 0xa536933 thru 0xa54567e (0xed4c bytes) 2024-09-21T22:15:42.019 INFO:teuthology.orchestra.run.smithi134.stdout:193 write 0xae9218a thru 0xae9f5d3 (0xd44a bytes) 2024-09-21T22:15:42.023 INFO:teuthology.orchestra.run.smithi134.stdout:194 read 0x5210cb2 thru 0x52139d6 (0x2d25 bytes) 2024-09-21T22:15:42.023 INFO:teuthology.orchestra.run.smithi134.stdout:195 write 0xa1ab9ce thru 0xa1b417e (0x87b1 bytes) 2024-09-21T22:15:42.029 INFO:teuthology.orchestra.run.smithi134.stdout:197 trunc from 0xcea6486 to 0xb1241de 2024-09-21T22:15:42.034 INFO:teuthology.orchestra.run.smithi134.stdout:198 read 0x8aef2b5 thru 0x8afc0fa (0xce46 bytes) 2024-09-21T22:15:42.034 INFO:teuthology.orchestra.run.smithi134.stdout:199 read 0x6813d56 thru 0x68151b9 (0x1464 bytes) 2024-09-21T22:15:42.034 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.034 INFO:teuthology.orchestra.run.smithi134.stdout:204 read 0x639be1f thru 0x639da3e (0x1c20 bytes) 2024-09-21T22:15:42.034 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.045 INFO:teuthology.orchestra.run.smithi134.stdout:207 trunc from 0xb1241de to 0x1e7d79d 2024-09-21T22:15:42.057 INFO:teuthology.orchestra.run.smithi134.stdout:208 read 0xfab19c thru 0xfb517b (0x9fe0 bytes) 2024-09-21T22:15:42.057 INFO:teuthology.orchestra.run.smithi134.stdout:209 punch from 0x1778bd5 to 0x1781282, (0x86ad bytes) 2024-09-21T22:15:42.057 INFO:teuthology.orchestra.run.smithi134.stdout:210 read 0xd63608 thru 0xd6de44 (0xa83d bytes) 2024-09-21T22:15:42.057 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.057 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.058 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.058 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.067 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:42.065+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:42.071 INFO:teuthology.orchestra.run.smithi134.stdout:217 write 0x8ed6a7d thru 0x8edeaf3 (0x8077 bytes) 2024-09-21T22:15:42.074 INFO:teuthology.orchestra.run.smithi134.stdout:218 punch from 0x2c6e438 to 0x2c70e5c, (0x2a24 bytes) 2024-09-21T22:15:42.081 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:42.081 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:42.081 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:42.081 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:42.084 INFO:teuthology.orchestra.run.smithi134.stdout:219 trunc from 0x8edeaf4 to 0x7693ea 2024-09-21T22:15:42.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:42.121 INFO:teuthology.orchestra.run.smithi134.stdout:220 write 0xe38c57b thru 0xe396e66 (0xa8ec bytes) 2024-09-21T22:15:42.123 INFO:teuthology.orchestra.run.smithi134.stdout:221 write 0xc09cd9d thru 0xc09ce6d (0xd1 bytes) 2024-09-21T22:15:42.125 INFO:teuthology.orchestra.run.smithi134.stdout:222 write 0x645365c thru 0x645c29e (0x8c43 bytes) 2024-09-21T22:15:42.128 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.128 INFO:teuthology.orchestra.run.smithi134.stdout:225 write 0x3f873e3 thru 0x3f95216 (0xde34 bytes) 2024-09-21T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stdout:227 punch from 0x6379026 to 0x637e4f7, (0x54d1 bytes) 2024-09-21T22:15:42.131 INFO:teuthology.orchestra.run.smithi134.stdout:229 write 0x6532b6a thru 0x653bfd9 (0x9470 bytes) 2024-09-21T22:15:42.133 INFO:teuthology.orchestra.run.smithi134.stdout:230 writesame 0x58b9f1d thru 0x58ba84b data_size 0x1(0x92f bytes) 2024-09-21T22:15:42.136 INFO:teuthology.orchestra.run.smithi134.stdout:231 write 0xb69279 thru 0xb71694 (0x841c bytes) 2024-09-21T22:15:42.141 INFO:teuthology.orchestra.run.smithi134.stdout:232 read 0x757ef8a thru 0x7588667 (0x96de bytes) 2024-09-21T22:15:42.148 INFO:teuthology.orchestra.run.smithi134.stdout:233 writesame 0xe775f16 thru 0xe77bce1 data_size 0x5c(0x5dcc bytes) 2024-09-21T22:15:42.148 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.148 INFO:teuthology.orchestra.run.smithi134.stdout:235 write 0x63f230c thru 0x6401c09 (0xf8fe bytes) 2024-09-21T22:15:42.155 INFO:teuthology.orchestra.run.smithi134.stdout:236 writesame 0xa08945d thru 0xa093727 data_size 0x5(0xa2cb bytes) 2024-09-21T22:15:42.161 INFO:teuthology.orchestra.run.smithi134.stdout:237 read 0xa5e55c6 thru 0xa5e7d43 (0x277e bytes) 2024-09-21T22:15:42.161 INFO:teuthology.orchestra.run.smithi134.stdout:238 write 0x310a2dd thru 0x310c6db (0x23ff bytes) 2024-09-21T22:15:42.164 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:42.164 INFO:teuthology.orchestra.run.smithi134.stdout:241 read 0xae55bd4 thru 0xae62c21 (0xd04e bytes) 2024-09-21T22:15:42.164 INFO:teuthology.orchestra.run.smithi134.stdout:242 punch from 0xd4a26dd to 0xd4b06c0, (0xdfe3 bytes) 2024-09-21T22:15:42.164 INFO:teuthology.orchestra.run.smithi134.stdout:243 read 0xb3fe604 thru 0xb40d92e (0xf32b bytes) 2024-09-21T22:15:42.164 INFO:teuthology.orchestra.run.smithi134.stdout:244 writesame 0x29814c6 thru 0x299049b data_size 0x51(0xefd6 bytes) 2024-09-21T22:15:42.169 INFO:teuthology.orchestra.run.smithi134.stdout:246 punch from 0xaa588a0 to 0xaa676b7, (0xee17 bytes) 2024-09-21T22:15:42.169 INFO:teuthology.orchestra.run.smithi134.stdout:247 write 0x2c6138e thru 0x2c68a2f (0x76a2 bytes) 2024-09-21T22:15:42.172 INFO:teuthology.orchestra.run.smithi134.stdout:248 clone 1 order 20 su 32768 sc 2 2024-09-21T22:15:42.174 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:42.173+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:42.237 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:42.237 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:42.237 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:42.237 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:42.237 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:42.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:42.269 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:42.268+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:42.370 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:42.368+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:42.390 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:37.441206+0000", 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9470107490000004, 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001459857, 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 7 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441206+0000", 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441206+0000", 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441207+0000", 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2440000000000001e-06 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441221+0000", 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3532e-05 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441232+0000", 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1318000000000001e-05 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441239+0000", 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4669999999999998e-06 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441287+0000", 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7379000000000002e-05 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441411+0000", 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000123888 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.441568+0000", 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0001573 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.442268+0000", 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069963899999999995 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.442560+0000", 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000291973 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.442611+0000", 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1205999999999997e-05 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:37.442666+0000", 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4911000000000003e-05 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:38.443040+0000", 2024-09-21T22:15:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.9451762390000003, 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0054018319999999996, 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 9 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443040+0000", 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443040+0000", 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443042+0000", 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.779e-06 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443049+0000", 2024-09-21T22:15:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4760000000000003e-06 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443060+0000", 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1704e-05 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443071+0000", 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0531e-05 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443127+0000", 2024-09-21T22:15:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443204+0000", 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7480999999999999e-05 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.443334+0000", 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012966 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.447958+0000", 2024-09-21T22:15:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046238429999999999 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.448369+0000", 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041138600000000002 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.448409+0000", 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9742e-05 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.448442+0000", 2024-09-21T22:15:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3064000000000001e-05 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:10 3.1c e26/23 3:3831950c:::rbd_directory:head v 26'1, mlcod=0'0)", 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:38.451917+0000", 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.9362998620000003, 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003101772, 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451917+0000", 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451917+0000", 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451917+0000", 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5899999999999998e-07 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451924+0000", 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4769999999999997e-06 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451932+0000", 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4370000000000001e-06 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451939+0000", 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4739999999999999e-06 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.452019+0000", 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9881000000000003e-05 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.452044+0000", 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4515000000000002e-05 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.454978+0000", 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002934594 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.455018+0000", 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0135000000000001e-05 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:167 3.1c e28/23 3:3b4f43fa:::rbd_data.11856a5cf33b.000000000000001c:head v 28'5, mlcod=28'3)", 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.661000+0000", 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.72721685700000005, 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022064900000000002, 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661000+0000", 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661000+0000", 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661000+0000", 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1900000000000002e-07 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661016+0000", 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5775000000000001e-05 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661026+0000", 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0287e-05 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661032+0000", 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1669999999999998e-06 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661081+0000", 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9265999999999999e-05 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.661104+0000", 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3204e-05 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.663160+0000", 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020560410000000002 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.663206+0000", 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6031e-05 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:180 3.9 3:97e5b7ca:::rbd_header.11856a5cf33b:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.675188+0000", 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.71302900599999997, 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0016356599999999999, 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 180 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675188+0000", 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675188+0000", 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675188+0000", 2024-09-21T22:15:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9999999999999997e-07 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675192+0000", 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7510000000000002e-06 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675202+0000", 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0093e-05 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675230+0000", 2024-09-21T22:15:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7993000000000001e-05 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675277+0000", 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7077999999999999e-05 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675358+0000", 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0461000000000001e-05 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.675579+0000", 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000221141 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.676046+0000", 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046717500000000001 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.676733+0000", 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00068690699999999995 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.676784+0000", 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1486999999999997e-05 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.676823+0000", 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8874000000000001e-05 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:272 3.3 3:c4c6d042:::rbd_data.11856a5cf33b.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3955281~59615] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.775384+0000", 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.61283259700000003, 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020504249999999998, 2024-09-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 272 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775384+0000", 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775384+0000", 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775385+0000", 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7400000000000002e-07 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775529+0000", 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000144394 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775540+0000", 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0497e-05 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775545+0000", 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2259999999999996e-06 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775589+0000", 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3835000000000003e-05 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775666+0000", 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6823999999999995e-05 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.775742+0000", 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6112000000000006e-05 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.776473+0000", 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00073130799999999996 2024-09-21T22:15:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.777372+0000", 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00089956300000000003 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.777406+0000", 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3201000000000003e-05 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.777434+0000", 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8691e-05 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:274 3.1 e28/23 3:83194431:::rbd_data.11856a5cf33b.0000000000000011:head v 28'1, mlcod=0'0)", 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.778907+0000", 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.60930946799999997, 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001766873, 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.778907+0000", 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.778907+0000", 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.778908+0000", 2024-09-21T22:15:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.778934+0000", 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6140999999999999e-05 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.778941+0000", 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4449999999999999e-06 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.778945+0000", 2024-09-21T22:15:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9519999999999996e-06 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.778989+0000", 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3819000000000002e-05 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.779003+0000", 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3658e-05 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.780644+0000", 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0016417700000000001 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.780674+0000", 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9609000000000001e-05 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:350 3.3 3:c4c6d042:::rbd_data.11856a5cf33b.0000000000000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.862588+0000", 2024-09-21T22:15:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.52562859299999998, 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0019709369999999999, 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 350 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862588+0000", 2024-09-21T22:15:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862588+0000", 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862589+0000", 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.37e-07 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862592+0000", 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7840000000000001e-06 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862603+0000", 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0713000000000001e-05 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862611+0000", 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.14e-06 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862684+0000", 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2214999999999999e-05 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862773+0000", 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9549000000000006e-05 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862893+0000", 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011952599999999999 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.863567+0000", 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00067476799999999996 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864507+0000", 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00093924999999999998 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864536+0000", 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9726e-05 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864559+0000", 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2529000000000001e-05 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:353 3.1a 3:58c299ba:::rbd_data.11856a5cf33b.0000000000000012:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.862632+0000", 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.52558408499999998, 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001865474, 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 353 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862632+0000", 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862632+0000", 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862633+0000", 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862637+0000", 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.72e-06 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862644+0000", 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2180000000000002e-06 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862650+0000", 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7629999999999997e-06 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862698+0000", 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8109999999999998e-05 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862800+0000", 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010234900000000001 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862913+0000", 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000112656 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864286+0000", 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0013732659999999999 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864397+0000", 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011066 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864457+0000", 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0393999999999998e-05 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864498+0000", 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0757999999999998e-05 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:421 3.1a 3:58c299ba:::rbd_data.11856a5cf33b.0000000000000012:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.933673+0000", 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.45454385400000002, 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037886360000000002, 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 421 2024-09-21T22:15:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933673+0000", 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933673+0000", 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933673+0000", 2024-09-21T22:15:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.85e-07 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933678+0000", 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0600000000000001e-06 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933688+0000", 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0657e-05 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933693+0000", 2024-09-21T22:15:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1229999999999999e-06 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933740+0000", 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6244e-05 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933824+0000", 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4641000000000005e-05 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933938+0000", 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011417 2024-09-21T22:15:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934492+0000", 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00055407000000000004 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937401+0000", 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029082869999999999 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937431+0000", 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0094999999999999e-05 2024-09-21T22:15:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937461+0000", 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0504000000000001e-05 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:420 3.f e28/23 3:f3c1033b:::rbd_data.11856a5cf33b.000000000000000e:head v 28'2, mlcod=0'0)", 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.934031+0000", 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.45418573600000001, 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024586149999999999, 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934031+0000", 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934031+0000", 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934031+0000", 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2799999999999996e-07 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934036+0000", 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3810000000000001e-06 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934043+0000", 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5070000000000003e-06 2024-09-21T22:15:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934048+0000", 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9540000000000003e-06 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934099+0000", 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0997e-05 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934119+0000", 2024-09-21T22:15:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9893000000000001e-05 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.936455+0000", 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002335555 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.936489+0000", 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4799999999999999e-05 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:448 3.f e28/23 3:f3c1033b:::rbd_data.11856a5cf33b.000000000000000e:head v 28'4, mlcod=28'2)", 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.971608+0000", 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.41660855499999999, 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024367360000000001, 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971608+0000", 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971608+0000", 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971609+0000", 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4799999999999998e-07 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971627+0000", 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8014000000000001e-05 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971638+0000", 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1299e-05 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971644+0000", 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7209999999999999e-06 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971691+0000", 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7355999999999999e-05 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.971712+0000", 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0488000000000001e-05 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.974016+0000", 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023040700000000001 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.974045+0000", 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9139999999999999e-05 2024-09-21T22:15:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:450 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:head [set-alloc-hint object_size 4194304 write_size 4194304,write 349118~61595] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.975526+0000", 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.41269094499999998, 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014423000000000001, 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 450 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975526+0000", 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975526+0000", 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975527+0000", 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6249999999999999e-06 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975582+0000", 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4345000000000002e-05 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975593+0000", 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1647999999999999e-05 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975599+0000", 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.178e-06 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975643+0000", 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3801999999999998e-05 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975728+0000", 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4746999999999993e-05 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.975813+0000", 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4914999999999996e-05 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.976884+0000", 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010715810000000001 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.976901+0000", 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6104999999999999e-05 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.976940+0000", 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9165000000000002e-05 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.976968+0000", 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8189000000000001e-05 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:479 3.3 3:c78f9d4c:::rbd_data.11856a5cf33b.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1751502~34737] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.025093+0000", 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.36312373599999997, 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014816129999999999, 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 479 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025093+0000", 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025093+0000", 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025094+0000", 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5510000000000001e-06 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025115+0000", 2024-09-21T22:15:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1010999999999999e-05 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025129+0000", 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3746e-05 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025136+0000", 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9999999999999999e-06 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025189+0000", 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2933999999999998e-05 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025284+0000", 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5231999999999999e-05 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025368+0000", 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4013999999999999e-05 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.025938+0000", 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00056933099999999996 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.026514+0000", 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00057634400000000001 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.026546+0000", 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1597999999999998e-05 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.026574+0000", 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8852000000000001e-05 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:492 3.3 3:c78f9d4c:::rbd_data.11856a5cf33b.0000000000000028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.046664+0000", 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.34155206700000001, 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024671150000000002, 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 492 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046664+0000", 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046664+0000", 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046667+0000", 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0200000000000001e-06 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046673+0000", 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6039999999999998e-06 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046690+0000", 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7317e-05 2024-09-21T22:15:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046698+0000", 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5290000000000003e-06 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047273+0000", 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00057511900000000002 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047365+0000", 2024-09-21T22:15:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2422000000000004e-05 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047507+0000", 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014186900000000001 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048603+0000", 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010955030000000001 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049035+0000", 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043190699999999998 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049086+0000", 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1036999999999999e-05 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049132+0000", 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5788000000000003e-05 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:506 3.9 3:97e5b7ca:::rbd_header.11856a5cf33b:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.067019+0000", 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.32119750499999999, 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015741469999999999, 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 506 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067019+0000", 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067019+0000", 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067020+0000", 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.054e-06 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067026+0000", 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6280000000000002e-06 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067040+0000", 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3927999999999999e-05 2024-09-21T22:15:42.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067047+0000", 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6690000000000006e-06 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067091+0000", 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3461999999999998e-05 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067145+0000", 2024-09-21T22:15:42.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3943000000000002e-05 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067264+0000", 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000119531 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.067678+0000", 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041364199999999998 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.068543+0000", 2024-09-21T22:15:42.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00086496999999999995 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.068571+0000", 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7976000000000001e-05 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.068593+0000", 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2344000000000002e-05 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:520 3.11 e28/23 3:88a22621:::rbd_data.11856a5cf33b.0000000000000001:head v 28'4, mlcod=28'2)", 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.088741+0000", 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.29947599499999999, 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021754679999999998, 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088741+0000", 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088741+0000", 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088742+0000", 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2720000000000001e-06 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088753+0000", 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1307e-05 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088782+0000", 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8527999999999999e-05 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088792+0000", 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.961e-06 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088856+0000", 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4189000000000005e-05 2024-09-21T22:15:42.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.088880+0000", 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4374000000000001e-05 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.090883+0000", 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002002518 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.090916+0000", 2024-09-21T22:15:42.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3318999999999997e-05 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:531 3.9 3:97e5b7ca:::rbd_header.11856a5cf33b:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.116579+0000", 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.27163757799999999, 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015244099999999999, 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.479 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 531 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116579+0000", 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116579+0000", 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116580+0000", 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4499999999999996e-07 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116584+0000", 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.408e-06 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116595+0000", 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0733e-05 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116600+0000", 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.434e-06 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116646+0000", 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5184e-05 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116699+0000", 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3154e-05 2024-09-21T22:15:42.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.116808+0000", 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000109522 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.117221+0000", 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000412817 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.118009+0000", 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00078801000000000001 2024-09-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.118063+0000", 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3761000000000002e-05 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.118103+0000", 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0541999999999999e-05 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:547 3.e e28/23 3:70dd2a23:::rbd_data.11856a5cf33b.0000000000000019:head v 28'10, mlcod=28'8)", 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.131351+0000", 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.25686556700000002, 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001842865, 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131351+0000", 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131351+0000", 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131352+0000", 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131374+0000", 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2039e-05 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131383+0000", 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0890000000000006e-06 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131387+0000", 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4850000000000003e-06 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131432+0000", 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5034000000000003e-05 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.131460+0000", 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7878999999999999e-05 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.133160+0000", 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001699809 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.133194+0000", 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3958999999999998e-05 2024-09-21T22:15:42.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:565 3.3 3:c78f9d4c:::rbd_data.11856a5cf33b.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.156687+0000", 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.231529915, 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040958740000000002, 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.489 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 565 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156687+0000", 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156687+0000", 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156688+0000", 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3990000000000001e-06 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156695+0000", 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1199999999999996e-06 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156706+0000", 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1192999999999999e-05 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156713+0000", 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156760+0000", 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7284999999999999e-05 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.156809+0000", 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9125999999999997e-05 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:42.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.157475+0000", 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00066567700000000004 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.160714+0000", 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0032392609999999998 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.160724+0000", 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1330000000000005e-06 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.160752+0000", 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8513999999999998e-05 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.160783+0000", 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0431000000000001e-05 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.494 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:42.496 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:15:42.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:42.494+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:42.597 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:42.596+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:42.640 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:42.640 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:42.640 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:42.640 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:42.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:15:42.698 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:42.696+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:42.752 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:42.752 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:42.752 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:42.752 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:42.753 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:42.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:15:42.798 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:42.797+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:42.865 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:42.891 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:42.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:42.891 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:42.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.892 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4241.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-21T22:15:42.892 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:26.397169+0000", 2024-09-21T22:15:42.893 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.465808568, 2024-09-21T22:15:42.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010191412, 2024-09-21T22:15:42.893 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.893 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.893 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4241", 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2916123753", 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397169+0000", 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397169+0000", 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397173+0000", 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7160000000000002e-06 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397182+0000", 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7600000000000008e-06 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397195+0000", 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3004e-05 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397211+0000", 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5648e-05 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397435+0000", 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000224534 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.397455+0000", 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9242e-05 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.405186+0000", 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0077317510000000002 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.405347+0000", 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016058199999999999 2024-09-21T22:15:42.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.405483+0000", 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000135735 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.406688+0000", 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001205891 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.407278+0000", 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00058924300000000004 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.407315+0000", 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7545000000000001e-05 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:26.407360+0000", 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4761000000000001e-05 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4241.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:27.401378+0000", 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.461599256, 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039421589999999998, 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4241", 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2916123753", 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 5 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401378+0000", 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401378+0000", 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401380+0000", 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.736e-06 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401389+0000", 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4939999999999992e-06 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401407+0000", 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7649e-05 2024-09-21T22:15:42.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401421+0000", 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3918e-05 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401499+0000", 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8568999999999999e-05 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.401508+0000", 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4200000000000007e-06 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.403159+0000", 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0016512790000000001 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.403315+0000", 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000155585 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.403512+0000", 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000197853 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.404313+0000", 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00080072200000000002 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.405254+0000", 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00094101500000000002 2024-09-21T22:15:42.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.405291+0000", 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7103e-05 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:27.405320+0000", 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8816e-05 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4241.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:28.402036+0000", 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.460941087, 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035140219999999999, 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4241", 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2916123753", 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 7 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402036+0000", 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402036+0000", 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402039+0000", 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402052+0000", 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2777e-05 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402074+0000", 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2523000000000001e-05 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402087+0000", 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.259e-05 2024-09-21T22:15:42.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402165+0000", 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8048999999999998e-05 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.402172+0000", 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2389999999999996e-06 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.403845+0000", 2024-09-21T22:15:42.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00167275 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.403914+0000", 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9507999999999999e-05 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.404030+0000", 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000116039 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.405264+0000", 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001233757 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.405456+0000", 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000192356 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.405502+0000", 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5497000000000002e-05 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:28.405550+0000", 2024-09-21T22:15:42.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8239999999999999e-05 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:10 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:38.449345+0000", 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.413632486, 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058486579999999996, 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.913 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 10 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449345+0000", 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449345+0000", 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449346+0000", 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3549999999999999e-06 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449353+0000", 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449361+0000", 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4030000000000007e-06 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449369+0000", 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8790000000000003e-06 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449429+0000", 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9444000000000002e-05 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.449434+0000", 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4729999999999999e-06 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451554+0000", 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021194400000000002 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451659+0000", 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0001052 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.451794+0000", 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013491499999999999 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.452466+0000", 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00067246500000000002 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.455130+0000", 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026642250000000001 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.455167+0000", 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6390999999999998e-05 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.455193+0000", 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6594e-05 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:11 3.1f e26/23 3:fa654f18:::rbd_id.image_client.0:head v 26'1, mlcod=0'0)", 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:38.457829+0000", 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.4051482870000003, 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003270888, 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457829+0000", 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457829+0000", 2024-09-21T22:15:42.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457829+0000", 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7599999999999999e-07 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457833+0000", 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0470000000000004e-06 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457843+0000", 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9420000000000007e-06 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457850+0000", 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4470000000000003e-06 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457901+0000", 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1946e-05 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.457923+0000", 2024-09-21T22:15:42.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1844e-05 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.461056+0000", 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031329779999999998 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:38.461100+0000", 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3507999999999997e-05 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:167 3.1c 3:3b4f43fa:::rbd_data.11856a5cf33b.000000000000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.660664+0000", 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.202313172, 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026950960000000001, 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 167 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660664+0000", 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660664+0000", 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660665+0000", 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.540000000000001e-07 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660671+0000", 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6679999999999998e-06 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660682+0000", 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0953e-05 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660688+0000", 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6050000000000003e-06 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660744+0000", 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5489999999999999e-05 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660829+0000", 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5393e-05 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660930+0000", 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100986 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.663105+0000", 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002175008 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.663303+0000", 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000197801 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.663334+0000", 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1557999999999998e-05 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.663359+0000", 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4680000000000001e-05 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:169 3.5 3:a5549d6f:::rbd_data.11856a5cf33b.000000000000002d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.660709+0000", 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.202268541, 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00487076, 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 169 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660709+0000", 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660709+0000", 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660709+0000", 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.89e-07 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660712+0000", 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0929999999999999e-06 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660719+0000", 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3379999999999999e-06 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660724+0000", 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7350000000000004e-06 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660772+0000", 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7636999999999998e-05 2024-09-21T22:15:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.660853+0000", 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1007999999999994e-05 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.665502+0000", 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.004649256 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.665533+0000", 2024-09-21T22:15:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1074000000000001e-05 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.665579+0000", 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6230000000000003e-05 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:218 3.16 3:6ffd439f:::rbd_data.11856a5cf33b.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1150435~25768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.718066+0000", 2024-09-21T22:15:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.144911555, 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001183471, 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 218 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718066+0000", 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718066+0000", 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718066+0000", 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5000000000000002e-07 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718082+0000", 2024-09-21T22:15:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5659e-05 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718093+0000", 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0662999999999999e-05 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718098+0000", 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7300000000000002e-06 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718143+0000", 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4697999999999998e-05 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718217+0000", 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4245999999999994e-05 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718300+0000", 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2189999999999997e-05 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.718889+0000", 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000589144 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.719161+0000", 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000272551 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.719209+0000", 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7246999999999997e-05 2024-09-21T22:15:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.719249+0000", 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0593000000000003e-05 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:285 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.796895+0000", 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.066082588, 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0029374660000000001, 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 285 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.796895+0000", 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.796895+0000", 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.796896+0000", 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2240000000000001e-06 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.796902+0000", 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9200000000000001e-06 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.796913+0000", 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1732999999999999e-05 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.796919+0000", 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4600000000000002e-06 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.796963+0000", 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3968999999999999e-05 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.797051+0000", 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7946000000000001e-05 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.797486+0000", 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043562000000000001 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.799533+0000", 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020469490000000002 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.799775+0000", 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024167200000000001 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.799805+0000", 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0128999999999999e-05 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.799832+0000", 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6843999999999999e-05 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:351 3.16 3:6ffd439f:::rbd_data.11856a5cf33b.000000000000000c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.862587+0000", 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.0003899329999999, 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001956167, 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 351 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862587+0000", 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862587+0000", 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862589+0000", 2024-09-21T22:15:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3209999999999999e-06 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862594+0000", 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5489999999999997e-06 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862608+0000", 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.393e-05 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862617+0000", 2024-09-21T22:15:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5080000000000005e-06 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862678+0000", 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1784000000000003e-05 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862757+0000", 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9012999999999997e-05 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862869+0000", 2024-09-21T22:15:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000112052 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864158+0000", 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001288478 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864463+0000", 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030514099999999998 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864512+0000", 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9067999999999998e-05 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864543+0000", 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1322999999999998e-05 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:355 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.862648+0000", 2024-09-21T22:15:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.0003291999999999, 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025981189999999999, 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 355 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862648+0000", 2024-09-21T22:15:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862648+0000", 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862649+0000", 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4499999999999997e-07 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862653+0000", 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5410000000000002e-06 2024-09-21T22:15:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862665+0000", 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1671999999999999e-05 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862671+0000", 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0059999999999998e-06 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.863147+0000", 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00047618200000000002 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.863266+0000", 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011879600000000001 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.863373+0000", 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107528 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864565+0000", 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00119136 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.865198+0000", 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00063294299999999996 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.865224+0000", 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6404e-05 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.865246+0000", 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2042e-05 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:354 3.17 e28/23 3:ebe009d6:::rbd_data.11856a5cf33b.0000000000000017:head v 28'2, mlcod=0'0)", 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.862927+0000", 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.000050197, 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015122499999999999, 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862927+0000", 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862927+0000", 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862928+0000", 2024-09-21T22:15:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.850000000000001e-07 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862936+0000", 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4999999999999999e-06 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862948+0000", 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1511999999999999e-05 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.862955+0000", 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.863016+0000", 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0945e-05 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.863035+0000", 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9245e-05 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864401+0000", 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00136523 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.864439+0000", 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8529999999999999e-05 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:403 3.c 3:30d5e4b6:::rbd_data.11856a5cf33b.0000000000000029:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2271326~64757] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.907323+0000", 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.95565385800000002, 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00098101799999999995, 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 403 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907323+0000", 2024-09-21T22:15:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907323+0000", 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907325+0000", 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-06 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907364+0000", 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9734999999999998e-05 2024-09-21T22:15:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907377+0000", 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3117e-05 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907385+0000", 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6499999999999996e-06 2024-09-21T22:15:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907441+0000", 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5761999999999999e-05 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.907529+0000", 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7870999999999999e-05 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.908229+0000", 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00070018299999999995 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.908261+0000", 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2033999999999999e-05 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.908304+0000", 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3392000000000001e-05 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:452 3.5 3:a0335b4c:::rbd_data.11856a5cf33b.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.978219+0000", 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88475810399999999, 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040819699999999999, 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 452 2024-09-21T22:15:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978219+0000", 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978219+0000", 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978221+0000", 2024-09-21T22:15:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978228+0000", 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3089999999999998e-06 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978244+0000", 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5238e-05 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978253+0000", 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0070000000000003e-06 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978304+0000", 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1026999999999998e-05 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.978355+0000", 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1007000000000001e-05 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.982150+0000", 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037949540000000001 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.982207+0000", 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7507999999999999e-05 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.982301+0000", 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3923000000000002e-05 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:495 3.5 3:a0335b4c:::rbd_data.11856a5cf33b.0000000000000007:head [truncate 2611101] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.050559+0000", 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.81241769799999997, 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00082065199999999995, 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 495 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050559+0000", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050559+0000", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050561+0000", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.934e-06 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050571+0000", 2024-09-21T22:15:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2070000000000001e-06 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050592+0000", 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0981000000000001e-05 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050603+0000", 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0964e-05 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050658+0000", 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5546e-05 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.050718+0000", 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9786e-05 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.051239+0000", 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000520781 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.051292+0000", 2024-09-21T22:15:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3711000000000001e-05 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.051380+0000", 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7742000000000001e-05 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:546 3.1d 3:b9eba10b:::rbd_data.11856a5cf33b.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3699683~56884] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.129680+0000", 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.73329701400000002, 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001159799, 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 546 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129680+0000", 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129680+0000", 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129682+0000", 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.903e-06 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129716+0000", 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4393000000000001e-05 2024-09-21T22:15:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129732+0000", 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5722999999999998e-05 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129740+0000", 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4800000000000004e-06 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129789+0000", 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8856000000000001e-05 2024-09-21T22:15:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129862+0000", 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3868000000000005e-05 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.129936+0000", 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4023999999999995e-05 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.130648+0000", 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00071160099999999997 2024-09-21T22:15:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.130786+0000", 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000138264 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.130815+0000", 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8385e-05 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.130840+0000", 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5301999999999999e-05 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:563 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4137740~56564] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.152047+0000", 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.71093027900000005, 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027833179999999999, 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 563 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152047+0000", 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152047+0000", 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152049+0000", 2024-09-21T22:15:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152078+0000", 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9079000000000001e-05 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152095+0000", 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6719999999999999e-05 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152102+0000", 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5939999999999996e-06 2024-09-21T22:15:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152157+0000", 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4756999999999998e-05 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152212+0000", 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4815999999999998e-05 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152304+0000", 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2052000000000006e-05 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.152900+0000", 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059657600000000003 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.154731+0000", 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018301999999999999 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.154787+0000", 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5986999999999998e-05 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.154830+0000", 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3628999999999999e-05 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:567 3.16 3:6ffd439f:::rbd_data.11856a5cf33b.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1090269~9215] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.162617+0000", 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.70036015200000001, 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0012383439999999999, 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 567 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162617+0000", 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162617+0000", 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162619+0000", 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.578e-06 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162639+0000", 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9945e-05 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162654+0000", 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.519e-05 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162660+0000", 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6850000000000004e-06 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162715+0000", 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4923999999999998e-05 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162796+0000", 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0319000000000001e-05 2024-09-21T22:15:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.162943+0000", 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014781199999999999 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.163621+0000", 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00067788400000000002 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.163793+0000", 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00017184599999999999 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.163825+0000", 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1721999999999999e-05 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.163855+0000", 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0439000000000001e-05 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:577 3.c 3:3466bc76:::rbd_object_map.11856a5cf33b.0000000000000003:head [writefull 0~49] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.467047+0000", 2024-09-21T22:15:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39592989099999998, 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022599230000000001, 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 577 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467047+0000", 2024-09-21T22:15:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467047+0000", 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467049+0000", 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.829e-06 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467057+0000", 2024-09-21T22:15:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2300000000000008e-06 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467072+0000", 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5105e-05 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467081+0000", 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0730000000000005e-06 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467136+0000", 2024-09-21T22:15:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5364000000000001e-05 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.467145+0000", 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8319999999999995e-06 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.468587+0000", 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014417709999999999 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.468676+0000", 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9759999999999994e-05 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.469224+0000", 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00054758400000000005 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.469259+0000", 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5549999999999997e-05 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.469307+0000", 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7824999999999997e-05 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:607 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.486418+0000", 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.37655936499999998, 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010907829999999999, 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 607 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486418+0000", 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486418+0000", 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486419+0000", 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2900000000000003e-07 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486423+0000", 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7910000000000004e-06 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486433+0000", 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7249999999999992e-06 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486438+0000", 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.164e-06 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486485+0000", 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6879000000000003e-05 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486534+0000", 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8705000000000002e-05 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.486671+0000", 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013687899999999999 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.487155+0000", 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00048426699999999998 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.487445+0000", 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00029052199999999998 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.487485+0000", 2024-09-21T22:15:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9623000000000003e-05 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.487509+0000", 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499e-05 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.003 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:43.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:43.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:43.003+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:43.105 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:43.104+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:43.110 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:43.110 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:43.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:43.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:43.205+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:43.222 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:43.222 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:43.222 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:43.222 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:43.222 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:43.230 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:43.307 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:43.305+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:193 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.689302+0000", 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.6441658590000001, 2024-09-21T22:15:43.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0012359199999999999, 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 193 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689302+0000", 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689302+0000", 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689303+0000", 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1820000000000001e-06 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689309+0000", 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.648e-06 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689322+0000", 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2601e-05 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689330+0000", 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9810000000000003e-06 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689380+0000", 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0806000000000001e-05 2024-09-21T22:15:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689432+0000", 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1347999999999997e-05 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689503+0000", 2024-09-21T22:15:43.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1177e-05 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.689911+0000", 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00040838499999999999 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690482+0000", 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00057070999999999999 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690511+0000", 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9558999999999999e-05 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690538+0000", 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6523e-05 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:193 3.10 e28/23 ondisk, result = 0)", 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.690410+0000", 2024-09-21T22:15:43.341 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.643057904, 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013213299999999999, 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690410+0000", 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690410+0000", 2024-09-21T22:15:43.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690411+0000", 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5599999999999995e-07 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690416+0000", 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9370000000000003e-06 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690424+0000", 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7169999999999997e-06 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690428+0000", 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2239999999999997e-06 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690473+0000", 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4617999999999999e-05 2024-09-21T22:15:43.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690479+0000", 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6380000000000001e-06 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.690542+0000", 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3442999999999995e-05 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:379 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.888640+0000", 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.444827954, 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011950070000000001, 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 379 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888640+0000", 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888640+0000", 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888642+0000", 2024-09-21T22:15:43.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5209999999999999e-06 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888648+0000", 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8569999999999997e-06 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888662+0000", 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4087000000000001e-05 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888673+0000", 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.081e-05 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888731+0000", 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7902999999999998e-05 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888784+0000", 2024-09-21T22:15:43.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2537000000000002e-05 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.888882+0000", 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889500+0000", 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061744999999999997 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889778+0000", 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027829299999999999 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889808+0000", 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0307999999999998e-05 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889835+0000", 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6679999999999999e-05 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:379 3.10 e28/23 ondisk, result = 0)", 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.889718+0000", 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.4437497029999999, 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000121395, 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889718+0000", 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889718+0000", 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889719+0000", 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9800000000000002e-07 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889723+0000", 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8020000000000002e-06 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889731+0000", 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3939999999999996e-06 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889735+0000", 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8340000000000001e-06 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889770+0000", 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4894999999999997e-05 2024-09-21T22:15:43.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889774+0000", 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0559999999999998e-06 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.889840+0000", 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5415999999999998e-05 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:419 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.355 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.399801721, 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040014170000000002, 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 419 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933668+0000", 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.378e-06 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933675+0000", 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.109e-06 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933688+0000", 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3291e-05 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933695+0000", 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3520000000000001e-06 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933760+0000", 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4488999999999999e-05 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933846+0000", 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6199999999999995e-05 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933963+0000", 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000116937 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934556+0000", 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059266699999999996 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937613+0000", 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030571660000000001 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937641+0000", 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8381000000000002e-05 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937668+0000", 2024-09-21T22:15:43.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6446999999999999e-05 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:419 3.10 e28/23 ondisk, result = 0)", 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.937554+0000", 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.395914171, 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000117967, 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937554+0000", 2024-09-21T22:15:43.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937554+0000", 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937554+0000", 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0999999999999998e-07 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937558+0000", 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5090000000000002e-06 2024-09-21T22:15:43.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937568+0000", 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5289999999999997e-06 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937572+0000", 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4510000000000002e-06 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937604+0000", 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1906000000000003e-05 2024-09-21T22:15:43.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937609+0000", 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.826e-06 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937672+0000", 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3035999999999998e-05 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:454 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 940076~27508] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.364 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.983680+0000", 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.3497880769999999, 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001540923, 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 454 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983680+0000", 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983680+0000", 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983682+0000", 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7630000000000001e-06 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983732+0000", 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0336000000000001e-05 2024-09-21T22:15:43.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983747+0000", 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4788e-05 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983756+0000", 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0720000000000006e-06 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983815+0000", 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8817000000000003e-05 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983896+0000", 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0993000000000002e-05 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.984040+0000", 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000144597 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.984887+0000", 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00084723199999999995 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985157+0000", 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026972699999999999 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985191+0000", 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4168999999999998e-05 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985221+0000", 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9428999999999999e-05 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:454 3.10 e28/23 ondisk, result = 0)", 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.985099+0000", 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.3483687440000001, 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012736900000000001, 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.370 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985099+0000", 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985099+0000", 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985100+0000", 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.99e-07 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985104+0000", 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0899999999999998e-06 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985112+0000", 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6830000000000008e-06 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985116+0000", 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6550000000000003e-06 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985147+0000", 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0614999999999997e-05 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985153+0000", 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0780000000000001e-06 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985227+0000", 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3548999999999997e-05 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:477 3.10 3.49d83570 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.020372+0000", 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.313095626, 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000201125, 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.374 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 477 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020372+0000", 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020372+0000", 2024-09-21T22:15:43.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020374+0000", 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.052e-06 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020453+0000", 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8695000000000005e-05 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020473+0000", 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9647e-05 2024-09-21T22:15:43.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020483+0000", 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0281e-05 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020564+0000", 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0700999999999999e-05 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.020573+0000", 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7489999999999993e-06 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.377 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:477 3.10 3:0eac1b92:::rbd_data.11856a5cf33b.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2695562~54346] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.312308429, 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018129450000000001, 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 477 2024-09-21T22:15:43.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:43.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8899999999999998e-07 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021248+0000", 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7750000000000005e-05 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021256+0000", 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6790000000000005e-06 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021261+0000", 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5060000000000003e-06 2024-09-21T22:15:43.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021305+0000", 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4041000000000001e-05 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021479+0000", 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00017363799999999999 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021626+0000", 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014658600000000001 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022425+0000", 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00079913499999999997 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022916+0000", 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00049179099999999999 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022947+0000", 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0645999999999998e-05 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022972+0000", 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5384e-05 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:477 3.10 e28/23 ondisk, result = 0)", 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.022841+0000", 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.3106268669999999, 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013599400000000001, 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022841+0000", 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022841+0000", 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022842+0000", 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6000000000000002e-07 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022846+0000", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022859+0000", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2442e-05 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022868+0000", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4509999999999998e-06 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022908+0000", 2024-09-21T22:15:43.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9269e-05 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022913+0000", 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7610000000000004e-06 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022977+0000", 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3701000000000006e-05 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:490 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.046680+0000", 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.286788453, 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001765015, 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 490 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046680+0000", 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046680+0000", 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046682+0000", 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.339e-06 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046693+0000", 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.116e-05 2024-09-21T22:15:43.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046716+0000", 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.268e-05 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046728+0000", 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2149e-05 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046805+0000", 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6958000000000004e-05 2024-09-21T22:15:43.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046906+0000", 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101377 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047020+0000", 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000113565 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047809+0000", 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00078948500000000003 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048386+0000", 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00057631999999999996 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048418+0000", 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2419000000000003e-05 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048445+0000", 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6563e-05 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:493 3.10 3:0eac1b92:::rbd_data.11856a5cf33b.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.2867093729999999, 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024082309999999998, 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 493 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4700000000000001e-07 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046762+0000", 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3270000000000001e-06 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046770+0000", 2024-09-21T22:15:43.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8040000000000002e-06 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046778+0000", 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047340+0000", 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00056201600000000003 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047425+0000", 2024-09-21T22:15:43.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4271999999999995e-05 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047540+0000", 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011576799999999999 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048628+0000", 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010874389999999999 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049111+0000", 2024-09-21T22:15:43.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00048346700000000001 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049143+0000", 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1649000000000001e-05 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049167+0000", 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3903000000000001e-05 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:490 3.10 e28/23 ondisk, result = 0)", 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.048312+0000", 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.2851558080000001, 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014479799999999999, 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048312+0000", 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048312+0000", 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048313+0000", 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.065e-06 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048318+0000", 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.989e-06 2024-09-21T22:15:43.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048332+0000", 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3721e-05 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048339+0000", 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048377+0000", 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8055000000000001e-05 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048381+0000", 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-06 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048457+0000", 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5479e-05 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:493 3.10 e28/23 ondisk, result = 0)", 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.048544+0000", 2024-09-21T22:15:43.401 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.284923587, 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0928999999999996e-05, 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048544+0000", 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048544+0000", 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048545+0000", 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8500000000000001e-07 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048549+0000", 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7179999999999998e-06 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048560+0000", 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1347e-05 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048567+0000", 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4270000000000002e-06 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048614+0000", 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6137000000000002e-05 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048622+0000", 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6249999999999996e-06 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048635+0000", 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.309e-05 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:542 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:head [set-alloc-hint object_size 4194304 write_size 4194304,write 642461~209] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.124291+0000", 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.2091770719999999, 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000922381, 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 542 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124291+0000", 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124291+0000", 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124293+0000", 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.888e-06 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124302+0000", 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.02e-06 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124315+0000", 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3448999999999999e-05 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124324+0000", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124377+0000", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3007999999999998e-05 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.124472+0000", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4408999999999997e-05 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.125139+0000", 2024-09-21T22:15:43.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00066725200000000001 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.125165+0000", 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6437000000000001e-05 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.125213+0000", 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7859999999999999e-05 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.409 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:43.411 INFO:teuthology.orchestra.run.smithi134.stderr:Exporting 3.c info 3.c( empty local-lis/les=23/24 n=0 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-21T22:15:43.411 INFO:teuthology.orchestra.run.smithi134.stderr:Export successful 2024-09-21T22:15:43.411 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:43.412 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:43.409+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:43.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:15:43.511 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:43.509+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:43.601 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:43.602 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:43.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:43.652 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:43.650+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:43.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:15:43.713 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:43.711+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:43.754 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:43.754 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:43.755 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:43.755 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:43.755 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:43.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:43.813 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:43.813 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:43.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:43.812+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:43.830 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:43.830 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:43.846 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:43.846 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:43.846 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:43.862 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:43.863 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:43.879 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:43.879 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:43.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --force --op remove --pgid 3.c 2024-09-21T22:15:43.897 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:43.898 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:836 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3801088~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.42509510299999997, 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013595324000000001, 2024-09-21T22:15:43.910 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 836 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482744+0000", 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1599999999999999e-06 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482747+0000", 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1089999999999998e-06 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482749+0000", 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3e-06 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496166+0000", 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013416855 2024-09-21T22:15:43.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496240+0000", 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3579999999999997e-05 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496338+0000", 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8098999999999997e-05 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:837 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3866624~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.42508540099999997, 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013717548, 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 837 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482753+0000", 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1399999999999995e-07 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482757+0000", 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8020000000000002e-06 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482759+0000", 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2589999999999999e-06 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496374+0000", 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013614446000000001 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496412+0000", 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8325999999999999e-05 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496470+0000", 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7593999999999998e-05 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:838 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3932160~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.42507547200000001, 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013928474, 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 838 2024-09-21T22:15:43.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482763+0000", 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0800000000000001e-07 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482763+0000", 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4600000000000003e-07 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482767+0000", 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0900000000000001e-06 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482769+0000", 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.283e-06 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496503+0000", 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013734 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496581+0000", 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8578999999999994e-05 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496691+0000", 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000109268 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:839 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3997696~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.42506534200000001, 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014045281999999999, 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 839 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482773+0000", 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482777+0000", 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7639999999999996e-06 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482781+0000", 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3759999999999999e-06 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482783+0000", 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.357e-06 2024-09-21T22:15:43.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496727+0000", 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013944061000000001 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496768+0000", 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1318e-05 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496818+0000", 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9202000000000001e-05 2024-09-21T22:15:43.926 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:840 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 4063232~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.42505137999999998, 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014530977, 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.927 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 840 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482787+0000", 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482788+0000", 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0669999999999999e-06 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482791+0000", 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.004e-06 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482793+0000", 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.847e-06 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496863+0000", 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014069504 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496940+0000", 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6724000000000006e-05 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497317+0000", 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037761199999999999 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:841 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 4128768~567 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:43.931 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.425041314, 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014781610000000001, 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 841 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482797+0000", 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.05e-07 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482798+0000", 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9699999999999994e-07 2024-09-21T22:15:43.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482801+0000", 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0690000000000002e-06 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482803+0000", 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497346+0000", 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014543512 2024-09-21T22:15:43.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497388+0000", 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1618e-05 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497578+0000", 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018990000000000001 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.935 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1014 3.15 3:ad0e59cf:::rbd_data.11856a5cf33b.0000000000000002:3 [read 3506176~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507575+0000", 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.40026233999999999, 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013522785000000001, 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1014 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507575+0000", 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507575+0000", 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507576+0000", 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507578+0000", 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8050000000000001e-06 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507583+0000", 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8440000000000003e-06 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507588+0000", 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4139999999999996e-06 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.520883+0000", 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013294742999999999 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.520960+0000", 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7502000000000004e-05 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521098+0000", 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013810100000000001 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1015 3.15 3:ad0e59cf:::rbd_data.11856a5cf33b.0000000000000002:3 [read 3571712~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.40024378399999999, 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013982695999999999, 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1015 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.940 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:43.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507596+0000", 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.996e-06 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507609+0000", 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2276000000000001e-05 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507614+0000", 2024-09-21T22:15:43.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521139+0000", 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01352561 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521192+0000", 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2317000000000001e-05 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521577+0000", 2024-09-21T22:15:43.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038497599999999998 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1016 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.40021592099999997, 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014357010999999999, 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.944 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1016 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507624+0000", 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507632+0000", 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8269999999999998e-06 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507635+0000", 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521625+0000", 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013989661 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521759+0000", 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013431900000000001 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521979+0000", 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000219803 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1018 3.15 3:ae013215:::rbd_data.1185ff358907.0000000000000002:head [write 0~1016375 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39979083199999998, 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019909570000000001, 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:43.948 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1018 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0399999999999996e-07 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509915+0000", 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018678049999999999 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509926+0000", 2024-09-21T22:15:43.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0729e-05 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509937+0000", 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1447999999999999e-05 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522027+0000", 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012089379000000001 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522161+0000", 2024-09-21T22:15:43.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134525 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527828+0000", 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056671430000000004 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527880+0000", 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1329000000000003e-05 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527956+0000", 2024-09-21T22:15:43.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6607999999999996e-05 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1019 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39788512599999998, 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014915193, 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1019 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1099999999999995e-07 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509955+0000", 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509959+0000", 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509964+0000", 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5129999999999998e-06 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524643+0000", 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014679073000000001 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524742+0000", 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8604999999999995e-05 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524868+0000", 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012606299999999999 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1021 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39786898799999998, 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015100463, 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1021 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509971+0000", 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.886e-06 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509974+0000", 2024-09-21T22:15:43.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3720000000000001e-06 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509977+0000", 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7520000000000001e-06 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524899+0000", 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014921751 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524964+0000", 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5703000000000004e-05 2024-09-21T22:15:43.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525069+0000", 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104726 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1023 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.397420677, 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014865608000000001, 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.961 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1023 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:43.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510418+0000", 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4199999999999995e-07 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510422+0000", 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4220000000000002e-06 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510431+0000", 2024-09-21T22:15:43.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4619999999999996e-06 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510436+0000", 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3070000000000002e-06 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525098+0000", 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014661990999999999 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525171+0000", 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2889e-05 2024-09-21T22:15:43.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525283+0000", 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111795 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1133 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1212416~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.38208315500000001, 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013461615999999999, 2024-09-21T22:15:43.965 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1133 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525758+0000", 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2160000000000002e-06 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525767+0000", 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7090000000000008e-06 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525772+0000", 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.538937+0000", 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013165081 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539048+0000", 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110467 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539216+0000", 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016844900000000001 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.969 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1134 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1277952~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.38204792700000001, 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013821072, 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1134 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525793+0000", 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3269999999999999e-06 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525800+0000", 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1640000000000004e-06 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525805+0000", 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0540000000000002e-06 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539256+0000", 2024-09-21T22:15:43.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013451174 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539419+0000", 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016245800000000001 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539611+0000", 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00019230500000000001 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1135 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1343488~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.382024682, 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014032734, 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1135 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525814+0000", 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9299999999999997e-07 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525816+0000", 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7410000000000001e-06 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525828+0000", 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1389999999999999e-05 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525835+0000", 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5680000000000002e-06 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539642+0000", 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013806992000000001 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539717+0000", 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4788000000000003e-05 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539846+0000", 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012856200000000001 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1136 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1409024~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.381995221, 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014210109, 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1136 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.978 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525843+0000", 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:15:43.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525845+0000", 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3760000000000002e-06 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525852+0000", 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.613e-06 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525857+0000", 2024-09-21T22:15:43.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7779999999999998e-06 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539873+0000", 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014016673 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539942+0000", 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8436999999999995e-05 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540053+0000", 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110808 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1137 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1474560~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.38197503700000002, 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014416333, 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.982 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1137 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:43.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525866+0000", 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2310000000000001e-06 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525873+0000", 2024-09-21T22:15:43.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6030000000000001e-06 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525877+0000", 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000002e-06 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540084+0000", 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014206185 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540160+0000", 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6132999999999998e-05 2024-09-21T22:15:43.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540279+0000", 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011923 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1138 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1540096~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.38195399800000002, 2024-09-21T22:15:43.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015066355999999999, 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1138 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525890+0000", 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525897+0000", 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8519999999999998e-06 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525902+0000", 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4909999999999999e-06 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540309+0000", 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014407392999999999 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540386+0000", 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6775999999999998e-05 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540950+0000", 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00056422700000000004 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1139 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.38192912099999998, 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017975142999999999, 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1139 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:43.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525911+0000", 2024-09-21T22:15:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525917+0000", 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8599999999999998e-06 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525921+0000", 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540743+0000", 2024-09-21T22:15:43.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014821166 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540833+0000", 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0853000000000006e-05 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543884+0000", 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030503219999999998 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:43.994 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:43.995 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:43.995 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:43.996 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:43.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:43.997 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:43.997 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:43.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:43.995+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:44.096 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:44.095+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:44.141 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:44.141 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:44.150 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:44.197 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:44.196+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:44.256 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:44.256 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:44.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:44.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:44.306+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:44.399 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:44.397+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:44.408 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:44.409 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:44.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:44.473 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:15:44.500 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:44.499+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:44.529 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:44.529 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:44.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:44.601 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:44.600+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:44.629 INFO:teuthology.orchestra.run.smithi134.stdout:249 punch from 0x6070510 to 0x60763d0, (0x5ec0 bytes) 2024-09-21T22:15:44.648 INFO:teuthology.orchestra.run.smithi134.stdout:250 trunc from 0xe77bce2 to 0x13150d1 2024-09-21T22:15:44.668 INFO:teuthology.orchestra.run.smithi134.stdout:252 punch from 0xfaab76 to 0xfb2aa3, (0x7f2d bytes) 2024-09-21T22:15:44.668 INFO:teuthology.orchestra.run.smithi134.stdout:253 read 0xa3c28e thru 0xa3cc88 (0x9fb bytes) 2024-09-21T22:15:44.668 INFO:teuthology.orchestra.run.smithi134.stdout:254 read 0x104993d thru 0x105126c (0x7930 bytes) 2024-09-21T22:15:44.673 INFO:teuthology.orchestra.run.smithi134.stdout:256 trunc from 0x13150d1 to 0x4fbc3f7 2024-09-21T22:15:44.692 INFO:teuthology.orchestra.run.smithi134.stdout:257 write 0xbdbee79 thru 0xbdc49b3 (0x5b3b bytes) 2024-09-21T22:15:44.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:44.700+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:44.702 INFO:teuthology.orchestra.run.smithi134.stdout:258 trunc from 0xbdc49b4 to 0x6ebdca7 2024-09-21T22:15:44.706 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:44.706 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:44.712 INFO:teuthology.orchestra.run.smithi134.stdout:259 read 0x4e0ebc thru 0x4e3491 (0x25d6 bytes) 2024-09-21T22:15:44.713 INFO:teuthology.orchestra.run.smithi134.stdout:260 write 0x27e41b2 thru 0x27eb00f (0x6e5e bytes) 2024-09-21T22:15:44.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:44.717 INFO:teuthology.orchestra.run.smithi134.stdout:263 write 0x27297f6 thru 0x2731b99 (0x83a4 bytes) 2024-09-21T22:15:44.720 INFO:teuthology.orchestra.run.smithi134.stdout:265 punch from 0x3729298 to 0x37302dc, (0x7044 bytes) 2024-09-21T22:15:44.733 INFO:teuthology.orchestra.run.smithi134.stdout:266 writesame 0xd26b444 thru 0xd275147 data_size 0x1a(0x9d04 bytes) 2024-09-21T22:15:44.733 INFO:teuthology.orchestra.run.smithi134.stdout:267 read 0x8ac0c69 thru 0x8ac5053 (0x43eb bytes) 2024-09-21T22:15:44.733 INFO:teuthology.orchestra.run.smithi134.stdout:268 punch from 0xc477ee to 0xc4bb24, (0x4336 bytes) 2024-09-21T22:15:44.733 INFO:teuthology.orchestra.run.smithi134.stdout:269 punch from 0x7977784 to 0x7983927, (0xc1a3 bytes) 2024-09-21T22:15:44.733 INFO:teuthology.orchestra.run.smithi134.stdout:270 punch from 0x49bcdc4 to 0x49bf6f0, (0x292c bytes) 2024-09-21T22:15:44.733 INFO:teuthology.orchestra.run.smithi134.stdout:271 write 0xd1c8758 thru 0xd1ce3d0 (0x5c79 bytes) 2024-09-21T22:15:44.735 INFO:teuthology.orchestra.run.smithi134.stdout:272 read 0x31b9607 thru 0x31bb103 (0x1afd bytes) 2024-09-21T22:15:44.735 INFO:teuthology.orchestra.run.smithi134.stdout:273 read 0xb664cb1 thru 0xb66f1d3 (0xa523 bytes) 2024-09-21T22:15:44.735 INFO:teuthology.orchestra.run.smithi134.stdout:274 write 0x66bb920 thru 0x66c4d28 (0x9409 bytes) 2024-09-21T22:15:44.739 INFO:teuthology.orchestra.run.smithi134.stdout:276 read 0x5242a4e thru 0x5250d64 (0xe317 bytes) 2024-09-21T22:15:44.739 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:44.739 INFO:teuthology.orchestra.run.smithi134.stdout:280 writesame 0x3228e5f thru 0x322e9c7 data_size 0x1(0x5b69 bytes) 2024-09-21T22:15:44.768 INFO:teuthology.orchestra.run.smithi134.stdout:281 trunc from 0xd275148 to 0x1802b3d 2024-09-21T22:15:44.778 INFO:teuthology.orchestra.run.smithi134.stdout:282 read 0x106c8c2 thru 0x106e10a (0x1849 bytes) 2024-09-21T22:15:44.783 INFO:teuthology.orchestra.run.smithi134.stdout:283 trunc from 0x1802b3d to 0x5c7fdf2 2024-09-21T22:15:44.788 INFO:teuthology.orchestra.run.smithi134.stdout:284 read 0x55195e4 thru 0x551af3d (0x195a bytes) 2024-09-21T22:15:44.797 INFO:teuthology.orchestra.run.smithi134.stdout:285 write 0x954460f thru 0x95505cd (0xbfbf bytes) 2024-09-21T22:15:44.802 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:44.800+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:44.803 INFO:teuthology.orchestra.run.smithi134.stdout:286 writesame 0x5a2f40e thru 0x5a3d07d data_size 0x8(0xdc70 bytes) 2024-09-21T22:15:44.808 INFO:teuthology.orchestra.run.smithi134.stdout:287 write 0x6bb16f5 thru 0x6bbaa30 (0x933c bytes) 2024-09-21T22:15:44.813 INFO:teuthology.orchestra.run.smithi134.stdout:291 read 0x5f29c50 thru 0x5f2f929 (0x5cda bytes) 2024-09-21T22:15:44.824 INFO:teuthology.orchestra.run.smithi134.stdout:292 write 0xcfe6f51 thru 0xcff069e (0x974e bytes) 2024-09-21T22:15:44.828 INFO:teuthology.orchestra.run.smithi134.stdout:293 writesame 0x5fe6e88 thru 0x5ff6569 data_size 0x1(0xf6e2 bytes) 2024-09-21T22:15:44.844 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:44.844 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:44.846 INFO:teuthology.orchestra.run.smithi134.stdout:294 writesame 0x320c7f2 thru 0x321ac9d data_size 0xa(0xe4ac bytes) 2024-09-21T22:15:44.854 INFO:teuthology.orchestra.run.smithi134.stdout:296 punch from 0x8b324eb to 0x8b3d217, (0xad2c bytes) 2024-09-21T22:15:44.854 INFO:teuthology.orchestra.run.smithi134.stdout:297 read 0x14846f9 thru 0x148e648 (0x9f50 bytes) 2024-09-21T22:15:44.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:44.855 INFO:teuthology.orchestra.run.smithi134.stdout:298 read 0x5696a83 thru 0x569a5c8 (0x3b46 bytes) 2024-09-21T22:15:44.855 INFO:teuthology.orchestra.run.smithi134.stdout:299 write 0x7c931ca thru 0x7c95a13 (0x284a bytes) 2024-09-21T22:15:44.859 INFO:teuthology.orchestra.run.smithi134.stdout:300 write 0x6e597c thru 0x6f509e (0xf723 bytes) 2024-09-21T22:15:44.861 INFO:teuthology.orchestra.run.smithi134.stdout:301 write 0x50d7e11 thru 0x50e7b03 (0xfcf3 bytes) 2024-09-21T22:15:44.869 INFO:teuthology.orchestra.run.smithi134.stdout:302 trunc from 0xcff069f to 0x8ad3d04 2024-09-21T22:15:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:304 punch from 0x2b8a772 to 0x2b97c13, (0xd4a1 bytes) 2024-09-21T22:15:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:305 read 0x2f681bd thru 0x2f74d9a (0xcbde bytes) 2024-09-21T22:15:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:306 punch from 0x3be7ca5 to 0x3be8477, (0x7d2 bytes) 2024-09-21T22:15:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:307 write 0x83cbefd thru 0x83d3a6e (0x7b72 bytes) 2024-09-21T22:15:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:308 read 0x4b2c71c thru 0x4b3bf2a (0xf80f bytes) 2024-09-21T22:15:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:309 read 0x2f78fbb thru 0x2f87bb9 (0xebff bytes) 2024-09-21T22:15:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:310 trunc from 0x8ad3d04 to 0x48ae81e 2024-09-21T22:15:44.903 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:44.902+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:311 read 0x1dfd0d0 thru 0x1e008a8 (0x37d9 bytes) 2024-09-21T22:15:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:312 write 0x76ff5de thru 0x7705548 (0x5f6b bytes) 2024-09-21T22:15:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:313 punch from 0x42c62e8 to 0x42c82ae, (0x1fc6 bytes) 2024-09-21T22:15:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:315 trunc from 0x7705549 to 0xb71fb40 2024-09-21T22:15:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:317 read 0x1fe9aa7 thru 0x1ff7a94 (0xdfee bytes) 2024-09-21T22:15:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:320 write 0xaafd4ec thru 0xab0a99a (0xd4af bytes) 2024-09-21T22:15:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:325 writesame 0xde27578 thru 0xde280c2 data_size 0x7(0xb4b bytes) 2024-09-21T22:15:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:326 write 0xa407d1d thru 0xa408d03 (0xfe7 bytes) 2024-09-21T22:15:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:327 writesame 0x83f41cc thru 0x83fe7e2 data_size 0x1(0xa617 bytes) 2024-09-21T22:15:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:329 write 0x9643a81 thru 0x964bf76 (0x84f6 bytes) 2024-09-21T22:15:44.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:330 read 0x3c039ec thru 0x3c0bd6c (0x8381 bytes) 2024-09-21T22:15:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:331 read 0x693b6e1 thru 0x6949ed0 (0xe7f0 bytes) 2024-09-21T22:15:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:333 read 0xc47a250 thru 0xc47e82f (0x45e0 bytes) 2024-09-21T22:15:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:334 write 0x47ed26b thru 0x47f3b4b (0x68e1 bytes) 2024-09-21T22:15:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:336 read 0x80ed31b thru 0x80f7b49 (0xa82f bytes) 2024-09-21T22:15:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:337 writesame 0x4231d34 thru 0x4232707 data_size 0x11(0x9d4 bytes) 2024-09-21T22:15:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:338 read 0xa63748a thru 0xa63ef56 (0x7acd bytes) 2024-09-21T22:15:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:340 read 0x2db8a8c thru 0x2dc55d6 (0xcb4b bytes) 2024-09-21T22:15:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:341 writesame 0xd75a2bc thru 0xd761d73 data_size 0x2a(0x7ab8 bytes) 2024-09-21T22:15:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:344 read 0x77c1701 thru 0x77ce595 (0xce95 bytes) 2024-09-21T22:15:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:345 trunc from 0xde280c3 to 0xd1792ab 2024-09-21T22:15:45.004 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:45.003+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:347 trunc from 0xd1792ab to 0x131d8b3 2024-09-21T22:15:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:348 write 0xb3597c1 thru 0xb36337b (0x9bbb bytes) 2024-09-21T22:15:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:350 clone 2 order 21 su 262144 sc 4 2024-09-21T22:15:45.096 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:45.097 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:45.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:45.106 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:45.103+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:45.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:45.205+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:45.247 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:45.248 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:45.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:45.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:45.305+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:45.361 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:45.362 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:45.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:45.414 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:45.413+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:45.474 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:45.475 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:45.485 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:45.526 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:45.524+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:45.559 INFO:teuthology.orchestra.run.smithi134.stdout: marking collection for removal 2024-09-21T22:15:45.559 INFO:teuthology.orchestra.run.smithi134.stdout:setting '_remove' omap key 2024-09-21T22:15:45.560 INFO:teuthology.orchestra.run.smithi134.stdout:finish_remove_pgs 3.c_head removing 3.c 2024-09-21T22:15:45.563 INFO:teuthology.orchestra.run.smithi134.stdout:Remove successful 2024-09-21T22:15:45.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:45.607+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:45.628 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:45.628 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:45.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:15:45.709 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:45.707+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:45.741 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:45.741 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:45.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:15:45.834 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:45.832+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:45.893 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:45.893 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:45.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:15:45.943 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:45.941+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:45.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:15:46.011 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:46.010+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:46.046 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:46.046 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:46.054 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:46.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.c.3 2024-09-21T22:15:46.124 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:46.124 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:46.139 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:46.137+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:46.144 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:46.144 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:46.160 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:46.177 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:46.177 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:46.193 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:46.193 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:46.199 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:46.200 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:46.209 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:46.209 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:46.212 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:46.211+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:46.225 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:46.226 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:46.228 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:46.229 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:46.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:46.312+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:46.353 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:46.353 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:46.353 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:46.353 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:46.353 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:46.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:46.414 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:46.412+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:46.467 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:46.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:46.467 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:419 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.5315445910000003, 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040014170000000002, 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 419 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933668+0000", 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.378e-06 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933675+0000", 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.109e-06 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933688+0000", 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3291e-05 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933695+0000", 2024-09-21T22:15:46.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3520000000000001e-06 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933760+0000", 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4488999999999999e-05 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933846+0000", 2024-09-21T22:15:46.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6199999999999995e-05 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933963+0000", 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000116937 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934556+0000", 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059266699999999996 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937613+0000", 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030571660000000001 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937641+0000", 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8381000000000002e-05 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937668+0000", 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6446999999999999e-05 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:454 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 940076~27508] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.983680+0000", 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.4815309469999995, 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001540923, 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 454 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983680+0000", 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983680+0000", 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983682+0000", 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7630000000000001e-06 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983732+0000", 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0336000000000001e-05 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983747+0000", 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4788e-05 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983756+0000", 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0720000000000006e-06 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983815+0000", 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8817000000000003e-05 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.983896+0000", 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0993000000000002e-05 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.984040+0000", 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000144597 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.984887+0000", 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00084723199999999995 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985157+0000", 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026972699999999999 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985191+0000", 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4168999999999998e-05 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.985221+0000", 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9428999999999999e-05 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:477 3.10 3:0eac1b92:::rbd_data.11856a5cf33b.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2695562~54346] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.4440512989999998, 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018129450000000001, 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.479 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 477 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021160+0000", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8899999999999998e-07 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021248+0000", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7750000000000005e-05 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021256+0000", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6790000000000005e-06 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021261+0000", 2024-09-21T22:15:46.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5060000000000003e-06 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021305+0000", 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4041000000000001e-05 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021479+0000", 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00017363799999999999 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:46.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.021626+0000", 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014658600000000001 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022425+0000", 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00079913499999999997 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022916+0000", 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00049179099999999999 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022947+0000", 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0645999999999998e-05 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.022972+0000", 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5384e-05 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:490 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.046680+0000", 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.4185313229999998, 2024-09-21T22:15:46.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001765015, 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 490 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046680+0000", 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046680+0000", 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046682+0000", 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.339e-06 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046693+0000", 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.116e-05 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046716+0000", 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.268e-05 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046728+0000", 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2149e-05 2024-09-21T22:15:46.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046805+0000", 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6958000000000004e-05 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046906+0000", 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101377 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:46.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047020+0000", 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000113565 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047809+0000", 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00078948500000000003 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048386+0000", 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00057631999999999996 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048418+0000", 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2419000000000003e-05 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048445+0000", 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6563e-05 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.490 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:493 3.10 3:0eac1b92:::rbd_data.11856a5cf33b.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.4184522429999999, 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024082309999999998, 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 493 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046759+0000", 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4700000000000001e-07 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046762+0000", 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3270000000000001e-06 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046770+0000", 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8040000000000002e-06 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.046778+0000", 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047340+0000", 2024-09-21T22:15:46.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00056201600000000003 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047425+0000", 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4271999999999995e-05 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.047540+0000", 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011576799999999999 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.048628+0000", 2024-09-21T22:15:46.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010874389999999999 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049111+0000", 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00048346700000000001 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049143+0000", 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1649000000000001e-05 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:42.049167+0000", 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3903000000000001e-05 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1020 3.1e 3:7af2d16a:::rbd_data.1185ff358907.0000000000000007:head [write 0~725994 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9570270650000001, 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067157170000000004, 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1020 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508185+0000", 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4920000000000001e-06 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509567+0000", 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0013821510000000001 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509585+0000", 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7813e-05 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509595+0000", 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9499999999999996e-06 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509669+0000", 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4260999999999999e-05 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509678+0000", 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6139999999999992e-06 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.512690+0000", 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030124510000000002 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.512850+0000", 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000159271 2024-09-21T22:15:46.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514765+0000", 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001915588 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514820+0000", 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4586000000000002e-05 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514899+0000", 2024-09-21T22:15:46.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9540000000000001e-05 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1305 3.1e 3:7e413434:::rbd_data.1185ff358907.0000000000000059:head [write 0~370764 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.538718+0000", 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9264924329999999, 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026977920000000001, 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.502 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1305 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.538718+0000", 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.538718+0000", 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.538720+0000", 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0540000000000002e-06 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539809+0000", 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001088861 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539833+0000", 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.391e-05 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539844+0000", 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1205e-05 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539927+0000", 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2434000000000004e-05 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540090+0000", 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016264599999999999 2024-09-21T22:15:46.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.541268+0000", 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011783379999999999 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.541328+0000", 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9731000000000001e-05 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.541416+0000", 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8613e-05 2024-09-21T22:15:46.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1523 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 524288~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558554+0000", 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9066565259999999, 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015728960000000001, 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.507 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1523 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558554+0000", 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558554+0000", 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558555+0000", 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558556+0000", 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-06 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558559+0000", 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2150000000000001e-06 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558564+0000", 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8389999999999997e-06 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.559966+0000", 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014027639999999999 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560006+0000", 2024-09-21T22:15:46.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9520000000000001e-05 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560127+0000", 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000121193 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1524 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 589824~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558567+0000", 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9066433869999999, 2024-09-21T22:15:46.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001796754, 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1524 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558567+0000", 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558567+0000", 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558568+0000", 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.28e-07 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558569+0000", 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1319999999999999e-06 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558573+0000", 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7689999999999998e-06 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558576+0000", 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3639999999999999e-06 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560158+0000", 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001581903 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560232+0000", 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4420999999999998e-05 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560364+0000", 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013193699999999999 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.515 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1525 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 32768~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558740+0000", 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9064712999999998, 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018149539999999999, 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.516 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1525 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558740+0000", 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558740+0000", 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558740+0000", 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3600000000000003e-07 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558748+0000", 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3119999999999994e-06 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558756+0000", 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4290000000000004e-06 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558760+0000", 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560401+0000", 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001641188 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560445+0000", 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3157e-05 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560554+0000", 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000109937 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1526 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 98304~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558770+0000", 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9064404430000002, 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020457639999999998, 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.520 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1526 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558770+0000", 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558770+0000", 2024-09-21T22:15:46.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558771+0000", 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558772+0000", 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.666e-06 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558776+0000", 2024-09-21T22:15:46.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.766e-06 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558779+0000", 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9529999999999999e-06 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560598+0000", 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018186739999999999 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560682+0000", 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3726000000000004e-05 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560816+0000", 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013454999999999999 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1527 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 163840~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558788+0000", 2024-09-21T22:15:46.524 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9064223939999998, 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002305011, 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1527 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558788+0000", 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558788+0000", 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558789+0000", 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.65e-07 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558790+0000", 2024-09-21T22:15:46.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5540000000000001e-06 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558794+0000", 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7730000000000001e-06 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558797+0000", 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1489999999999998e-06 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560858+0000", 2024-09-21T22:15:46.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020609109999999999 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.560949+0000", 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0476999999999994e-05 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561093+0000", 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014488200000000001 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1528 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 229376~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558801+0000", 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9064095050000001, 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024574760000000001, 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1528 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.529 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558801+0000", 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558801+0000", 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558802+0000", 2024-09-21T22:15:46.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558803+0000", 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1400000000000001e-06 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558806+0000", 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6650000000000001e-06 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558809+0000", 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6879999999999999e-06 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561137+0000", 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023280979999999998 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561178+0000", 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0593999999999998e-05 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561259+0000", 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0939999999999994e-05 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1529 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 294912~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558813+0000", 2024-09-21T22:15:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.906398255, 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026798550000000001, 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1529 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558813+0000", 2024-09-21T22:15:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558813+0000", 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558813+0000", 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.36e-07 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558820+0000", 2024-09-21T22:15:46.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7270000000000001e-06 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558823+0000", 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8399999999999997e-06 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558828+0000", 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2509999999999996e-06 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561287+0000", 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002459672 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561358+0000", 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0401000000000006e-05 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561492+0000", 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134728 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1530 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 360448~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558833+0000", 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.906377982, 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002837876, 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1530 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.538 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558833+0000", 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558833+0000", 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558833+0000", 2024-09-21T22:15:46.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.48e-07 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558834+0000", 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1519999999999999e-06 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558838+0000", 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3110000000000001e-06 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558841+0000", 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.258e-06 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561528+0000", 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026872879999999999 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561587+0000", 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561671+0000", 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.352e-05 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1531 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 425984~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558844+0000", 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9063666430000001, 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003067761, 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.542 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1531 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558844+0000", 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558844+0000", 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558844+0000", 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558846+0000", 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.204e-06 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558849+0000", 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.117e-06 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558851+0000", 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6180000000000002e-06 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561702+0000", 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0028504670000000002 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561783+0000", 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1231999999999997e-05 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561912+0000", 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012890300000000001 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1532 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 491520~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558855+0000", 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9063561519999999, 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033005690000000002, 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1532 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558855+0000", 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558855+0000", 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558855+0000", 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558856+0000", 2024-09-21T22:15:46.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2929999999999999e-06 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558859+0000", 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2629999999999999e-06 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558862+0000", 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.537e-06 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.561940+0000", 2024-09-21T22:15:46.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030782750000000001 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562021+0000", 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1081999999999994e-05 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562155+0000", 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013389200000000001 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.550 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1533 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 557056~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9063455729999998, 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035474220000000002, 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1533 2024-09-21T22:15:46.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:46.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558867+0000", 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2669999999999999e-06 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558870+0000", 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2310000000000001e-06 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558873+0000", 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6479999999999999e-06 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562187+0000", 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003314862 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562265+0000", 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7714999999999997e-05 2024-09-21T22:15:46.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562413+0000", 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014747800000000001 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1534 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 622592~20078 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.9063349270000001, 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040238330000000001, 2024-09-21T22:15:46.555 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1534 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.22e-07 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558877+0000", 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0049999999999999e-06 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558880+0000", 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2179999999999999e-06 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558884+0000", 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.19e-06 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562450+0000", 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035664540000000002 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562575+0000", 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000125458 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562900+0000", 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032428600000000002 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1535 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.559 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 2.906324116, 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042382110000000004, 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1535 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558888+0000", 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.122e-06 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558891+0000", 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2650000000000001e-06 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558894+0000", 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.278e-06 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562932+0000", 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040381100000000001 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563001+0000", 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9669e-05 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563125+0000", 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012355299999999999 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.564 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:46.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:15:46.565 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:46.564+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:46.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:46.665 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:46.664+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:46.711 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:46.711 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:46.720 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:46.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:46.766+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:46.823 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:46.823 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:46.823 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:46.823 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:46.823 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:46.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:46.876 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:46.874+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:46.938 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:46.938 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:46.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:46.938 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:46.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.938 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:836 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3801088~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.938 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4533626220000002, 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013595324000000001, 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 836 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482744+0000", 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1599999999999999e-06 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482747+0000", 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1089999999999998e-06 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482749+0000", 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3e-06 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496166+0000", 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013416855 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496240+0000", 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3579999999999997e-05 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496338+0000", 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8098999999999997e-05 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.942 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:837 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3866624~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4533529199999999, 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013717548, 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 837 2024-09-21T22:15:46.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482753+0000", 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1399999999999995e-07 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482757+0000", 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8020000000000002e-06 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482759+0000", 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2589999999999999e-06 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496374+0000", 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013614446000000001 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496412+0000", 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8325999999999999e-05 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496470+0000", 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7593999999999998e-05 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:838 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3932160~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.453342991, 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013928474, 2024-09-21T22:15:46.947 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 838 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482763+0000", 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0800000000000001e-07 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482763+0000", 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4600000000000003e-07 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482767+0000", 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0900000000000001e-06 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482769+0000", 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.283e-06 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496503+0000", 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013734 2024-09-21T22:15:46.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496581+0000", 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8578999999999994e-05 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496691+0000", 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000109268 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:839 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3997696~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4533328609999998, 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014045281999999999, 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 839 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.952 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482773+0000", 2024-09-21T22:15:46.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482777+0000", 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7639999999999996e-06 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482781+0000", 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3759999999999999e-06 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482783+0000", 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.357e-06 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496727+0000", 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013944061000000001 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496768+0000", 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1318e-05 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496818+0000", 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9202000000000001e-05 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:840 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 4063232~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4533188990000001, 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014530977, 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.956 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 840 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482787+0000", 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482788+0000", 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0669999999999999e-06 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482791+0000", 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.004e-06 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482793+0000", 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.847e-06 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496863+0000", 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014069504 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496940+0000", 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6724000000000006e-05 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497317+0000", 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037761199999999999 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.960 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:841 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 4128768~567 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4533088329999999, 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014781610000000001, 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 841 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482797+0000", 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.05e-07 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482798+0000", 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9699999999999994e-07 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482801+0000", 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0690000000000002e-06 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482803+0000", 2024-09-21T22:15:46.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497346+0000", 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014543512 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497388+0000", 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1618e-05 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497578+0000", 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018990000000000001 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1014 3.15 3:ad0e59cf:::rbd_data.11856a5cf33b.0000000000000002:3 [read 3506176~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507575+0000", 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4285298590000002, 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013522785000000001, 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.965 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1014 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507575+0000", 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507575+0000", 2024-09-21T22:15:46.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507576+0000", 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507578+0000", 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8050000000000001e-06 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507583+0000", 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8440000000000003e-06 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507588+0000", 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4139999999999996e-06 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.520883+0000", 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013294742999999999 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.520960+0000", 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7502000000000004e-05 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521098+0000", 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013810100000000001 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1015 3.15 3:ad0e59cf:::rbd_data.11856a5cf33b.0000000000000002:3 [read 3571712~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:46.969 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4285113030000001, 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013982695999999999, 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1015 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507596+0000", 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.996e-06 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507609+0000", 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2276000000000001e-05 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507614+0000", 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521139+0000", 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01352561 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521192+0000", 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2317000000000001e-05 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521577+0000", 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038497599999999998 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1016 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4284834399999999, 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014357010999999999, 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1016 2024-09-21T22:15:46.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507624+0000", 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507632+0000", 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8269999999999998e-06 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507635+0000", 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521625+0000", 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013989661 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521759+0000", 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013431900000000001 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521979+0000", 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000219803 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1018 3.15 3:ae013215:::rbd_data.1185ff358907.0000000000000002:head [write 0~1016375 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4280583509999998, 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019909570000000001, 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1018 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0399999999999996e-07 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509915+0000", 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018678049999999999 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509926+0000", 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0729e-05 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509937+0000", 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1447999999999999e-05 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522027+0000", 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012089379000000001 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522161+0000", 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134525 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527828+0000", 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056671430000000004 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527880+0000", 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1329000000000003e-05 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527956+0000", 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6607999999999996e-05 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1019 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4261526450000002, 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014915193, 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1019 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1099999999999995e-07 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509955+0000", 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509959+0000", 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509964+0000", 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5129999999999998e-06 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524643+0000", 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014679073000000001 2024-09-21T22:15:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524742+0000", 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8604999999999995e-05 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524868+0000", 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012606299999999999 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1021 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4261365069999998, 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015100463, 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1021 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509971+0000", 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.886e-06 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509974+0000", 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3720000000000001e-06 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509977+0000", 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7520000000000001e-06 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524899+0000", 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014921751 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524964+0000", 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5703000000000004e-05 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525069+0000", 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104726 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1023 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4256881959999999, 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014865608000000001, 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1023 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510418+0000", 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4199999999999995e-07 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510422+0000", 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4220000000000002e-06 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510431+0000", 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4619999999999996e-06 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510436+0000", 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3070000000000002e-06 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525098+0000", 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014661990999999999 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525171+0000", 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2889e-05 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525283+0000", 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111795 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1133 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1212416~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.410350674, 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013461615999999999, 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1133 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525755+0000", 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:15:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525758+0000", 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2160000000000002e-06 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525767+0000", 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7090000000000008e-06 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525772+0000", 2024-09-21T22:15:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.538937+0000", 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013165081 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539048+0000", 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110467 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539216+0000", 2024-09-21T22:15:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016844900000000001 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1134 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1277952~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4103154459999998, 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013821072, 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1134 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525793+0000", 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3269999999999999e-06 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525800+0000", 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1640000000000004e-06 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525805+0000", 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0540000000000002e-06 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539256+0000", 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013451174 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539419+0000", 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016245800000000001 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539611+0000", 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00019230500000000001 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1135 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1343488~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4102922009999999, 2024-09-21T22:15:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014032734, 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1135 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525814+0000", 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9299999999999997e-07 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525816+0000", 2024-09-21T22:15:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7410000000000001e-06 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525828+0000", 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1389999999999999e-05 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525835+0000", 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5680000000000002e-06 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539642+0000", 2024-09-21T22:15:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013806992000000001 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539717+0000", 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4788000000000003e-05 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539846+0000", 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012856200000000001 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1136 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1409024~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4102627399999998, 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014210109, 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1136 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525843+0000", 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:15:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525845+0000", 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3760000000000002e-06 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525852+0000", 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.613e-06 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525857+0000", 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7779999999999998e-06 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539873+0000", 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014016673 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539942+0000", 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8436999999999995e-05 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540053+0000", 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110808 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1137 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1474560~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.410242556, 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014416333, 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1137 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525866+0000", 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2310000000000001e-06 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525873+0000", 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6030000000000001e-06 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525877+0000", 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000002e-06 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540084+0000", 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014206185 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540160+0000", 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6132999999999998e-05 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540279+0000", 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011923 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1138 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1540096~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4102215170000001, 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015066355999999999, 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1138 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525890+0000", 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525897+0000", 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8519999999999998e-06 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525902+0000", 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4909999999999999e-06 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540309+0000", 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014407392999999999 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540386+0000", 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6775999999999998e-05 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540950+0000", 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00056422700000000004 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1139 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.4101966400000001, 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017975142999999999, 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1139 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:15:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525911+0000", 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525917+0000", 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8599999999999998e-06 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525921+0000", 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:15:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540743+0000", 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014821166 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540833+0000", 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0853000000000006e-05 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543884+0000", 2024-09-21T22:15:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030503219999999998 2024-09-21T22:15:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:47.027 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:47.028 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:47.026+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:47.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:47.129 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:47.127+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:47.132 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:47.132 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:47.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:47.231 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:47.230+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:47.251 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:47.251 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:47.252 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:47.252 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:47.252 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:47.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:47.332 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:47.331+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:47.365 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:956 3.6 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8681423480000001, 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010751263, 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 956 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494873+0000", 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0049999999999999e-06 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495626+0000", 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075252999999999995 2024-09-21T22:15:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495638+0000", 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1952e-05 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495650+0000", 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1739000000000001e-05 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495713+0000", 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999995e-05 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495836+0000", 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012285799999999999 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495924+0000", 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7663000000000004e-05 2024-09-21T22:15:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501700+0000", 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057759159999999999 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505497+0000", 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003797417 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505574+0000", 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6917999999999998e-05 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505623+0000", 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8705000000000002e-05 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2294 3.1b 3:de16f4f6:::rbd_data.1185ff358907.0000000000000004:5 [sparse-read 786432~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499699+0000", 2024-09-21T22:15:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.863315159, 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095119539999999995, 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2294 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499699+0000", 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499699+0000", 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499699+0000", 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.23e-07 2024-09-21T22:15:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499700+0000", 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1599999999999999e-06 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499703+0000", 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8779999999999998e-06 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499707+0000", 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8340000000000001e-06 2024-09-21T22:15:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508661+0000", 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089544370000000009 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508737+0000", 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5369000000000003e-05 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509211+0000", 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000474053 2024-09-21T22:15:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2302 3.b 3:d590e8c0:::rbd_data.1185ff358907.0000000000000009:5 [sparse-read 786432~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499820+0000", 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86319425800000005, 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010104254, 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2302 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499820+0000", 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499820+0000", 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499820+0000", 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.46e-07 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499822+0000", 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2350000000000002e-06 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499828+0000", 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:15:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499833+0000", 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0220000000000004e-06 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509223+0000", 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093901499999999999 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509299+0000", 2024-09-21T22:15:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5536000000000003e-05 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509924+0000", 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062473599999999998 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2304 3.1b 3:dc8a8db5:::rbd_data.1185ff358907.000000000000000b:5 [sparse-read 262144~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499840+0000", 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86317376899999998, 2024-09-21T22:15:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010083105, 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2304 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499840+0000", 2024-09-21T22:15:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499840+0000", 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499840+0000", 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499842+0000", 2024-09-21T22:15:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499848+0000", 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.429e-06 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499854+0000", 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8209999999999998e-06 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509240+0000", 2024-09-21T22:15:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093865159999999993 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509325+0000", 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4497000000000001e-05 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509923+0000", 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059849299999999996 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2307 3.b 3:d590e8c0:::rbd_data.1185ff358907.0000000000000009:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499998+0000", 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86301594299999995, 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010544665, 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2307 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499998+0000", 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499998+0000", 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499998+0000", 2024-09-21T22:15:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3099999999999997e-07 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500003+0000", 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5310000000000003e-06 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500011+0000", 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8690000000000004e-06 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500017+0000", 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9660000000000001e-06 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509957+0000", 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099406530000000007 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510037+0000", 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9930000000000002e-05 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510542+0000", 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050508499999999995 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2308 3.b 3:d590e8c0:::rbd_data.1185ff358907.0000000000000009:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86298651599999998, 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011159749, 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2308 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500028+0000", 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500030+0000", 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500036+0000", 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8819999999999998e-06 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500042+0000", 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.993e-06 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510584+0000", 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010542674 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510667+0000", 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3008000000000002e-05 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511187+0000", 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051960799999999996 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2310 3.1b 3:dc8a8db5:::rbd_data.1185ff358907.000000000000000b:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86296434499999997, 2024-09-21T22:15:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011142944, 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2310 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500050+0000", 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500052+0000", 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1959999999999998e-06 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500058+0000", 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.212e-06 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500063+0000", 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.882e-06 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510572+0000", 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010508639 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510659+0000", 2024-09-21T22:15:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7677999999999996e-05 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511192+0000", 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053292499999999996 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2319 3.1b 3:de16f4f6:::rbd_data.1185ff358907.0000000000000004:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.862628002, 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011297852000000001, 2024-09-21T22:15:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2319 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0399999999999996e-07 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500389+0000", 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:15:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500396+0000", 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4479999999999997e-06 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500401+0000", 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511205+0000", 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010804258000000001 2024-09-21T22:15:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511257+0000", 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1751e-05 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511684+0000", 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042683100000000002 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2320 3.1b 3:de16f4f6:::rbd_data.1185ff358907.0000000000000004:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86260627400000001, 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011845501, 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2320 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500408+0000", 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4400000000000001e-07 2024-09-21T22:15:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500410+0000", 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1390000000000002e-06 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500416+0000", 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7769999999999999e-06 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500420+0000", 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2849999999999996e-06 2024-09-21T22:15:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511718+0000", 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011298450999999999 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511801+0000", 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2105000000000001e-05 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512253+0000", 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045239999999999999 2024-09-21T22:15:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2325 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86247458399999999, 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014066749999999999, 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2325 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500540+0000", 2024-09-21T22:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9100000000000003e-07 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500544+0000", 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500555+0000", 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1318000000000001e-05 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500565+0000", 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0079e-05 2024-09-21T22:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512283+0000", 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011717049 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512360+0000", 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7093000000000002e-05 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512607+0000", 2024-09-21T22:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024718400000000001 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514440+0000", 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018330460000000001 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514515+0000", 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4818000000000001e-05 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514563+0000", 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7862999999999999e-05 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514606+0000", 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3389000000000001e-05 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2326 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85904579999999997, 2024-09-21T22:15:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010731123, 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2326 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503970+0000", 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8560000000000001e-06 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503979+0000", 2024-09-21T22:15:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2469999999999997e-06 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503991+0000", 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2201999999999999e-05 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504002+0000", 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0530000000000001e-05 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512946+0000", 2024-09-21T22:15:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089438360000000001 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513034+0000", 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8038e-05 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513347+0000", 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031344499999999998 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514500+0000", 2024-09-21T22:15:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011528230000000001 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514615+0000", 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011526700000000001 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514661+0000", 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5726999999999998e-05 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514699+0000", 2024-09-21T22:15:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8152000000000003e-05 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2327 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85858448399999998, 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014161098, 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2327 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504430+0000", 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.172e-06 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504444+0000", 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3957999999999999e-05 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504457+0000", 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2693e-05 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504465+0000", 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513649+0000", 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091831199999999995 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513731+0000", 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2293000000000006e-05 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514070+0000", 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033902599999999998 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516042+0000", 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019719730000000001 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518484+0000", 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002441927 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518545+0000", 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0816999999999997e-05 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518590+0000", 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5738999999999997e-05 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2328 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:15:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85675942199999999, 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014248399, 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2328 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:15:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506255+0000", 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4200000000000004e-07 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506259+0000", 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9160000000000003e-06 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506268+0000", 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0140000000000004e-06 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506273+0000", 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514744+0000", 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084708739999999998 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514802+0000", 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8187999999999999e-05 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514989+0000", 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018687399999999999 2024-09-21T22:15:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517620+0000", 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002631272 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520440+0000", 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028199660000000001 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520474+0000", 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.349e-05 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520503+0000", 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8824e-05 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2329 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85489938300000001, 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012486248, 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2329 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508115+0000", 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1399999999999996e-07 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508119+0000", 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0589999999999996e-06 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508129+0000", 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4169999999999998e-06 2024-09-21T22:15:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508134+0000", 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9819999999999999e-06 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515275+0000", 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071415619999999997 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515357+0000", 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2099000000000001e-05 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515706+0000", 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034926400000000001 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518603+0000", 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028969930000000001 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520544+0000", 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019409290000000001 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520575+0000", 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1044999999999998e-05 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520601+0000", 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5184000000000001e-05 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2340 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:15:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85344395699999998, 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013061006999999999, 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2340 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509571+0000", 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7599999999999996e-07 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509575+0000", 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0670000000000002e-06 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509584+0000", 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6290000000000005e-06 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509589+0000", 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516089+0000", 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064993739999999996 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516161+0000", 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1958999999999993e-05 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516524+0000", 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036302699999999998 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518609+0000", 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020855330000000001 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522528+0000", 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039189799999999999 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522589+0000", 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0411999999999997e-05 2024-09-21T22:15:47.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522631+0000", 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2249000000000002e-05 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2341 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85318201699999996, 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012992413, 2024-09-21T22:15:47.440 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2341 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5000000000000002e-07 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509836+0000", 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7680000000000002e-06 2024-09-21T22:15:47.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509844+0000", 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5680000000000002e-06 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509854+0000", 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0332999999999999e-05 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516927+0000", 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070725029999999999 2024-09-21T22:15:47.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517000+0000", 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3350999999999996e-05 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517317+0000", 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031706600000000002 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519821+0000", 2024-09-21T22:15:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025039649999999999 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522678+0000", 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002856716 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522755+0000", 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7756000000000006e-05 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522824+0000", 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8737000000000003e-05 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2342 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85284832899999996, 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012819782, 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2342 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510166+0000", 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510170+0000", 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.693e-06 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510178+0000", 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2490000000000001e-06 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510182+0000", 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2300000000000002e-06 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517673+0000", 2024-09-21T22:15:47.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074904000000000004 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517756+0000", 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2899999999999996e-05 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518080+0000", 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032417399999999999 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520516+0000", 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002435857 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522891+0000", 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023752539999999998 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522947+0000", 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6338999999999997e-05 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522985+0000", 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7985000000000003e-05 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2343 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85150513299999997, 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011604199000000001, 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2343 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.06e-07 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511514+0000", 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3630000000000004e-06 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511524+0000", 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511530+0000", 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1739999999999997e-06 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518635+0000", 2024-09-21T22:15:47.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071051120000000002 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518711+0000", 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5659000000000002e-05 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518903+0000", 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019194399999999999 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.521701+0000", 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027975489999999999 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523042+0000", 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013413500000000001 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523075+0000", 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2928000000000001e-05 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523113+0000", 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7898999999999997e-05 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2344 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.85050322, 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014323447, 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2344 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1200000000000002e-07 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512516+0000", 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4000000000000002e-06 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512527+0000", 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1015999999999999e-05 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512532+0000", 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0749999999999997e-06 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519269+0000", 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067374419999999997 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519320+0000", 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0447e-05 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519537+0000", 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000217584 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523121+0000", 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003583859 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526752+0000", 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036310639999999998 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526798+0000", 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6270000000000003e-05 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526834+0000", 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5577999999999997e-05 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2362 3.17 3:ed4fe5a8:::rbd_data.118555b0e245.0000000000000006:head [write 0~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.83929274399999998, 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011794905, 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2362 2024-09-21T22:15:47.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523723+0000", 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5090000000000001e-06 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524071+0000", 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034883499999999998 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524085+0000", 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3774000000000001e-05 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524096+0000", 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0713999999999999e-05 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524153+0000", 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7367000000000001e-05 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524237+0000", 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3567999999999997e-05 2024-09-21T22:15:47.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524321+0000", 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4309999999999997e-05 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526229+0000", 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019082669999999999 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535431+0000", 2024-09-21T22:15:47.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092015959999999994 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535470+0000", 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9320000000000003e-05 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535516+0000", 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5645000000000001e-05 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.470 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:47.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:47.471 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:47.470+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:47.483 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:15:47.510 INFO:teuthology.orchestra.run.smithi134.stdout:get_pg_num_history pg_num_history pg_num_history(e26 pg_nums {1={15=1},2={18=8},3={23=32}} deleted_pools ) 2024-09-21T22:15:47.511 INFO:teuthology.orchestra.run.smithi134.stdout:Importing pgid 3.c 2024-09-21T22:15:47.511 INFO:teuthology.orchestra.run.smithi134.stdout:write_pg epoch 26 info 3.c( empty local-lis/les=23/24 n=0 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-21T22:15:47.515 INFO:teuthology.orchestra.run.smithi134.stdout:Import successful 2024-09-21T22:15:47.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:47.571+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:47.586 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:47.586 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:47.596 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-21T22:15:47.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:47.672+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:47.738 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:47.738 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:47.738 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:47.738 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:47.738 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:47.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:47.789 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:47.788+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:47.875 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:47.874+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:47.882 INFO:teuthology.orchestra.run.smithi134.stdout:351 read 0x40cd30e thru 0x40d595c (0x864f bytes) 2024-09-21T22:15:47.882 INFO:teuthology.orchestra.run.smithi134.stdout:352 writesame 0x2666ecc thru 0x266ac3f data_size 0x4c(0x3d74 bytes) 2024-09-21T22:15:47.895 INFO:teuthology.orchestra.run.smithi134.stdout:354 write 0xbe587b0 thru 0xbe5ba62 (0x32b3 bytes) 2024-09-21T22:15:47.898 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.4527620020000001, 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043089249999999999, 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443484+0000", 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5140000000000002e-06 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443492+0000", 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4259999999999997e-06 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443501+0000", 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3980000000000005e-06 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443536+0000", 2024-09-21T22:15:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4604000000000003e-05 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443551+0000", 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5387999999999999e-05 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447726+0000", 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041748530000000001 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447789+0000", 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3540000000000005e-05 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:259 3.4 3:226e6cb4:::rbd_data.11856a5cf33b.000000000000003a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.764732+0000", 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1315104170000003, 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035988349999999999, 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 259 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764732+0000", 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764732+0000", 2024-09-21T22:15:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764733+0000", 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764737+0000", 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8299999999999998e-06 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764749+0000", 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2884999999999999e-05 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764756+0000", 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764805+0000", 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9775999999999999e-05 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764880+0000", 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4527e-05 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764992+0000", 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112179 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765669+0000", 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00067687300000000004 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768280+0000", 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026111620000000002 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768308+0000", 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8354e-05 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768331+0000", 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2514000000000002e-05 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:421 3.1a e28/23 3:58c299ba:::rbd_data.11856a5cf33b.0000000000000012:head v 28'6, mlcod=28'4)", 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.934038+0000", 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9622050660000001, 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032753000000000001, 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934038+0000", 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934038+0000", 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934038+0000", 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7599999999999996e-07 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934047+0000", 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4009999999999997e-06 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934056+0000", 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934061+0000", 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6569999999999996e-06 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934125+0000", 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4241999999999999e-05 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934142+0000", 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6351e-05 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.937285+0000", 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031429359999999998 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.937313+0000", 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8178999999999999e-05 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:423 3.6 e28/23 3:61566dec:::rbd_data.11856a5cf33b.0000000000000023:head v 28'4, mlcod=28'2)", 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.934071+0000", 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9621713600000001, 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032806379999999998, 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934071+0000", 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934071+0000", 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934072+0000", 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0800000000000004e-07 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934089+0000", 2024-09-21T22:15:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.749e-05 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934101+0000", 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1411e-05 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934121+0000", 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0539000000000001e-05 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934178+0000", 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7003999999999998e-05 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.934197+0000", 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9012999999999999e-05 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.937304+0000", 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031067500000000001 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.937352+0000", 2024-09-21T22:15:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7722999999999997e-05 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:611 3.8 3:1244a9cf:::rbd_object_map.1185ff358907:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:42.493075+0000", 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4031678660000004, 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022144869999999998, 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 611 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493075+0000", 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493075+0000", 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493076+0000", 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.595e-06 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493086+0000", 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7229999999999999e-06 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493101+0000", 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4747e-05 2024-09-21T22:15:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493108+0000", 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8719999999999996e-06 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493166+0000", 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8415000000000002e-05 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.493172+0000", 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6130000000000003e-06 2024-09-21T22:15:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.494548+0000", 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013761380000000001 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.494619+0000", 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1495999999999994e-05 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.495213+0000", 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059350699999999995 2024-09-21T22:15:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.495247+0000", 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4193999999999998e-05 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:42.495289+0000", 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2187000000000001e-05 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:956 3.6 e30/23 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head v 30'7, mlcod=28'5)", 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.4002108169999996, 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091893070000000007, 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497369+0000", 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001336804 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497387+0000", 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8014999999999999e-05 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497398+0000", 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1581e-05 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497480+0000", 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1874999999999998e-05 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497511+0000", 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1103999999999999e-05 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505165+0000", 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076536219999999997 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505221+0000", 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6026000000000002e-05 2024-09-21T22:15:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:960 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.398277266, 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084308620000000008, 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 960 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497968+0000", 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.429e-06 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498743+0000", 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077512399999999997 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498766+0000", 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2983999999999999e-05 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498790+0000", 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389e-05 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498881+0000", 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0780999999999997e-05 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498890+0000", 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7579999999999998e-06 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500819+0000", 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929491 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500968+0000", 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014854199999999999 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501114+0000", 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146298 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505622+0000", 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045081649999999997 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506247+0000", 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062455099999999999 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506353+0000", 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010586699999999999 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506396+0000", 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3482999999999997e-05 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:1617 3.8 3:1519a0ec:::rbd_data.1185ff358907.0000000000000063:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.3246842939999999, 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043537289999999998, 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 1617 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571561+0000", 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2350000000000002e-06 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571851+0000", 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029007799999999998 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571866+0000", 2024-09-21T22:15:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5241e-05 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571875+0000", 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4439999999999997e-06 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571949+0000", 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4082e-05 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.572140+0000", 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019105599999999999 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575746+0000", 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036054630000000002 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575815+0000", 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9402999999999999e-05 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575912+0000", 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6726999999999997e-05 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2277 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 131072~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499755+0000", 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.396487604, 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001606704, 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2277 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499755+0000", 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499755+0000", 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499756+0000", 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8800000000000001e-07 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499760+0000", 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4490000000000001e-06 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499781+0000", 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0876000000000001e-05 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499789+0000", 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4549999999999998e-06 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500759+0000", 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00097009799999999997 2024-09-21T22:15:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500847+0000", 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.865e-05 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.501362+0000", 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051428800000000001 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2278 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 655360~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499802+0000", 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.396440777, 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021458459999999999, 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2278 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499802+0000", 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499802+0000", 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499802+0000", 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499805+0000", 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6089999999999999e-06 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499812+0000", 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5120000000000002e-06 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499817+0000", 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.501405+0000", 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015877650000000001 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.501486+0000", 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1237999999999997e-05 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.501948+0000", 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046126400000000002 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2299 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 262144~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499825+0000", 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3964174460000001, 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028027210000000002, 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2299 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499825+0000", 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499825+0000", 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499825+0000", 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499828+0000", 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0310000000000001e-06 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499835+0000", 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7400000000000004e-06 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499846+0000", 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0316000000000001e-05 2024-09-21T22:15:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.501990+0000", 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.502055+0000", 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4639000000000002e-05 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.502628+0000", 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057283599999999996 2024-09-21T22:15:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2300 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 786432~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3963855469999999, 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035596450000000002, 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2300 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.53e-07 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499859+0000", 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499868+0000", 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.67e-06 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499881+0000", 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2542e-05 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.502658+0000", 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027775299999999998 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.502732+0000", 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3424999999999996e-05 2024-09-21T22:15:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503417+0000", 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068504700000000004 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2305 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3963253250000001, 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042464419999999996, 2024-09-21T22:15:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2305 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499918+0000", 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499921+0000", 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7879999999999998e-06 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499932+0000", 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1629e-05 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499940+0000", 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0590000000000003e-06 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503530+0000", 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035898150000000001 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503609+0000", 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9284999999999997e-05 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504164+0000", 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055435700000000001 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2306 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3962932079999999, 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004774197, 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2306 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499950+0000", 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0800000000000005e-07 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499952+0000", 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.261e-06 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499959+0000", 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499964+0000", 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504193+0000", 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004229684 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504269+0000", 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5956000000000003e-05 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504724+0000", 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045437400000000001 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2346 3.0 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.381240472, 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083135759999999996, 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2346 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515003+0000", 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-06 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515950+0000", 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094629499999999999 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515967+0000", 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7554000000000002e-05 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515974+0000", 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:15:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516038+0000", 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3176999999999995e-05 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516167+0000", 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012979800000000001 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516306+0000", 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138887 2024-09-21T22:15:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522280+0000", 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059732750000000001 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523229+0000", 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094895000000000005 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523280+0000", 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1554999999999997e-05 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523316+0000", 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5602999999999998e-05 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2361 3.8 3:116e4395:::rbd_data.118555b0e245.0000000000000002:head [write 0~1835008 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.522963+0000", 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3732797050000001, 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032618840000000001, 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2361 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522963+0000", 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522963+0000", 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522965+0000", 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.663e-06 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523567+0000", 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060276600000000002 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523577+0000", 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2199999999999998e-06 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523584+0000", 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6299999999999998e-06 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523628+0000", 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3784e-05 2024-09-21T22:15:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523735+0000", 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010713300000000001 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526128+0000", 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023925029999999998 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526171+0000", 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2962e-05 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526225+0000", 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4222999999999999e-05 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2364 3.0 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head [write 0~983607 [fadvise_sequential+fadvise_nocache],write 1048576~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.369114919, 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077052980000000002, 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2364 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527129+0000", 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527492+0000", 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036298100000000001 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527504+0000", 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1814000000000001e-05 2024-09-21T22:15:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527510+0000", 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4649999999999999e-06 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527564+0000", 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3893000000000001e-05 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527665+0000", 2024-09-21T22:15:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101468 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527817+0000", 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015177100000000001 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534445+0000", 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066276169999999997 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534752+0000", 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030757499999999998 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534799+0000", 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6310000000000002e-05 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534833+0000", 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341999999999997e-05 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2367 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.537295+0000", 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.358947584, 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028077390000000001, 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2367 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537295+0000", 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537295+0000", 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537296+0000", 2024-09-21T22:15:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537299+0000", 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5769999999999998e-06 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537307+0000", 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.52e-06 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537311+0000", 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3919999999999996e-06 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537348+0000", 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6307999999999999e-05 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537400+0000", 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2188999999999998e-05 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540103+0000", 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027030190000000001 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2370 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.540855+0000", 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.355387447, 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016049700000000001, 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2370 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540855+0000", 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540855+0000", 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540856+0000", 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7400000000000003e-07 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540859+0000", 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6619999999999998e-06 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540868+0000", 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2609999999999993e-06 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540872+0000", 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3970000000000004e-06 2024-09-21T22:15:47.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540906+0000", 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3964999999999998e-05 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.540955+0000", 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9323000000000002e-05 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:47.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.541051+0000", 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5814000000000001e-05 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.541444+0000", 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000393137 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.542406+0000", 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00096175199999999996 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.542437+0000", 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0583999999999997e-05 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.542460+0000", 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3400999999999998e-05 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2417 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.40617451199999999, 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043883469999999999, 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2417 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:47.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490070+0000", 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490081+0000", 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0893000000000001e-05 2024-09-21T22:15:47.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490099+0000", 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7648000000000001e-05 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490108+0000", 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0000000000000002e-06 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490162+0000", 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4846000000000003e-05 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490168+0000", 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7749999999999998e-06 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492060+0000", 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018918450000000001 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492159+0000", 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8827999999999996e-05 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492338+0000", 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017905500000000001 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.493985+0000", 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016466 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494382+0000", 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039761899999999999 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494424+0000", 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1544000000000001e-05 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494456+0000", 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2706000000000002e-05 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:47.996 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:47.997 INFO:teuthology.orchestra.run.smithi134.stdout:356 write 0x5f1d5d1 thru 0x5f1f320 (0x1d50 bytes) 2024-09-21T22:15:47.997 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:47.997 INFO:teuthology.orchestra.run.smithi134.stdout:358 writesame 0x36f9b1 thru 0x375378 data_size 0x68(0x59c8 bytes) 2024-09-21T22:15:47.997 INFO:teuthology.orchestra.run.smithi134.stdout:359 read 0xa9ddd94 thru 0xa9e5fa1 (0x820e bytes) 2024-09-21T22:15:47.997 INFO:teuthology.orchestra.run.smithi134.stdout:360 write 0x94f2447 thru 0x94f441d (0x1fd7 bytes) 2024-09-21T22:15:47.998 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:47.999 INFO:teuthology.orchestra.run.smithi134.stdout:361 trunc from 0xbe5ba63 to 0x319d84b 2024-09-21T22:15:47.999 INFO:teuthology.orchestra.run.smithi134.stdout:362 write 0xedbd2c0 thru 0xedc7824 (0xa565 bytes) 2024-09-21T22:15:47.999 INFO:teuthology.orchestra.run.smithi134.stdout:363 trunc from 0xedc7825 to 0xb3081a7 2024-09-21T22:15:48.000 INFO:teuthology.orchestra.run.smithi134.stdout:364 write 0xb879344 thru 0xb880619 (0x72d6 bytes) 2024-09-21T22:15:48.000 INFO:teuthology.orchestra.run.smithi134.stdout:365 trunc from 0xb88061a to 0x8cdd3c7 2024-09-21T22:15:48.000 INFO:teuthology.orchestra.run.smithi134.stdout:366 read 0x2ee261e thru 0x2ee681c (0x41ff bytes) 2024-09-21T22:15:48.000 INFO:teuthology.orchestra.run.smithi134.stdout:367 write 0x1a4f33a thru 0x1a5e636 (0xf2fd bytes) 2024-09-21T22:15:48.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:48.000+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:48.015 INFO:teuthology.orchestra.run.smithi134.stdout:368 writesame 0xc9f0d15 thru 0xc9f70e0 data_size 0x6(0x63cc bytes) 2024-09-21T22:15:48.015 INFO:teuthology.orchestra.run.smithi134.stdout:369 punch from 0x1891da5 to 0x1895e22, (0x407d bytes) 2024-09-21T22:15:48.015 INFO:teuthology.orchestra.run.smithi134.stdout:370 writesame 0x9faa9a2 thru 0x9fb75c4 data_size 0x1(0xcc23 bytes) 2024-09-21T22:15:48.039 INFO:teuthology.orchestra.run.smithi134.stdout:372 trunc from 0xc9f70e1 to 0xafaec80 2024-09-21T22:15:48.047 INFO:teuthology.orchestra.run.smithi134.stdout:373 write 0x6a82bbf thru 0x6a91bac (0xefee bytes) 2024-09-21T22:15:48.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /var/log/ceph/exp.3.c.3 2024-09-21T22:15:48.053 INFO:teuthology.orchestra.run.smithi134.stdout:374 punch from 0x3ea0331 to 0x3ead06b, (0xcd3a bytes) 2024-09-21T22:15:48.058 INFO:teuthology.orchestra.run.smithi134.stdout:375 write 0xafc6d6a thru 0xafd0255 (0x94ec bytes) 2024-09-21T22:15:48.065 INFO:teuthology.orchestra.run.smithi134.stdout:376 punch from 0x2bd5343 to 0x2be3a27, (0xe6e4 bytes) 2024-09-21T22:15:48.065 INFO:teuthology.orchestra.run.smithi134.stdout:377 punch from 0x6452150 to 0x6456424, (0x42d4 bytes) 2024-09-21T22:15:48.065 INFO:teuthology.orchestra.run.smithi134.stdout:379 read 0x21086c0 thru 0x2115f78 (0xd8b9 bytes) 2024-09-21T22:15:48.065 INFO:teuthology.orchestra.run.smithi134.stdout:380 read 0xf86cca thru 0xf8e5a2 (0x78d9 bytes) 2024-09-21T22:15:48.065 INFO:teuthology.orchestra.run.smithi134.stdout:381 write 0x93c714f thru 0x93ceb87 (0x7a39 bytes) 2024-09-21T22:15:48.068 INFO:teuthology.orchestra.run.smithi134.stdout:382 write 0x2e557fc thru 0x2e5be79 (0x667e bytes) 2024-09-21T22:15:48.070 INFO:teuthology.orchestra.run.smithi134.stdout:383 write 0x671d95d thru 0x6721acc (0x4170 bytes) 2024-09-21T22:15:48.074 INFO:teuthology.orchestra.run.smithi134.stdout:384 punch from 0xaa5cda to 0xab1c89, (0xbfaf bytes) 2024-09-21T22:15:48.077 INFO:teuthology.orchestra.run.smithi134.stdout:385 trunc from 0xafd0256 to 0x8f37ba9 2024-09-21T22:15:48.096 INFO:teuthology.orchestra.run.smithi134.stdout:386 trunc from 0x8f37ba9 to 0x4aeb763 2024-09-21T22:15:48.102 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:48.100+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:48.116 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:48.116 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:48.116 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:48.116 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:48.128 INFO:teuthology.orchestra.run.smithi134.stdout:387 writesame 0xcb99ba4 thru 0xcba9038 data_size 0x1b(0xf495 bytes) 2024-09-21T22:15:48.128 INFO:teuthology.orchestra.run.smithi134.stdout:388 punch from 0x24d0ea9 to 0x24d7769, (0x68c0 bytes) 2024-09-21T22:15:48.128 INFO:teuthology.orchestra.run.smithi134.stdout:390 writesame 0x8b55a94 thru 0x8b56ce5 data_size 0x5(0x1252 bytes) 2024-09-21T22:15:48.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:48.132 INFO:teuthology.orchestra.run.smithi134.stdout:391 writesame 0xc183348 thru 0xc1899be data_size 0x1(0x6677 bytes) 2024-09-21T22:15:48.144 INFO:teuthology.orchestra.run.smithi134.stdout:392 trunc from 0xcba9039 to 0xcad5b56 2024-09-21T22:15:48.150 INFO:teuthology.orchestra.run.smithi134.stdout:393 read 0x1118f44 thru 0x111eea2 (0x5f5f bytes) 2024-09-21T22:15:48.150 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.150 INFO:teuthology.orchestra.run.smithi134.stdout:396 writesame 0x132defa thru 0x1334c53 data_size 0x1(0x6d5a bytes) 2024-09-21T22:15:48.168 INFO:teuthology.orchestra.run.smithi134.stdout:397 read 0x8f54f0b thru 0x8f55b8b (0xc81 bytes) 2024-09-21T22:15:48.168 INFO:teuthology.orchestra.run.smithi134.stdout:398 write 0x835597e thru 0x835d6df (0x7d62 bytes) 2024-09-21T22:15:48.171 INFO:teuthology.orchestra.run.smithi134.stdout:399 punch from 0x2d62fc0 to 0x2d6a0e5, (0x7125 bytes) 2024-09-21T22:15:48.171 INFO:teuthology.orchestra.run.smithi134.stdout:401 write 0x4931eb6 thru 0x4939a79 (0x7bc4 bytes) 2024-09-21T22:15:48.176 INFO:teuthology.orchestra.run.smithi134.stdout:402 write 0x450e712 thru 0x4515f78 (0x7867 bytes) 2024-09-21T22:15:48.179 INFO:teuthology.orchestra.run.smithi134.stdout:403 read 0xbe38229 thru 0xbe42031 (0x9e09 bytes) 2024-09-21T22:15:48.179 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.179 INFO:teuthology.orchestra.run.smithi134.stdout:405 writesame 0x5074cb9 thru 0x5084a73 data_size 0xb(0xfdbb bytes) 2024-09-21T22:15:48.193 INFO:teuthology.orchestra.run.smithi134.stdout:407 write 0xd57ac14 thru 0xd57cc2e (0x201b bytes) 2024-09-21T22:15:48.197 INFO:teuthology.orchestra.run.smithi134.stdout:408 write 0xe98a6c thru 0xea0f45 (0x84da bytes) 2024-09-21T22:15:48.198 INFO:teuthology.orchestra.run.smithi134.stdout:409 write 0x32cc5d3 thru 0x32d49f0 (0x841e bytes) 2024-09-21T22:15:48.202 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:48.201+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:48.206 INFO:teuthology.orchestra.run.smithi134.stdout:410 read 0xa79a41f thru 0xa79c75a (0x233c bytes) 2024-09-21T22:15:48.206 INFO:teuthology.orchestra.run.smithi134.stdout:411 read 0x8145b53 thru 0x815541a (0xf8c8 bytes) 2024-09-21T22:15:48.206 INFO:teuthology.orchestra.run.smithi134.stdout:412 read 0x92251b8 thru 0x92254e3 (0x32c bytes) 2024-09-21T22:15:48.209 INFO:teuthology.orchestra.run.smithi134.stdout:413 trunc from 0xd57cc2f to 0xb44e1d5 2024-09-21T22:15:48.223 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.223 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.223 INFO:teuthology.orchestra.run.smithi134.stdout:416 read 0x360f29e thru 0x361e59e (0xf301 bytes) 2024-09-21T22:15:48.224 INFO:teuthology.orchestra.run.smithi134.stdout:417 writesame 0xa222e38 thru 0xa22b24f data_size 0xc(0x8418 bytes) 2024-09-21T22:15:48.227 INFO:teuthology.orchestra.run.smithi134.stdout:418 punch from 0x38954a9 to 0x38a2103, (0xcc5a bytes) 2024-09-21T22:15:48.227 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.227 INFO:teuthology.orchestra.run.smithi134.stdout:421 read 0x189e180 thru 0x18a4b4d (0x69ce bytes) 2024-09-21T22:15:48.227 INFO:teuthology.orchestra.run.smithi134.stdout:422 punch from 0x31eb57c to 0x31f10ad, (0x5b31 bytes) 2024-09-21T22:15:48.227 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.227 INFO:teuthology.orchestra.run.smithi134.stdout:425 writesame 0xb52ee0 thru 0xb5daa3 data_size 0x2(0xabc4 bytes) 2024-09-21T22:15:48.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:15:48.241 INFO:teuthology.orchestra.run.smithi134.stdout:426 trunc from 0xb44e1d5 to 0xdc3869d 2024-09-21T22:15:48.244 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:48.244 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:48.244 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:48.244 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:48.244 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:48.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:48.257 INFO:teuthology.orchestra.run.smithi134.stdout:427 trunc from 0xdc3869d to 0x626d7a8 2024-09-21T22:15:48.274 INFO:teuthology.orchestra.run.smithi134.stdout:428 writesame 0x6b8268f thru 0x6b9136c data_size 0x1(0xecde bytes) 2024-09-21T22:15:48.274 INFO:teuthology.orchestra.run.smithi134.stdout:429 read 0x2d46381 thru 0x2d46adf (0x75f bytes) 2024-09-21T22:15:48.274 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.279 INFO:teuthology.orchestra.run.smithi134.stdout:431 trunc from 0x6b9136d to 0x29d1cda 2024-09-21T22:15:48.292 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.303 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:48.302+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:48.307 INFO:teuthology.orchestra.run.smithi134.stdout:433 write 0xa956929 thru 0xa9574a2 (0xb7a bytes) 2024-09-21T22:15:48.311 INFO:teuthology.orchestra.run.smithi134.stdout:434 read 0xa19f4f5 thru 0xa1a9459 (0x9f65 bytes) 2024-09-21T22:15:48.311 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.318 INFO:teuthology.orchestra.run.smithi134.stdout:436 write 0xbda00d0 thru 0xbda0509 (0x43a bytes) 2024-09-21T22:15:48.321 INFO:teuthology.orchestra.run.smithi134.stdout:438 read 0x9b65b01 thru 0x9b70d37 (0xb237 bytes) 2024-09-21T22:15:48.324 INFO:teuthology.orchestra.run.smithi134.stdout:440 trunc from 0xbda050a to 0xe10da83 2024-09-21T22:15:48.329 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.336 INFO:teuthology.orchestra.run.smithi134.stdout:443 trunc from 0xe10da83 to 0x8767a2d 2024-09-21T22:15:48.347 INFO:teuthology.orchestra.run.smithi134.stdout:444 read 0xe13e thru 0x1e01a (0xfedd bytes) 2024-09-21T22:15:48.348 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.348 INFO:teuthology.orchestra.run.smithi134.stdout:446 read 0x3ec0d2c thru 0x3ecadf2 (0xa0c7 bytes) 2024-09-21T22:15:48.348 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.348 INFO:teuthology.orchestra.run.smithi134.stdout:448 writesame 0x25a88ac thru 0x25b282b data_size 0x1d(0x9f80 bytes) 2024-09-21T22:15:48.354 INFO:teuthology.orchestra.run.smithi134.stdout:449 punch from 0x25b2fa9 to 0x25b3973, (0x9ca bytes) 2024-09-21T22:15:48.354 INFO:teuthology.orchestra.run.smithi134.stdout:450 read 0x705d6f3 thru 0x7064f84 (0x7892 bytes) 2024-09-21T22:15:48.354 INFO:teuthology.orchestra.run.smithi134.stdout:451 read 0x1fed892 thru 0x1ff29db (0x514a bytes) 2024-09-21T22:15:48.354 INFO:teuthology.orchestra.run.smithi134.stdout:452 read 0xefe84a thru 0xf06238 (0x79ef bytes) 2024-09-21T22:15:48.364 INFO:teuthology.orchestra.run.smithi134.stdout:454 writesame 0xadf9ae3 thru 0xadfe55a data_size 0x4(0x4a78 bytes) 2024-09-21T22:15:48.364 INFO:teuthology.orchestra.run.smithi134.stdout:456 punch from 0x4b33a65 to 0x4b3dd47, (0xa2e2 bytes) 2024-09-21T22:15:48.364 INFO:teuthology.orchestra.run.smithi134.stdout:457 read 0x4e9175d thru 0x4e966a6 (0x4f4a bytes) 2024-09-21T22:15:48.364 INFO:teuthology.orchestra.run.smithi134.stdout:458 read 0x4b0c278 thru 0x4b18799 (0xc522 bytes) 2024-09-21T22:15:48.371 INFO:teuthology.orchestra.run.smithi134.stdout:459 trunc from 0xadfe55b to 0x5443154 2024-09-21T22:15:48.371 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:48.371 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:48.378 INFO:teuthology.orchestra.run.smithi134.stdout:460 punch from 0x2a0d48e to 0x2a13b1a, (0x668c bytes) 2024-09-21T22:15:48.381 INFO:teuthology.orchestra.run.smithi134.stdout:461 trunc from 0x5443154 to 0x2d63aa6 2024-09-21T22:15:48.389 INFO:teuthology.orchestra.run.smithi134.stdout:462 punch from 0x2a31e2 to 0x2a9089, (0x5ea7 bytes) 2024-09-21T22:15:48.400 INFO:teuthology.orchestra.run.smithi134.stdout:464 write 0x62aef3e thru 0x62b46da (0x579d bytes) 2024-09-21T22:15:48.404 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:48.404 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:48.405 INFO:teuthology.orchestra.run.smithi134.stdout:466 read 0x25714aa thru 0x257886e (0x73c5 bytes) 2024-09-21T22:15:48.405 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.405 INFO:teuthology.orchestra.run.smithi134.stdout:469 read 0x3d22fa8 thru 0x3d29527 (0x6580 bytes) 2024-09-21T22:15:48.405 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:48.402+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:48.409 INFO:teuthology.orchestra.run.smithi134.stdout:470 trunc from 0x62b46db to 0x2eadf8a 2024-09-21T22:15:48.411 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:48.411 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:48.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:48.411 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:259 3.4 e28/23 3:226e6cb4:::rbd_data.11856a5cf33b.000000000000003a:head v 28'6, mlcod=28'4)", 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.6437758240000004, 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030935889999999999, 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765082+0000", 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9350000000000001e-06 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765094+0000", 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2045000000000001e-05 2024-09-21T22:15:48.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765114+0000", 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9556999999999999e-05 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765136+0000", 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2257999999999999e-05 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765208+0000", 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2192000000000003e-05 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765232+0000", 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4107000000000001e-05 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768126+0000", 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028939159999999998 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768174+0000", 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7579e-05 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9075652539999997, 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:15:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:15:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8923817949999999, 2024-09-21T22:15:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:15:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:15:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.880935357, 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.0 epoch 33/23 rep_tid 115 entries 33'10 (0'0) error 3:053415b0:::rbd_object_map.118555b0e245:head by client.4485.0:2367 0.000000 -17 [r=-17+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 33'8)", 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8712701790000001, 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023730000000000001, 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1900000000000002e-07 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537593+0000", 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.844e-06 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537609+0000", 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5786000000000001e-05 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537618+0000", 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8000000000000004e-06 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537671+0000", 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3096999999999997e-05 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.539959+0000", 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878540000000002 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2603 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'36, mlcod=34'34)", 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.409732339, 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032135610000000002, 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999129+0000", 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999139+0000", 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5300000000000002e-06 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999143+0000", 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999184+0000", 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999198+0000", 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3971999999999999e-05 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002303+0000", 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031052179999999999 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002337+0000", 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3992000000000003e-05 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2614 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'38, mlcod=34'36)", 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.39347139399999997, 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002984273, 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015386+0000", 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6700000000000002e-07 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015392+0000", 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4999999999999996e-06 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015404+0000", 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1864e-05 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015411+0000", 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9e-06 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015478+0000", 2024-09-21T22:15:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7067e-05 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015493+0000", 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5398000000000001e-05 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018334+0000", 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002840679 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018369+0000", 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4897999999999997e-05 2024-09-21T22:15:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.36102901799999998, 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:15:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:15:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:15:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2636 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'42, mlcod=34'40)", 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.34983778999999998, 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033367480000000001, 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059019+0000", 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-06 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059029+0000", 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4509999999999998e-06 2024-09-21T22:15:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059044+0000", 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5218000000000001e-05 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059052+0000", 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059114+0000", 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2094999999999994e-05 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059139+0000", 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-05 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062305+0000", 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031661020000000001 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062355+0000", 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0129000000000001e-05 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2649 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'47, mlcod=34'45)", 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.080962+0000", 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.32789422899999998, 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024035839999999998, 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080962+0000", 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080962+0000", 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080963+0000", 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5600000000000004e-07 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080971+0000", 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2900000000000002e-06 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080986+0000", 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5441e-05 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080995+0000", 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3129999999999999e-06 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.081049+0000", 2024-09-21T22:15:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4256999999999999e-05 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.081071+0000", 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2140000000000001e-05 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.083332+0000", 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022607700000000001 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.083365+0000", 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3417000000000002e-05 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2651 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'48, mlcod=34'46)", 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.085290+0000", 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.32356613000000001, 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024552279999999998, 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085290+0000", 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085290+0000", 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085291+0000", 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7499999999999999e-07 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085297+0000", 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2659999999999998e-06 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085310+0000", 2024-09-21T22:15:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3587999999999999e-05 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085327+0000", 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6215999999999999e-05 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085376+0000", 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9147000000000002e-05 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085396+0000", 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0001e-05 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.087704+0000", 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00230861 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.087745+0000", 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0624999999999998e-05 2024-09-21T22:15:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2659 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'49, mlcod=34'47)", 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.31150989099999998, 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024912200000000002, 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:15:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097347+0000", 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097357+0000", 2024-09-21T22:15:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9040000000000004e-06 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097375+0000", 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8284999999999999e-05 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097389+0000", 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3053e-05 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097438+0000", 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9184999999999997e-05 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097456+0000", 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8022000000000001e-05 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.099805+0000", 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023490479999999998 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.099837+0000", 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2487000000000003e-05 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2672 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'52, mlcod=34'50)", 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.28792174599999998, 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024984180000000001, 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120935+0000", 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.034e-06 2024-09-21T22:15:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120944+0000", 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9120000000000004e-06 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120957+0000", 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2398999999999999e-05 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120964+0000", 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0480000000000001e-06 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.121020+0000", 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6514999999999997e-05 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.121038+0000", 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8105999999999999e-05 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123389+0000", 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023506930000000001 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123433+0000", 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3711000000000002e-05 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2681 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'53, mlcod=34'51)", 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.280496419, 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024865360000000001, 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128361+0000", 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.850000000000001e-07 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128371+0000", 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0293e-05 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128384+0000", 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3546e-05 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128393+0000", 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2090000000000005e-06 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128440+0000", 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7120999999999998e-05 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128456+0000", 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6503000000000001e-05 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.130815+0000", 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023583419999999998 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.130846+0000", 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1537e-05 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2699 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'58, mlcod=34'56)", 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.171904+0000", 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236951988, 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023824670000000001, 2024-09-21T22:15:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171904+0000", 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171904+0000", 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171905+0000", 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8299999999999997e-07 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171912+0000", 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9840000000000004e-06 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171921+0000", 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5040000000000008e-06 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171927+0000", 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171973+0000", 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5045e-05 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171990+0000", 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7037999999999998e-05 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.174239+0000", 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022490349999999999 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.174286+0000", 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7824999999999997e-05 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2719 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'64, mlcod=34'62)", 2024-09-21T22:15:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.21000653, 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029567959999999998, 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:15:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198850+0000", 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6599999999999995e-07 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198855+0000", 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2939999999999996e-06 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198866+0000", 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0239e-05 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198873+0000", 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198927+0000", 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4548e-05 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198949+0000", 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2243999999999999e-05 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201757+0000", 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028075700000000001 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201806+0000", 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9258000000000002e-05 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.19909421199999999, 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:15:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:15:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2835 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'85, mlcod=34'83)", 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.060076979000000003, 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002476645, 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348780+0000", 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.311e-06 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348791+0000", 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0257e-05 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348808+0000", 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7546000000000001e-05 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348817+0000", 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3090000000000001e-06 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348881+0000", 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3615999999999995e-05 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348908+0000", 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7483000000000001e-05 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.351202+0000", 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022931449999999999 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.351256+0000", 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3977999999999997e-05 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2839 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'86, mlcod=34'84)", 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.358196+0000", 2024-09-21T22:15:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.050660043000000002, 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002391458, 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358196+0000", 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358196+0000", 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358198+0000", 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7269999999999999e-06 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358208+0000", 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0832000000000001e-05 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358227+0000", 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8156e-05 2024-09-21T22:15:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358234+0000", 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3440000000000003e-06 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358299+0000", 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4839999999999996e-05 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358316+0000", 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7564999999999999e-05 2024-09-21T22:15:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.360546+0000", 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022292150000000001 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.360587+0000", 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1779000000000001e-05 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2859 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'88, mlcod=34'86)", 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.384084+0000", 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024771468000000001, 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023357730000000002, 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384084+0000", 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384084+0000", 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384086+0000", 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.094e-06 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384094+0000", 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384109+0000", 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5180999999999999e-05 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384116+0000", 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5839999999999997e-06 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384174+0000", 2024-09-21T22:15:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7967999999999998e-05 2024-09-21T22:15:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.384192+0000", 2024-09-21T22:15:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7762999999999999e-05 2024-09-21T22:15:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.386375+0000", 2024-09-21T22:15:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021834979999999999 2024-09-21T22:15:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.386420+0000", 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4755000000000001e-05 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:48.498 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:48.499 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:48.500 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:48.501 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:48.501 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:48.502 INFO:teuthology.orchestra.run.smithi134.stdout:472 trunc from 0x2eadf8a to 0xe226356 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:473 writesame 0xe694e2f thru 0xe699827 data_size 0x1(0x49f9 bytes) 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:475 trunc from 0xe699828 to 0xe8ad906 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:477 punch from 0xa140784 to 0xa14a5ab, (0x9e27 bytes) 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:478 writesame 0xc663448 thru 0xc668950 data_size 0x1(0x5509 bytes) 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:479 write 0x1836715 thru 0x1842b82 (0xc46e bytes) 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:480 write 0x1d8969b thru 0x1d8e48f (0x4df5 bytes) 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:482 read 0x1b253bb thru 0x1b2f6aa (0xa2f0 bytes) 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:483 writesame 0x8e07a01 thru 0x8e0930e data_size 0x3(0x190e bytes) 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:485 trunc from 0xe8ad906 to 0x5c8326e 2024-09-21T22:15:48.503 INFO:teuthology.orchestra.run.smithi134.stdout:488 trunc from 0x5c8326e to 0xb5afabe 2024-09-21T22:15:48.504 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:48.503+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:48.512 INFO:teuthology.orchestra.run.smithi134.stdout:490 write 0xb7cca85 thru 0xb7d3ed0 (0x744c bytes) 2024-09-21T22:15:48.515 INFO:teuthology.orchestra.run.smithi134.stdout:491 read 0x95302db thru 0x953e260 (0xdf86 bytes) 2024-09-21T22:15:48.515 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.515 INFO:teuthology.orchestra.run.smithi134.stdout:493 read 0x2e19e93 thru 0x2e267cb (0xc939 bytes) 2024-09-21T22:15:48.515 INFO:teuthology.orchestra.run.smithi134.stdout:495 read 0x4e0e4ef thru 0x4e13644 (0x5156 bytes) 2024-09-21T22:15:48.515 INFO:teuthology.orchestra.run.smithi134.stdout:496 write 0x1033699 thru 0x103cf82 (0x98ea bytes) 2024-09-21T22:15:48.516 INFO:teuthology.orchestra.run.smithi134.stdout:499 read 0x36aff89 thru 0x36b6a05 (0x6a7d bytes) 2024-09-21T22:15:48.517 INFO:teuthology.orchestra.run.smithi134.stdout:501 write 0x3741a7b thru 0x3747adb (0x6061 bytes) 2024-09-21T22:15:48.521 INFO:teuthology.orchestra.run.smithi134.stdout:502 read 0x5d3a96a thru 0x5d49ae2 (0xf179 bytes) 2024-09-21T22:15:48.521 INFO:teuthology.orchestra.run.smithi134.stdout:503 write 0x16563ef thru 0x1657204 (0xe16 bytes) 2024-09-21T22:15:48.524 INFO:teuthology.orchestra.run.smithi134.stdout:504 punch from 0xb0602dd to 0xb06c8c6, (0xc5e9 bytes) 2024-09-21T22:15:48.524 INFO:teuthology.orchestra.run.smithi134.stdout:505 punch from 0x29d52d6 to 0x29e0c3f, (0xb969 bytes) 2024-09-21T22:15:48.536 INFO:teuthology.orchestra.run.smithi134.stdout:506 writesame 0xea07393 thru 0xea07f25 data_size 0x1(0xb93 bytes) 2024-09-21T22:15:48.536 INFO:teuthology.orchestra.run.smithi134.stdout:507 write 0x44ca0c7 thru 0x44d0c1c (0x6b56 bytes) 2024-09-21T22:15:48.539 INFO:teuthology.orchestra.run.smithi134.stdout:508 read 0xe34670b thru 0xe34dfe2 (0x78d8 bytes) 2024-09-21T22:15:48.539 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.539 INFO:teuthology.orchestra.run.smithi134.stdout:510 punch from 0xcd5428a to 0xcd55251, (0xfc7 bytes) 2024-09-21T22:15:48.539 INFO:teuthology.orchestra.run.smithi134.stdout:511 write 0xae2542 thru 0xaea944 (0x8403 bytes) 2024-09-21T22:15:48.541 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.542 INFO:teuthology.orchestra.run.smithi134.stdout:513 write 0x6aef3a5 thru 0x6af9b82 (0xa7de bytes) 2024-09-21T22:15:48.545 INFO:teuthology.orchestra.run.smithi134.stdout:515 read 0x220d4ad thru 0x220f694 (0x21e8 bytes) 2024-09-21T22:15:48.545 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.545 INFO:teuthology.orchestra.run.smithi134.stdout:517 punch from 0xcc180b0 to 0xcc1a498, (0x23e8 bytes) 2024-09-21T22:15:48.545 INFO:teuthology.orchestra.run.smithi134.stdout:518 read 0x23d764a thru 0x23de673 (0x702a bytes) 2024-09-21T22:15:48.545 INFO:teuthology.orchestra.run.smithi134.stdout:519 write 0xe81e4c3 thru 0xe82a8c6 (0xc404 bytes) 2024-09-21T22:15:48.550 INFO:teuthology.orchestra.run.smithi134.stdout:520 write 0xc1b3f25 thru 0xc1ba772 (0x684e bytes) 2024-09-21T22:15:48.560 INFO:teuthology.orchestra.run.smithi134.stdout:521 trunc from 0xea07f26 to 0x87bb5b0 2024-09-21T22:15:48.581 INFO:teuthology.orchestra.run.smithi134.stdout:522 write 0xc518f72 thru 0xc52681a (0xd8a9 bytes) 2024-09-21T22:15:48.589 INFO:teuthology.orchestra.run.smithi134.stdout:523 trunc from 0xc52681b to 0x7e6682e 2024-09-21T22:15:48.599 INFO:teuthology.orchestra.run.smithi134.stdout:524 writesame 0x15d0c3f thru 0x15d583e data_size 0x13(0x4c00 bytes) 2024-09-21T22:15:48.602 INFO:teuthology.orchestra.run.smithi134.stdout:527 read 0x1f5fa4c thru 0x1f64726 (0x4cdb bytes) 2024-09-21T22:15:48.603 INFO:teuthology.orchestra.run.smithi134.stdout:528 read 0x2a198ec thru 0x2a1d728 (0x3e3d bytes) 2024-09-21T22:15:48.603 INFO:teuthology.orchestra.run.smithi134.stdout:529 read 0x4ee4224 thru 0x4eed11d (0x8efa bytes) 2024-09-21T22:15:48.603 INFO:teuthology.orchestra.run.smithi134.stdout:530 read 0x1bffdc8 thru 0x1c00d4f (0xf88 bytes) 2024-09-21T22:15:48.603 INFO:teuthology.orchestra.run.smithi134.stdout:531 punch from 0x34b7eee to 0x34c25ef, (0xa701 bytes) 2024-09-21T22:15:48.603 INFO:teuthology.orchestra.run.smithi134.stdout:532 write 0x941c23 thru 0x945d63 (0x4141 bytes) 2024-09-21T22:15:48.605 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.605 INFO:teuthology.orchestra.run.smithi134.stdout:534 write 0x696ad76 thru 0x696b941 (0xbcc bytes) 2024-09-21T22:15:48.606 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:48.604+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:48.610 INFO:teuthology.orchestra.run.smithi134.stdout:536 write 0x7afae0f thru 0x7afe271 (0x3463 bytes) 2024-09-21T22:15:48.611 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:48.611 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:48.613 INFO:teuthology.orchestra.run.smithi134.stdout:537 writesame 0x75082ff thru 0x750e745 data_size 0x2b(0x6447 bytes) 2024-09-21T22:15:48.619 INFO:teuthology.orchestra.run.smithi134.stdout:538 read 0x68a82bb thru 0x68b0e26 (0x8b6c bytes) 2024-09-21T22:15:48.621 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:48.633 INFO:teuthology.orchestra.run.smithi134.stdout:539 write 0xe58917c thru 0xe590379 (0x71fe bytes) 2024-09-21T22:15:48.635 INFO:teuthology.orchestra.run.smithi134.stdout:540 write 0x1c5ae87 thru 0x1c5f8e8 (0x4a62 bytes) 2024-09-21T22:15:48.638 INFO:teuthology.orchestra.run.smithi134.stdout:541 writesame 0x30084d6 thru 0x300fa64 data_size 0xd(0x758f bytes) 2024-09-21T22:15:48.641 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.648 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:48.648 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:48.658 INFO:teuthology.orchestra.run.smithi134.stdout:543 trunc from 0xe59037a to 0x7fe6fc 2024-09-21T22:15:48.668 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:48.668 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:48.683 INFO:teuthology.orchestra.run.smithi134.stdout:546 write 0x4b61bf thru 0x4bffc7 (0x9e09 bytes) 2024-09-21T22:15:48.686 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:48.686 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:48.703 INFO:teuthology.orchestra.run.smithi134.stdout:548 writesame 0x92a7f2d thru 0x92b2250 data_size 0x4(0xa324 bytes) 2024-09-21T22:15:48.703 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.703 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:48.704 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:48.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:48.706+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:48.708 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:48.708 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:48.712 INFO:teuthology.orchestra.run.smithi134.stdout:551 trunc from 0x92b2251 to 0x1697109 2024-09-21T22:15:48.742 INFO:teuthology.orchestra.run.smithi134.stdout:552 writesame 0xd697370 thru 0xd69e873 data_size 0x2(0x7504 bytes) 2024-09-21T22:15:48.742 INFO:teuthology.orchestra.run.smithi134.stdout:553 read 0x98bcfad thru 0x98c5956 (0x89aa bytes) 2024-09-21T22:15:48.742 INFO:teuthology.orchestra.run.smithi134.stdout:554 read 0x8902798 thru 0x890dec5 (0xb72e bytes) 2024-09-21T22:15:48.742 INFO:teuthology.orchestra.run.smithi134.stdout:555 read 0xa3e5607 thru 0xa3f51f8 (0xfbf2 bytes) 2024-09-21T22:15:48.742 INFO:teuthology.orchestra.run.smithi134.stdout:556 write 0xc9dc13a thru 0xc9e5ba0 (0x9a67 bytes) 2024-09-21T22:15:48.747 INFO:teuthology.orchestra.run.smithi134.stdout:557 writesame 0x4ff3e11 thru 0x4ffd0ba data_size 0x1(0x92aa bytes) 2024-09-21T22:15:48.770 INFO:teuthology.orchestra.run.smithi134.stdout:560 punch from 0x82928b to 0x836fb2, (0xdd27 bytes) 2024-09-21T22:15:48.770 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.770 INFO:teuthology.orchestra.run.smithi134.stdout:565 trunc from 0xd69e874 to 0xd721135 2024-09-21T22:15:48.775 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:48.775 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:48.775 INFO:teuthology.orchestra.run.smithi134.stdout:568 punch from 0x88be29 to 0x8930f0, (0x72c7 bytes) 2024-09-21T22:15:48.782 INFO:teuthology.orchestra.run.smithi134.stdout:569 trunc from 0xd721135 to 0x7c97d7f 2024-09-21T22:15:48.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:48.801 INFO:teuthology.orchestra.run.smithi134.stdout:570 trunc from 0x7c97d7f to 0x2cdcb76 2024-09-21T22:15:48.808 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:48.807+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:48.814 INFO:teuthology.orchestra.run.smithi134.stdout:571 read 0x25426ed thru 0x254c78b (0xa09f bytes) 2024-09-21T22:15:48.821 INFO:teuthology.orchestra.run.smithi134.stdout:572 trunc from 0x2cdcb76 to 0x93c4206 2024-09-21T22:15:48.831 INFO:teuthology.orchestra.run.smithi134.stdout:573 read 0x192f23e thru 0x1934434 (0x51f7 bytes) 2024-09-21T22:15:48.831 INFO:teuthology.orchestra.run.smithi134.stdout:575 read 0x8ab6f08 thru 0x8ac6c63 (0xfd5c bytes) 2024-09-21T22:15:48.831 INFO:teuthology.orchestra.run.smithi134.stdout:576 punch from 0x3312bcb to 0x331d52f, (0xa964 bytes) 2024-09-21T22:15:48.831 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.834 INFO:teuthology.orchestra.run.smithi134.stdout:578 trunc from 0x93c4206 to 0x6ddedd9 2024-09-21T22:15:48.844 INFO:teuthology.orchestra.run.smithi134.stdout:579 read 0x3198911 thru 0x319e470 (0x5b60 bytes) 2024-09-21T22:15:48.844 INFO:teuthology.orchestra.run.smithi134.stdout:580 read 0x4a100c9 thru 0x4a113df (0x1317 bytes) 2024-09-21T22:15:48.844 INFO:teuthology.orchestra.run.smithi134.stdout:584 read 0x57088b4 thru 0x570a045 (0x1792 bytes) 2024-09-21T22:15:48.844 INFO:teuthology.orchestra.run.smithi134.stdout:585 punch from 0x16c1240 to 0x16c3500, (0x22c0 bytes) 2024-09-21T22:15:48.844 INFO:teuthology.orchestra.run.smithi134.stdout:586 read 0x1773e2b thru 0x1783370 (0xf546 bytes) 2024-09-21T22:15:48.844 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.844 INFO:teuthology.orchestra.run.smithi134.stdout:588 writesame 0x703b5a thru 0x7084a9 data_size 0x66(0x4950 bytes) 2024-09-21T22:15:48.849 INFO:teuthology.orchestra.run.smithi134.stdout:589 read 0x492712e thru 0x4928bec (0x1abf bytes) 2024-09-21T22:15:48.849 INFO:teuthology.orchestra.run.smithi134.stdout:590 punch from 0x38615a4 to 0x3863caa, (0x2706 bytes) 2024-09-21T22:15:48.849 INFO:teuthology.orchestra.run.smithi134.stdout:592 read 0x5c14e12 thru 0x5c2252f (0xd71e bytes) 2024-09-21T22:15:48.849 INFO:teuthology.orchestra.run.smithi134.stdout:593 writesame 0xb79e09 thru 0xb807d4 data_size 0x7a(0x69cc bytes) 2024-09-21T22:15:48.859 INFO:teuthology.orchestra.run.smithi134.stdout:594 writesame 0x61f9045 thru 0x61fcc77 data_size 0xb(0x3c33 bytes) 2024-09-21T22:15:48.866 INFO:teuthology.orchestra.run.smithi134.stdout:595 read 0x4e5f903 thru 0x4e62ea2 (0x35a0 bytes) 2024-09-21T22:15:48.878 INFO:teuthology.orchestra.run.smithi134.stdout:596 write 0xca977d2 thru 0xca9c799 (0x4fc8 bytes) 2024-09-21T22:15:48.882 INFO:teuthology.orchestra.run.smithi134.stdout:597 write 0xc9760cf thru 0xc97d04a (0x6f7c bytes) 2024-09-21T22:15:48.885 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.885 INFO:teuthology.orchestra.run.smithi134.stdout:599 punch from 0x8cdecd to 0x8d02fe, (0x2431 bytes) 2024-09-21T22:15:48.885 INFO:teuthology.orchestra.run.smithi134.stdout:600 write 0x24a872 thru 0x252cca (0x8459 bytes) 2024-09-21T22:15:48.887 INFO:teuthology.orchestra.run.smithi134.stdout:601 punch from 0xc746bdb to 0xc754125, (0xd54a bytes) 2024-09-21T22:15:48.887 INFO:teuthology.orchestra.run.smithi134.stdout:602 read 0x4db3b92 thru 0x4db63fc (0x286b bytes) 2024-09-21T22:15:48.893 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:48.893 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:48.893 INFO:teuthology.orchestra.run.smithi134.stdout:603 write 0xd26b0a0 thru 0xd27a51a (0xf47b bytes) 2024-09-21T22:15:48.902 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:15:48.905 INFO:teuthology.orchestra.run.smithi134.stdout:604 trunc from 0xd27a51b to 0x815363f 2024-09-21T22:15:48.929 INFO:teuthology.orchestra.run.smithi134.stdout:605 read 0x3343708 thru 0x334ba61 (0x835a bytes) 2024-09-21T22:15:48.929 INFO:teuthology.orchestra.run.smithi134.stdout:606 read 0x3e330af thru 0x3e3f236 (0xc188 bytes) 2024-09-21T22:15:48.929 INFO:teuthology.orchestra.run.smithi134.stdout:607 write 0x1bfaa4b thru 0x1c01ad8 (0x708e bytes) 2024-09-21T22:15:48.935 INFO:teuthology.orchestra.run.smithi134.stdout:608 read 0x5bc26f thru 0x5c679b (0xa52d bytes) 2024-09-21T22:15:48.936 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.936 INFO:teuthology.orchestra.run.smithi134.stdout:610 write 0x287c571 thru 0x287d544 (0xfd4 bytes) 2024-09-21T22:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout:612 trunc from 0x815363f to 0xc82b37d 2024-09-21T22:15:48.945 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:48.944+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout:615 punch from 0x1277c20 to 0x127ebcc, (0x6fac bytes) 2024-09-21T22:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout:618 read 0x6680e78 thru 0x6683055 (0x21de bytes) 2024-09-21T22:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout:619 trunc from 0xc82b37d to 0x3901471 2024-09-21T22:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout:620 read 0x272e788 thru 0x2732a48 (0x42c1 bytes) 2024-09-21T22:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout:622 write 0x8bdb8e4 thru 0x8be65b9 (0xacd6 bytes) 2024-09-21T22:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout:623 punch from 0x6942cd4 to 0x694b116, (0x8442 bytes) 2024-09-21T22:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout:625 write 0xec05440 thru 0xec0d1b5 (0x7d76 bytes) 2024-09-21T22:15:49.009 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:49.007+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:49.009 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:49.009 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout:626 read 0x31f87ac thru 0x32010be (0x8913 bytes) 2024-09-21T22:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout:628 read 0x8b25143 thru 0x8b33c36 (0xeaf4 bytes) 2024-09-21T22:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout:629 write 0x4fc1d52 thru 0x4fd0612 (0xe8c1 bytes) 2024-09-21T22:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout:633 writesame 0xb01b8dd thru 0xb02acc6 data_size 0x9(0xf3ea bytes) 2024-09-21T22:15:49.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout:truncating to largest ever: 0xedd6a3f 2024-09-21T22:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout:635 trunc from 0xec0d1b6 to 0xedd6a3f 2024-09-21T22:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout:637 trunc from 0xedd6a3f to 0xc971a56 2024-09-21T22:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout:638 writesame 0x4f078d5 thru 0x4f09eeb data_size 0x7(0x2617 bytes) 2024-09-21T22:15:49.040 INFO:teuthology.orchestra.run.smithi134.stdout:640 read 0x6e33ba8 thru 0x6e3b5d2 (0x7a2b bytes) 2024-09-21T22:15:49.041 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:49.041 INFO:teuthology.orchestra.run.smithi134.stdout:642 write 0x19a83a6 thru 0x19b07be (0x8419 bytes) 2024-09-21T22:15:49.049 INFO:teuthology.orchestra.run.smithi134.stdout:644 write 0xd111d48 thru 0xd11e987 (0xcc40 bytes) 2024-09-21T22:15:49.052 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:49.052 INFO:teuthology.orchestra.run.smithi134.stdout:647 read 0x787b4be thru 0x7887e9a (0xc9dd bytes) 2024-09-21T22:15:49.052 INFO:teuthology.orchestra.run.smithi134.stdout:648 writesame 0x95fa216 thru 0x9607ea2 data_size 0x1(0xdc8d bytes) 2024-09-21T22:15:49.080 INFO:teuthology.orchestra.run.smithi134.stdout:649 read 0x28452bb thru 0x2849e11 (0x4b57 bytes) 2024-09-21T22:15:49.081 INFO:teuthology.orchestra.run.smithi134.stdout:650 read 0x696c7ee thru 0x697bb73 (0xf386 bytes) 2024-09-21T22:15:49.081 INFO:teuthology.orchestra.run.smithi134.stdout:652 writesame 0xb2a682f thru 0xb2b4dcf data_size 0x5(0xe5a1 bytes) 2024-09-21T22:15:49.090 INFO:teuthology.orchestra.run.smithi134.stdout:655 trunc from 0xd11e988 to 0xe677559 2024-09-21T22:15:49.095 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:49.095 INFO:teuthology.orchestra.run.smithi134.stdout:657 write 0xc703929 thru 0xc71281d (0xeef5 bytes) 2024-09-21T22:15:49.098 INFO:teuthology.orchestra.run.smithi134.stdout:658 writesame 0xcbddc83 thru 0xcbe480b data_size 0x1(0x6b89 bytes) 2024-09-21T22:15:49.110 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:49.108+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:49.113 INFO:teuthology.orchestra.run.smithi134.stdout:659 read 0x871a8ff thru 0x872838a (0xda8c bytes) 2024-09-21T22:15:49.113 INFO:teuthology.orchestra.run.smithi134.stdout:660 read 0xe586c3f thru 0xe58ee8c (0x824e bytes) 2024-09-21T22:15:49.113 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:49.113 INFO:teuthology.orchestra.run.smithi134.stdout:664 read 0x7131272 thru 0x713e2b0 (0xd03f bytes) 2024-09-21T22:15:49.114 INFO:teuthology.orchestra.run.smithi134.stdout:665 read 0xc1825d2 thru 0xc18f4ed (0xcf1c bytes) 2024-09-21T22:15:49.114 INFO:teuthology.orchestra.run.smithi134.stdout:666 punch from 0x459702e to 0x45a44b0, (0xd482 bytes) 2024-09-21T22:15:49.114 INFO:teuthology.orchestra.run.smithi134.stdout:667 punch from 0x2dbfcd7 to 0x2dcca84, (0xcdad bytes) 2024-09-21T22:15:49.114 INFO:teuthology.orchestra.run.smithi134.stdout:668 writesame 0x31afc67 thru 0x31b823a data_size 0x1e(0x85d4 bytes) 2024-09-21T22:15:49.127 INFO:teuthology.orchestra.run.smithi134.stdout:669 trunc from 0xe677559 to 0x65abc91 2024-09-21T22:15:49.160 INFO:teuthology.orchestra.run.smithi134.stdout:672 writesame 0xb3d86fc thru 0xb3dc296 data_size 0x1(0x3b9b bytes) 2024-09-21T22:15:49.160 INFO:teuthology.orchestra.run.smithi134.stdout:673 write 0x3eb165d thru 0x3ebc04e (0xa9f2 bytes) 2024-09-21T22:15:49.169 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:49.169 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:49.174 INFO:teuthology.orchestra.run.smithi134.stdout:675 trunc from 0xb3dc297 to 0x3cb569c 2024-09-21T22:15:49.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:15:49.184 INFO:teuthology.orchestra.run.smithi134.stdout:677 read 0x1b4582d thru 0x1b51ec7 (0xc69b bytes) 2024-09-21T22:15:49.201 INFO:teuthology.orchestra.run.smithi134.stdout:678 write 0xd2bb34b thru 0xd2bcffe (0x1cb4 bytes) 2024-09-21T22:15:49.204 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:49.204 INFO:teuthology.orchestra.run.smithi134.stdout:681 punch from 0x2c47554 to 0x2c4bd95, (0x4841 bytes) 2024-09-21T22:15:49.204 INFO:teuthology.orchestra.run.smithi134.stdout:682 write 0x91f4862 thru 0x9204792 (0xff31 bytes) 2024-09-21T22:15:49.208 INFO:teuthology.orchestra.run.smithi134.stdout:683 punch from 0xc381f4c to 0xc38dcc7, (0xbd7b bytes) 2024-09-21T22:15:49.208 INFO:teuthology.orchestra.run.smithi134.stdout:684 punch from 0x70f359f to 0x70fa59c, (0x6ffd bytes) 2024-09-21T22:15:49.208 INFO:teuthology.orchestra.run.smithi134.stdout:685 read 0x5d1da thru 0x6bfc9 (0xedf0 bytes) 2024-09-21T22:15:49.209 INFO:teuthology.orchestra.run.smithi134.stdout:686 read 0x24ac82a thru 0x24b8674 (0xbe4b bytes) 2024-09-21T22:15:49.209 INFO:teuthology.orchestra.run.smithi134.stdout:687 clone 3 order 22 su 65536 sc 6 2024-09-21T22:15:49.219 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:49.218+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:49.311 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:49.309+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:49.322 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:49.322 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:49.330 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:49.415 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:49.413+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:49.476 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:49.476 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:49.486 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:49.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:15:49.528 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:49.527+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:49.613 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:49.613+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:49.631 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:49.631 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:49.640 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:49.724 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:49.723+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:49.784 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:49.784 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:49.792 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:49.834 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:49.833+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:49.916 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:49.915+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:49.937 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:49.937 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:49.946 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:50.031 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:50.030+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:50.090 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:50.090 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:50.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:50.141 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:50.140+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:50.219 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:50.218+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:50.243 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:50.244 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:50.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:50.320 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:50.319+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:50.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:50.421 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:50.420+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:50.488 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:15:50.521 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:50.521 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:50.521 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:50.520+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:50.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:50.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:50.620+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:50.678 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:50.678 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:50.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:50.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:15:50.728 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:50.727+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:50.822 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:50.822+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:50.835 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:50.835 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:50.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:50.849 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:50.850 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:50.867 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:50.867 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:50.883 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:50.884 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:50.884 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:50.900 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:50.900 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:50.917 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:50.917 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:50.923 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:50.923+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:50.934 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:50.934 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:50.949 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:50.949 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:50.949 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:50.949 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:50.949 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:50.951 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:50.951 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:50.954 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:50.955 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:50.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:51.024 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:51.024+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:51.103 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:51.103 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:51.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.657509602999999, 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043089249999999999, 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443484+0000", 2024-09-21T22:15:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5140000000000002e-06 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443492+0000", 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4259999999999997e-06 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443501+0000", 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3980000000000005e-06 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443536+0000", 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4604000000000003e-05 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443551+0000", 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5387999999999999e-05 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447726+0000", 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041748530000000001 2024-09-21T22:15:51.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447789+0000", 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3540000000000005e-05 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:259 3.4 3:226e6cb4:::rbd_data.11856a5cf33b.000000000000003a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.764732+0000", 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3362580180000005, 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035988349999999999, 2024-09-21T22:15:51.108 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 259 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764732+0000", 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764732+0000", 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764733+0000", 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764737+0000", 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8299999999999998e-06 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764749+0000", 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2884999999999999e-05 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764756+0000", 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764805+0000", 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9775999999999999e-05 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764880+0000", 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4527e-05 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.764992+0000", 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112179 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765669+0000", 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00067687300000000004 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768280+0000", 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026111620000000002 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768308+0000", 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8354e-05 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768331+0000", 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2514000000000002e-05 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:956 3.6 e30/23 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head v 30'7, mlcod=28'5)", 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.6049584179999998, 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091893070000000007, 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497369+0000", 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001336804 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497387+0000", 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8014999999999999e-05 2024-09-21T22:15:51.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497398+0000", 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1581e-05 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497480+0000", 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1874999999999998e-05 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497511+0000", 2024-09-21T22:15:51.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1103999999999999e-05 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505165+0000", 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076536219999999997 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505221+0000", 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6026000000000002e-05 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:960 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.6030248670000002, 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084308620000000008, 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 960 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497968+0000", 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.429e-06 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498743+0000", 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077512399999999997 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498766+0000", 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2983999999999999e-05 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498790+0000", 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389e-05 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498881+0000", 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0780999999999997e-05 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498890+0000", 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7579999999999998e-06 2024-09-21T22:15:51.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500819+0000", 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929491 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500968+0000", 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014854199999999999 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501114+0000", 2024-09-21T22:15:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146298 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505622+0000", 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045081649999999997 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506247+0000", 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062455099999999999 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506353+0000", 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010586699999999999 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506396+0000", 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3482999999999997e-05 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:1617 3.8 3:1519a0ec:::rbd_data.1185ff358907.0000000000000063:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:51.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.5294318950000001, 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043537289999999998, 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 1617 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571561+0000", 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2350000000000002e-06 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571851+0000", 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029007799999999998 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571866+0000", 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5241e-05 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571875+0000", 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4439999999999997e-06 2024-09-21T22:15:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571949+0000", 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4082e-05 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.572140+0000", 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019105599999999999 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575746+0000", 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036054630000000002 2024-09-21T22:15:51.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575815+0000", 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9402999999999999e-05 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575912+0000", 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6726999999999997e-05 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2300 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 786432~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6011331479999997, 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035596450000000002, 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2300 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499857+0000", 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.53e-07 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499859+0000", 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499868+0000", 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.67e-06 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499881+0000", 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2542e-05 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.502658+0000", 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027775299999999998 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.502732+0000", 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3424999999999996e-05 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503417+0000", 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068504700000000004 2024-09-21T22:15:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2305 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6010729259999996, 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042464419999999996, 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2305 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499918+0000", 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499921+0000", 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7879999999999998e-06 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499932+0000", 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1629e-05 2024-09-21T22:15:51.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499940+0000", 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0590000000000003e-06 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503530+0000", 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035898150000000001 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503609+0000", 2024-09-21T22:15:51.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9284999999999997e-05 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504164+0000", 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055435700000000001 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2306 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6010408089999997, 2024-09-21T22:15:51.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004774197, 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2306 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499950+0000", 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0800000000000005e-07 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499952+0000", 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.261e-06 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499959+0000", 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499964+0000", 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504193+0000", 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004229684 2024-09-21T22:15:51.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504269+0000", 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5956000000000003e-05 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504724+0000", 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045437400000000001 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.143 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2346 3.0 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.5859880730000002, 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083135759999999996, 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2346 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515003+0000", 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-06 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515950+0000", 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094629499999999999 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515967+0000", 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7554000000000002e-05 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515974+0000", 2024-09-21T22:15:51.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516038+0000", 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3176999999999995e-05 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516167+0000", 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012979800000000001 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516306+0000", 2024-09-21T22:15:51.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138887 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522280+0000", 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059732750000000001 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523229+0000", 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094895000000000005 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523280+0000", 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1554999999999997e-05 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523316+0000", 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5602999999999998e-05 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2364 3.0 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head [write 0~983607 [fadvise_sequential+fadvise_nocache],write 1048576~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:51.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.5738625200000005, 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077052980000000002, 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2364 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:51.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527129+0000", 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527492+0000", 2024-09-21T22:15:51.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036298100000000001 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527504+0000", 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1814000000000001e-05 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527510+0000", 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4649999999999999e-06 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527564+0000", 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3893000000000001e-05 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527665+0000", 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101468 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527817+0000", 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015177100000000001 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534445+0000", 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066276169999999997 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534752+0000", 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030757499999999998 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534799+0000", 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6310000000000002e-05 2024-09-21T22:15:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534833+0000", 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341999999999997e-05 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2417 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.610922113, 2024-09-21T22:15:51.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043883469999999999, 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2417 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490070+0000", 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490081+0000", 2024-09-21T22:15:51.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0893000000000001e-05 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490099+0000", 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7648000000000001e-05 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490108+0000", 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0000000000000002e-06 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490162+0000", 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4846000000000003e-05 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490168+0000", 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7749999999999998e-06 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492060+0000", 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018918450000000001 2024-09-21T22:15:51.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492159+0000", 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8827999999999996e-05 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492338+0000", 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017905500000000001 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.493985+0000", 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016466 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494382+0000", 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039761899999999999 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494424+0000", 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1544000000000001e-05 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494456+0000", 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2706000000000002e-05 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2603 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.998715+0000", 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1022749510000001, 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003799855, 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2603 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998715+0000", 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998715+0000", 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998716+0000", 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1900000000000001e-07 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998722+0000", 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7200000000000003e-06 2024-09-21T22:15:51.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998733+0000", 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0886e-05 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998738+0000", 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2340000000000002e-06 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998786+0000", 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8343000000000001e-05 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.998841+0000", 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4945999999999999e-05 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999049+0000", 2024-09-21T22:15:51.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020736999999999999 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999645+0000", 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059646999999999999 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002452+0000", 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002806734 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002486+0000", 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4337e-05 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002515+0000", 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8996000000000002e-05 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2614 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.168 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.014953+0000", 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0860372100000002, 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036021270000000001, 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2614 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.014953+0000", 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.014953+0000", 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.014954+0000", 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.026e-06 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.014959+0000", 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1390000000000003e-06 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.014970+0000", 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1058e-05 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.014977+0000", 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2189999999999998e-06 2024-09-21T22:15:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015022+0000", 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5077999999999998e-05 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015089+0000", 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6363000000000001e-05 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015325+0000", 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023598400000000001 2024-09-21T22:15:51.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015931+0000", 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060611400000000005 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018481+0000", 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002550025 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018525+0000", 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3745000000000002e-05 2024-09-21T22:15:51.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018555+0000", 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0375999999999999e-05 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2625 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0539907749999999, 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045043440000000004, 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2625 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047001+0000", 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5939999999999999e-06 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047017+0000", 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5919000000000001e-05 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047034+0000", 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6818000000000001e-05 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047044+0000", 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0083e-05 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047129+0000", 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5205999999999997e-05 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047253+0000", 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012408699999999999 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047731+0000", 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047771700000000001 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051255+0000", 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035239619999999998 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051430+0000", 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017474 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051466+0000", 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6492999999999998e-05 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051504+0000", 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7725000000000002e-05 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2636 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0424363059999999, 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004016632, 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2636 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058555+0000", 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.398e-06 2024-09-21T22:15:51.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058563+0000", 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7379999999999994e-06 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058579+0000", 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5662999999999999e-05 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058586+0000", 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2649999999999999e-06 2024-09-21T22:15:51.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058636+0000", 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0358999999999997e-05 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058704+0000", 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8182999999999994e-05 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058948+0000", 2024-09-21T22:15:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000243322 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059681+0000", 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073306399999999996 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062499+0000", 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028180499999999999 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062534+0000", 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4799999999999999e-05 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062571+0000", 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6789999999999998e-05 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2672 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.185 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.120245+0000", 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.9807454619999998, 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003411524, 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2672 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120245+0000", 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120245+0000", 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120247+0000", 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120260+0000", 2024-09-21T22:15:51.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2424e-05 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120280+0000", 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0424999999999998e-05 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120291+0000", 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1026000000000001e-05 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120370+0000", 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8776999999999995e-05 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120490+0000", 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120319 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120836+0000", 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034526899999999999 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123410+0000", 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025747819999999999 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123550+0000", 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011899999999999 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123605+0000", 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4694999999999997e-05 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123656+0000", 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1048000000000003e-05 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2705 3.6 e34/23 3:6369496f:::rbd_data.118555b0e245.0000000000000029:head v 34'19, mlcod=31'17)", 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.182449+0000", 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.9185416740000001, 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003433705, 2024-09-21T22:15:51.191 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182449+0000", 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182449+0000", 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182449+0000", 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182474+0000", 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5462000000000001e-05 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182485+0000", 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0866999999999999e-05 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182492+0000", 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.691e-06 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182544+0000", 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2246000000000001e-05 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.182558+0000", 2024-09-21T22:15:51.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3883000000000001e-05 2024-09-21T22:15:51.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.185848+0000", 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032896570000000001 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.185882+0000", 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4586999999999999e-05 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.196 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2719 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.198459+0000", 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.9025315169999999, 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035516279999999998, 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2719 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198459+0000", 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198459+0000", 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198460+0000", 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5099999999999998e-07 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198465+0000", 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0459999999999996e-06 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198475+0000", 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0087e-05 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198481+0000", 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.161e-06 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198523+0000", 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1813000000000001e-05 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198577+0000", 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4642000000000003e-05 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198794+0000", 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021693299999999999 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201778+0000", 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029839770000000001 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201911+0000", 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013285099999999999 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201969+0000", 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7562000000000002e-05 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202010+0000", 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1604999999999999e-05 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2720 3.19 3:9f5b07a3:::rbd_data.118555b0e245.000000000000001b:head [set-alloc-hint object_size 2097152 write_size 2097152,write 574931~33822] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.202083+0000", 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8989074420000001, 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037108689999999999, 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2720 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202083+0000", 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202083+0000", 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202084+0000", 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7499999999999999e-07 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202097+0000", 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3251000000000001e-05 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202105+0000", 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7489999999999998e-06 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202109+0000", 2024-09-21T22:15:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202156+0000", 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6764000000000002e-05 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.202293+0000", 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013725400000000001 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.205633+0000", 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033402890000000002 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.205693+0000", 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9617000000000002e-05 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.205794+0000", 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010082 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.207 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2722 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8917947210000001, 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041655779999999996, 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2722 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209198+0000", 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.351e-06 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209213+0000", 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4847e-05 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209239+0000", 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6533000000000002e-05 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209252+0000", 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2998e-05 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209326+0000", 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4041999999999993e-05 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209405+0000", 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9246999999999995e-05 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209669+0000", 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026352999999999999 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.212980+0000", 2024-09-21T22:15:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033110209999999999 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213279+0000", 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029891100000000001 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213320+0000", 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0930999999999998e-05 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213361+0000", 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1167000000000001e-05 2024-09-21T22:15:51.213 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.214 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:51.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:51.216 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:51.214+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:51.316 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:51.315+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:51.318 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:51.319 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:51.319 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:51.319 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:51.328 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:51.417 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:51.416+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:51.429 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:51.429 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:51.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:51.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:51.516+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:51.546 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:51.546 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:259 3.4 e28/23 3:226e6cb4:::rbd_data.11856a5cf33b.000000000000003a:head v 28'6, mlcod=28'4)", 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7783869029999995, 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030935889999999999, 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765082+0000", 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9350000000000001e-06 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765094+0000", 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2045000000000001e-05 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765114+0000", 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9556999999999999e-05 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765136+0000", 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2257999999999999e-05 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765208+0000", 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2192000000000003e-05 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765232+0000", 2024-09-21T22:15:51.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4107000000000001e-05 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768126+0000", 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028939159999999998 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768174+0000", 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7579e-05 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.0421763330000005, 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:15:51.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0269928740000003, 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:15:51.556 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:15:51.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:15:51.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0155464360000002, 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.0 epoch 33/23 rep_tid 115 entries 33'10 (0'0) error 3:053415b0:::rbd_object_map.118555b0e245:head by client.4485.0:2367 0.000000 -17 [r=-17+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 33'8)", 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0058812579999996, 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023730000000000001, 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537586+0000", 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1900000000000002e-07 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537593+0000", 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.844e-06 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537609+0000", 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5786000000000001e-05 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537618+0000", 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8000000000000004e-06 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.537671+0000", 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3096999999999997e-05 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.539959+0000", 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878540000000002 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2603 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'36, mlcod=34'34)", 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.544343418, 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032135610000000002, 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999129+0000", 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999139+0000", 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5300000000000002e-06 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999143+0000", 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999184+0000", 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999198+0000", 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3971999999999999e-05 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002303+0000", 2024-09-21T22:15:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031052179999999999 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002337+0000", 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3992000000000003e-05 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2614 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'38, mlcod=34'36)", 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:15:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.528082473, 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002984273, 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:15:51.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015386+0000", 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6700000000000002e-07 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015392+0000", 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4999999999999996e-06 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015404+0000", 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1864e-05 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015411+0000", 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9e-06 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015478+0000", 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7067e-05 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015493+0000", 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5398000000000001e-05 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018334+0000", 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002840679 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018369+0000", 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4897999999999997e-05 2024-09-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.4956400969999999, 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:15:51.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2636 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'42, mlcod=34'40)", 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.4844488689999999, 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033367480000000001, 2024-09-21T22:15:51.582 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059019+0000", 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-06 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059029+0000", 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4509999999999998e-06 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059044+0000", 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5218000000000001e-05 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059052+0000", 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059114+0000", 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2094999999999994e-05 2024-09-21T22:15:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059139+0000", 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-05 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062305+0000", 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031661020000000001 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062355+0000", 2024-09-21T22:15:51.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0129000000000001e-05 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2649 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'47, mlcod=34'45)", 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.080962+0000", 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.4625053079999999, 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024035839999999998, 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080962+0000", 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080962+0000", 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080963+0000", 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5600000000000004e-07 2024-09-21T22:15:51.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080971+0000", 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2900000000000002e-06 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080986+0000", 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5441e-05 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.080995+0000", 2024-09-21T22:15:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3129999999999999e-06 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.081049+0000", 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4256999999999999e-05 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.081071+0000", 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2140000000000001e-05 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.083332+0000", 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022607700000000001 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.083365+0000", 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3417000000000002e-05 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2651 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'48, mlcod=34'46)", 2024-09-21T22:15:51.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.085290+0000", 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.458177209, 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024552279999999998, 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085290+0000", 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085290+0000", 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085291+0000", 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7499999999999999e-07 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085297+0000", 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2659999999999998e-06 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085310+0000", 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3587999999999999e-05 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085327+0000", 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6215999999999999e-05 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085376+0000", 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9147000000000002e-05 2024-09-21T22:15:51.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.085396+0000", 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0001e-05 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.087704+0000", 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00230861 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.087745+0000", 2024-09-21T22:15:51.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0624999999999998e-05 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2659 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'49, mlcod=34'47)", 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.44612097, 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024912200000000002, 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097347+0000", 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097357+0000", 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9040000000000004e-06 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097375+0000", 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8284999999999999e-05 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097389+0000", 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3053e-05 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097438+0000", 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9184999999999997e-05 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097456+0000", 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8022000000000001e-05 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.099805+0000", 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023490479999999998 2024-09-21T22:15:51.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.099837+0000", 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2487000000000003e-05 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2672 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'52, mlcod=34'50)", 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.4225328250000002, 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024984180000000001, 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120935+0000", 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.034e-06 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120944+0000", 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9120000000000004e-06 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120957+0000", 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2398999999999999e-05 2024-09-21T22:15:51.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120964+0000", 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0480000000000001e-06 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.121020+0000", 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6514999999999997e-05 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.121038+0000", 2024-09-21T22:15:51.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8105999999999999e-05 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123389+0000", 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023506930000000001 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123433+0000", 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3711000000000002e-05 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2681 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'53, mlcod=34'51)", 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.4151074980000002, 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024865360000000001, 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128361+0000", 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.850000000000001e-07 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128371+0000", 2024-09-21T22:15:51.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0293e-05 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128384+0000", 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3546e-05 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128393+0000", 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2090000000000005e-06 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128440+0000", 2024-09-21T22:15:51.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7120999999999998e-05 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128456+0000", 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6503000000000001e-05 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.130815+0000", 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023583419999999998 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.130846+0000", 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1537e-05 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2699 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'58, mlcod=34'56)", 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.171904+0000", 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.3715630669999999, 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023824670000000001, 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.609 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171904+0000", 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171904+0000", 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171905+0000", 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8299999999999997e-07 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171912+0000", 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9840000000000004e-06 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171921+0000", 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5040000000000008e-06 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171927+0000", 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171973+0000", 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5045e-05 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.171990+0000", 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7037999999999998e-05 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.174239+0000", 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022490349999999999 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.174286+0000", 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7824999999999997e-05 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2719 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'64, mlcod=34'62)", 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.3446176090000002, 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029567959999999998, 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198850+0000", 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6599999999999995e-07 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198855+0000", 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2939999999999996e-06 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198866+0000", 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0239e-05 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198873+0000", 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198927+0000", 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4548e-05 2024-09-21T22:15:51.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198949+0000", 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2243999999999999e-05 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201757+0000", 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028075700000000001 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201806+0000", 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9258000000000002e-05 2024-09-21T22:15:51.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.3337052910000002, 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2835 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'85, mlcod=34'83)", 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:15:51.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1946880580000001, 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002476645, 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348780+0000", 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.311e-06 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348791+0000", 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0257e-05 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348808+0000", 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7546000000000001e-05 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348817+0000", 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3090000000000001e-06 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348881+0000", 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3615999999999995e-05 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348908+0000", 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7483000000000001e-05 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.351202+0000", 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022931449999999999 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.351256+0000", 2024-09-21T22:15:51.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3977999999999997e-05 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2839 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'86, mlcod=34'84)", 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.358196+0000", 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1852711220000001, 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002391458, 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358196+0000", 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358196+0000", 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358198+0000", 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7269999999999999e-06 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358208+0000", 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0832000000000001e-05 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358227+0000", 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8156e-05 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358234+0000", 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3440000000000003e-06 2024-09-21T22:15:51.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358299+0000", 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4839999999999996e-05 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.358316+0000", 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7564999999999999e-05 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.360546+0000", 2024-09-21T22:15:51.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022292150000000001 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.360587+0000", 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1779000000000001e-05 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2876 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'90, mlcod=34'88)", 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.400229+0000", 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1432376290000001, 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023360830000000001, 2024-09-21T22:15:51.631 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400229+0000", 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400229+0000", 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400230+0000", 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9500000000000002e-07 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400236+0000", 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8660000000000002e-06 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400247+0000", 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1243000000000001e-05 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400254+0000", 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6610000000000003e-06 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400298+0000", 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4282000000000001e-05 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.400316+0000", 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7961999999999998e-05 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.402524+0000", 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022080060000000002 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.402565+0000", 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1368000000000001e-05 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:51.635 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:51.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:51.637 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:51.636+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:51.659 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-21T22:15:51.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:51.737+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:51.754 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:51.754 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:51.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:51.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:51.837+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:51.862 INFO:teuthology.orchestra.run.smithi134.stdout:688 write 0x74fd037 thru 0x750896b (0xb935 bytes) 2024-09-21T22:15:51.868 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:51.868 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:51.868 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:51.868 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:51.868 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:51.871 INFO:teuthology.orchestra.run.smithi134.stdout:690 trunc from 0xd2bcfff to 0xe22a712 2024-09-21T22:15:51.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:51.887 INFO:teuthology.orchestra.run.smithi134.stdout:691 trunc from 0xe22a712 to 0x75968a0 2024-09-21T22:15:51.912 INFO:teuthology.orchestra.run.smithi134.stdout:692 writesame 0x6b6ffa thru 0x6bdf37 data_size 0x1d(0x6f3e bytes) 2024-09-21T22:15:51.913 INFO:teuthology.orchestra.run.smithi134.stdout:693 read 0x731884b thru 0x731c593 (0x3d49 bytes) 2024-09-21T22:15:51.924 INFO:teuthology.orchestra.run.smithi134.stdout:694 writesame 0xab32794 thru 0xab339d1 data_size 0x5(0x123e bytes) 2024-09-21T22:15:51.930 INFO:teuthology.orchestra.run.smithi134.stdout:696 write 0xb469177 thru 0xb46d407 (0x4291 bytes) 2024-09-21T22:15:51.933 INFO:teuthology.orchestra.run.smithi134.stdout:697 read 0xaad7bf4 thru 0xaadfe95 (0x82a2 bytes) 2024-09-21T22:15:51.933 INFO:teuthology.orchestra.run.smithi134.stdout:698 read 0x7931ec2 thru 0x7941ab3 (0xfbf2 bytes) 2024-09-21T22:15:51.933 INFO:teuthology.orchestra.run.smithi134.stdout:701 write 0x49839ea thru 0x4987dc7 (0x43de bytes) 2024-09-21T22:15:51.935 INFO:teuthology.orchestra.run.smithi134.stdout:703 read 0x8804d13 thru 0x8813bf0 (0xeede bytes) 2024-09-21T22:15:51.939 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:51.939+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:51.946 INFO:teuthology.orchestra.run.smithi134.stdout:704 write 0xcdf0685 thru 0xcdf96ac (0x9028 bytes) 2024-09-21T22:15:51.949 INFO:teuthology.orchestra.run.smithi134.stdout:706 write 0x84f69c5 thru 0x850266c (0xbca8 bytes) 2024-09-21T22:15:51.952 INFO:teuthology.orchestra.run.smithi134.stdout:707 read 0x92e2f42 thru 0x92ed82c (0xa8eb bytes) 2024-09-21T22:15:51.952 INFO:teuthology.orchestra.run.smithi134.stdout:708 read 0x5eed3da thru 0x5eee7ce (0x13f5 bytes) 2024-09-21T22:15:51.958 INFO:teuthology.orchestra.run.smithi134.stdout:709 writesame 0xd07d16e thru 0xd07e8f8 data_size 0x15(0x178b bytes) 2024-09-21T22:15:51.958 INFO:teuthology.orchestra.run.smithi134.stdout:710 read 0xa8f9555 thru 0xa8fbf3c (0x29e8 bytes) 2024-09-21T22:15:51.959 INFO:teuthology.orchestra.run.smithi134.stdout:713 punch from 0x4b4cb3e to 0x4b58eeb, (0xc3ad bytes) 2024-09-21T22:15:51.959 INFO:teuthology.orchestra.run.smithi134.stdout:714 read 0x5062202 thru 0x5068aa0 (0x689f bytes) 2024-09-21T22:15:51.972 INFO:teuthology.orchestra.run.smithi134.stdout:715 trunc from 0xd07e8f9 to 0x12cd675 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1592 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1212416~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564031+0000", 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4276710559999994, 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093070770000000004, 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:51.994 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1592 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564031+0000", 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564031+0000", 2024-09-21T22:15:51.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564031+0000", 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564032+0000", 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.398e-06 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564037+0000", 2024-09-21T22:15:51.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3900000000000003e-06 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564042+0000", 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573180+0000", 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091384810000000004 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:51.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573241+0000", 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0574e-05 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573338+0000", 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7045000000000003e-05 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1593 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1277952~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564048+0000", 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4276543289999992, 2024-09-21T22:15:51.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095023529999999998, 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1593 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564048+0000", 2024-09-21T22:15:51.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564048+0000", 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564048+0000", 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564050+0000", 2024-09-21T22:15:52.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0710000000000002e-06 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564056+0000", 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2380000000000002e-06 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564061+0000", 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.437e-06 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573372+0000", 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093110769999999992 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573459+0000", 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7008000000000004e-05 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573550+0000", 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1073e-05 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.002 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1594 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1343488~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4276350640000004, 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097734940000000006, 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.003 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1594 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564069+0000", 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564080+0000", 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1171e-05 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564083+0000", 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573614+0000", 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095306309999999995 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573740+0000", 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000125549 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573840+0000", 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100825 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1595 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1409024~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4276130949999999, 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0099579890000000004, 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.007 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1595 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:15:52.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564092+0000", 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3319999999999999e-06 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564098+0000", 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1079999999999998e-06 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564102+0000", 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573875+0000", 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097733290000000007 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573950+0000", 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4399000000000004e-05 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574047+0000", 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7082000000000003e-05 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1596 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1474560~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4275944480000007, 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010121099, 2024-09-21T22:15:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1596 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564108+0000", 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.41e-07 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564110+0000", 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0810000000000001e-06 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564116+0000", 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0689999999999998e-06 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564122+0000", 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574087+0000", 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0099650099999999998 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574163+0000", 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6147000000000001e-05 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574229+0000", 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5718999999999999e-05 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1597 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1540096~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4275605490000007, 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010324866, 2024-09-21T22:15:52.015 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1597 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:15:52.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564142+0000", 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6000000000000004e-07 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564144+0000", 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2029999999999999e-06 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564151+0000", 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3489999999999997e-06 2024-09-21T22:15:52.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564156+0000", 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1399999999999999e-06 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574271+0000", 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010115017 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574355+0000", 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4820000000000004e-05 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574466+0000", 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110777 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1598 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4275395199999998, 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010531304999999999, 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.019 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1598 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564163+0000", 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4799999999999999e-07 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564165+0000", 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564171+0000", 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564176+0000", 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574511+0000", 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010335075000000001 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574600+0000", 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9220000000000003e-05 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574694+0000", 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3848e-05 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1599 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1671168~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4275204499999994, 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010750302, 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1599 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564182+0000", 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564184+0000", 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9539999999999998e-06 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564190+0000", 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.494e-06 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564195+0000", 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999999e-06 2024-09-21T22:15:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574732+0000", 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010537556999999999 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574816+0000", 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4146000000000004e-05 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574932+0000", 2024-09-21T22:15:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011539099999999999 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4275000129999995, 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:15:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:15:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4274580080000003, 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:15:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4273605459999992, 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:15:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4273054900000002, 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4272634840000009, 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:15:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:15:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4272028859999999, 2024-09-21T22:15:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:15:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4271806930000004, 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:15:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:15:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4262758859999991, 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1670 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 3702784~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.577542+0000", 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4141599849999995, 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091713899999999998, 2024-09-21T22:15:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1670 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.577542+0000", 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.577542+0000", 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.577542+0000", 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.577545+0000", 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2239999999999998e-06 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.577560+0000", 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5665999999999999e-05 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.577566+0000", 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1739999999999997e-06 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.586322+0000", 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0087558270000000007 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.586402+0000", 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9788000000000002e-05 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.586713+0000", 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031132399999999998 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:15:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.4708411540000004, 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.4677019119999999, 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:15:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2737 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:15:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.7646714340000003, 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010753749, 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2737 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0999999999999997e-07 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227036+0000", 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227046+0000", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227051+0000", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000004e-06 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227099+0000", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7920000000000002e-05 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227152+0000", 2024-09-21T22:15:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2753000000000001e-05 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.228909+0000", 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017568519999999999 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237712+0000", 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088031670000000006 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237722+0000", 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0478e-05 2024-09-21T22:15:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237750+0000", 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7885000000000002e-05 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237784+0000", 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4186000000000001e-05 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.078 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:52.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:15:52.081 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:52.079+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:52.082 INFO:teuthology.orchestra.run.smithi134.stdout:718 write 0xba54616 thru 0xba59845 (0x5230 bytes) 2024-09-21T22:15:52.082 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:52.082 INFO:teuthology.orchestra.run.smithi134.stdout:720 trunc from 0xba59846 to 0x2b02944 2024-09-21T22:15:52.082 INFO:teuthology.orchestra.run.smithi134.stdout:723 writesame 0x21b6edf thru 0x21bc19f data_size 0x13(0x52c1 bytes) 2024-09-21T22:15:52.082 INFO:teuthology.orchestra.run.smithi134.stdout:725 write 0x48a5e13 thru 0x48b4b2c (0xed1a bytes) 2024-09-21T22:15:52.082 INFO:teuthology.orchestra.run.smithi134.stdout:726 punch from 0x3469989 to 0x346a3ec, (0xa63 bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:728 writesame 0xb29174c thru 0xb29c892 data_size 0x1(0xb147 bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:729 trunc from 0xb29c893 to 0xc795cbd 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:730 punch from 0x6b38b0c to 0x6b469d4, (0xdec8 bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:731 punch from 0xb6357cb to 0xb63d432, (0x7c67 bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:733 writesame 0xa8c8715 thru 0xa8cbfcf data_size 0x3(0x38bb bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:735 write 0x98a762d thru 0x98af86e (0x8242 bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:736 write 0xcf72bef thru 0xcf81033 (0xe445 bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:737 punch from 0x6d7e8d9 to 0x6d8a81e, (0xbf45 bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:739 read 0x6298b48 thru 0x629daa1 (0x4f5a bytes) 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:52.083 INFO:teuthology.orchestra.run.smithi134.stdout:742 write 0x401e4b thru 0x409491 (0x7647 bytes) 2024-09-21T22:15:52.085 INFO:teuthology.orchestra.run.smithi134.stdout:743 punch from 0xca2aed7 to 0xca30093, (0x51bc bytes) 2024-09-21T22:15:52.085 INFO:teuthology.orchestra.run.smithi134.stdout:745 punch from 0x81d5a86 to 0x81dc4bb, (0x6a35 bytes) 2024-09-21T22:15:52.087 INFO:teuthology.orchestra.run.smithi134.stdout:746 trunc from 0xcf81034 to 0xb69581f 2024-09-21T22:15:52.097 INFO:teuthology.orchestra.run.smithi134.stdout:747 write 0x6c7308f thru 0x6c7dd70 (0xace2 bytes) 2024-09-21T22:15:52.102 INFO:teuthology.orchestra.run.smithi134.stdout:748 read 0x7860bea thru 0x786d8ae (0xccc5 bytes) 2024-09-21T22:15:52.109 INFO:teuthology.orchestra.run.smithi134.stdout:750 writesame 0xd57aab7 thru 0xd589e5f data_size 0x31(0xf3a9 bytes) 2024-09-21T22:15:52.109 INFO:teuthology.orchestra.run.smithi134.stdout:751 read 0xafe5a13 thru 0xafe74ec (0x1ada bytes) 2024-09-21T22:15:52.109 INFO:teuthology.orchestra.run.smithi134.stdout:752 punch from 0x7a9d5f5 to 0x7aaa457, (0xce62 bytes) 2024-09-21T22:15:52.109 INFO:teuthology.orchestra.run.smithi134.stdout:753 punch from 0x6d84dce to 0x6d91b5e, (0xcd90 bytes) 2024-09-21T22:15:52.110 INFO:teuthology.orchestra.run.smithi134.stdout:755 write 0xd523580 thru 0xd5327ae (0xf22f bytes) 2024-09-21T22:15:52.113 INFO:teuthology.orchestra.run.smithi134.stdout:756 read 0x9631bbe thru 0x9635a1d (0x3e60 bytes) 2024-09-21T22:15:52.113 INFO:teuthology.orchestra.run.smithi134.stdout:757 punch from 0x4d22058 to 0x4d2c172, (0xa11a bytes) 2024-09-21T22:15:52.113 INFO:teuthology.orchestra.run.smithi134.stdout:758 writesame 0x65006a1 thru 0x65049d5 data_size 0x5d(0x4335 bytes) 2024-09-21T22:15:52.115 INFO:teuthology.orchestra.run.smithi134.stdout:760 read 0x884d031 thru 0x885bec0 (0xee90 bytes) 2024-09-21T22:15:52.115 INFO:teuthology.orchestra.run.smithi134.stdout:761 read 0xaf90657 thru 0xaf98220 (0x7bca bytes) 2024-09-21T22:15:52.115 INFO:teuthology.orchestra.run.smithi134.stdout:762 write 0x5733dd6 thru 0x574179c (0xd9c7 bytes) 2024-09-21T22:15:52.117 INFO:teuthology.orchestra.run.smithi134.stdout:763 write 0xa601ce5 thru 0xa603bf3 (0x1f0f bytes) 2024-09-21T22:15:52.119 INFO:teuthology.orchestra.run.smithi134.stdout:765 punch from 0x36bdac1 to 0x36c5adb, (0x801a bytes) 2024-09-21T22:15:52.119 INFO:teuthology.orchestra.run.smithi134.stdout:767 write 0x972c4e0 thru 0x9732f04 (0x6a25 bytes) 2024-09-21T22:15:52.122 INFO:teuthology.orchestra.run.smithi134.stdout:768 writesame 0x18aa9b9 thru 0x18acae9 data_size 0x1(0x2131 bytes) 2024-09-21T22:15:52.127 INFO:teuthology.orchestra.run.smithi134.stdout:770 writesame 0x8131bb2 thru 0x813df83 data_size 0x12(0xc3d2 bytes) 2024-09-21T22:15:52.131 INFO:teuthology.orchestra.run.smithi134.stdout:771 writesame 0x49182c9 thru 0x492332d data_size 0x1(0xb065 bytes) 2024-09-21T22:15:52.147 INFO:teuthology.orchestra.run.smithi134.stdout:772 write 0x52de255 thru 0x52e4484 (0x6230 bytes) 2024-09-21T22:15:52.151 INFO:teuthology.orchestra.run.smithi134.stdout:773 read 0xab2b22 thru 0xab54d2 (0x29b1 bytes) 2024-09-21T22:15:52.151 INFO:teuthology.orchestra.run.smithi134.stdout:774 punch from 0xa4ee209 to 0xa4fcc56, (0xea4d bytes) 2024-09-21T22:15:52.151 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:52.151 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:52.158 INFO:teuthology.orchestra.run.smithi134.stdout:777 writesame 0xe3e64f4 thru 0xe3f43cf data_size 0x22(0xdedc bytes) 2024-09-21T22:15:52.158 INFO:teuthology.orchestra.run.smithi134.stdout:778 writesame 0x8b09af5 thru 0x8b1631b data_size 0x1(0xc827 bytes) 2024-09-21T22:15:52.176 INFO:teuthology.orchestra.run.smithi134.stdout:779 punch from 0x6df40f2 to 0x6dfc664, (0x8572 bytes) 2024-09-21T22:15:52.176 INFO:teuthology.orchestra.run.smithi134.stdout:780 punch from 0x1468aa7 to 0x146b51f, (0x2a78 bytes) 2024-09-21T22:15:52.176 INFO:teuthology.orchestra.run.smithi134.stdout:781 read 0xad024ef thru 0xad0519c (0x2cae bytes) 2024-09-21T22:15:52.176 INFO:teuthology.orchestra.run.smithi134.stdout:782 write 0xd72693c thru 0xd72dc4c (0x7311 bytes) 2024-09-21T22:15:52.179 INFO:teuthology.orchestra.run.smithi134.stdout:783 read 0xa324b8 thru 0xa350be (0x2c07 bytes) 2024-09-21T22:15:52.179 INFO:teuthology.orchestra.run.smithi134.stdout:784 write 0x7270baa thru 0x7271132 (0x589 bytes) 2024-09-21T22:15:52.179 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:52.179+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:52.180 INFO:teuthology.orchestra.run.smithi134.stdout:785 clone 4 order 22 su 32768 sc 7 2024-09-21T22:15:52.233 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:52.233 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:52.233 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:52.233 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:52.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:15:52.283 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:52.282+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:52.382 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:52.381+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:52.385 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:52.385 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:52.385 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:52.385 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:52.385 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:52.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:15:52.482 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:52.482+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:52.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:15:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1433 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 2916352~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9947759240000007, 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019321876000000002, 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.541 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1433 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543850+0000", 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9999999999999998e-07 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543852+0000", 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3080000000000002e-06 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543859+0000", 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6030000000000001e-06 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543865+0000", 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.173e-06 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562995+0000", 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019130261999999999 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563071+0000", 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6055000000000003e-05 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563171+0000", 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9975000000000004e-05 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1434 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 2981888~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9947531319999996, 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019712555, 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.545 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1434 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543873+0000", 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.39e-07 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543876+0000", 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1520000000000001e-06 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543882+0000", 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9290000000000003e-06 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543887+0000", 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.118e-06 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563381+0000", 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019494177000000001 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563476+0000", 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5427999999999995e-05 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563585+0000", 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108312 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.549 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1435 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3047424~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9947319720000003, 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019941364999999999, 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.550 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1435 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543894+0000", 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543896+0000", 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543948+0000", 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2201999999999999e-05 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544048+0000", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9625999999999998e-05 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563634+0000", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019586076000000001 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563723+0000", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8473999999999994e-05 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563835+0000", 2024-09-21T22:15:52.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011205900000000001 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1436 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3112960~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9945650669999999, 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019987041000000001, 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.554 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1436 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544061+0000", 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544064+0000", 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4489999999999999e-06 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544072+0000", 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.311e-06 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544077+0000", 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563868+0000", 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019791362999999999 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563944+0000", 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6064999999999998e-05 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564047+0000", 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010273299999999999 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1437 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3178496~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9945405750000003, 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020126950000000001, 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.558 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1437 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.27e-07 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544087+0000", 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2079999999999999e-06 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544093+0000", 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.874e-06 2024-09-21T22:15:52.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544098+0000", 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6650000000000002e-06 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564082+0000", 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019984483000000001 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564150+0000", 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7430999999999999e-05 2024-09-21T22:15:52.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1861999999999998e-05 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1438 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3244032~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9945172880000008, 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020359434999999999, 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.562 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1438 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544111+0000", 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544117+0000", 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544122+0000", 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7060000000000003e-06 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564258+0000", 2024-09-21T22:15:52.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020136582 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564347+0000", 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9288000000000003e-05 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564467+0000", 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000119948 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1439 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3309568~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9944967410000007, 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020562668999999999, 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1439 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.567 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:52.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5300000000000004e-07 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544131+0000", 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544137+0000", 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9519999999999999e-06 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544142+0000", 2024-09-21T22:15:52.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7550000000000002e-06 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564501+0000", 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020358883000000001 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564581+0000", 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0351000000000004e-05 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564691+0000", 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110195 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1440 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3375104~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9944748499999996, 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020796948999999999, 2024-09-21T22:15:52.571 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1440 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544151+0000", 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.82e-07 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544153+0000", 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.869e-06 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544159+0000", 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5769999999999999e-06 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544199+0000", 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9601999999999998e-05 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564737+0000", 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020537581999999999 2024-09-21T22:15:52.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564838+0000", 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101467 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564947+0000", 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010937 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.575 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1441 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3440640~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9944089080000005, 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020999262000000001, 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1441 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544217+0000", 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5700000000000001e-07 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544222+0000", 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3599999999999998e-06 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544232+0000", 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0233e-05 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544239+0000", 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0079999999999996e-06 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564996+0000", 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020757512999999998 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565085+0000", 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8566000000000006e-05 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565216+0000", 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013072499999999999 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1442 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3506176~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9943752779999997, 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021211990999999999, 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1442 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544251+0000", 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.99e-07 2024-09-21T22:15:52.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544253+0000", 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5909999999999998e-06 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544260+0000", 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544265+0000", 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1850000000000003e-06 2024-09-21T22:15:52.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565255+0000", 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020989622999999999 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565344+0000", 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9011999999999994e-05 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565462+0000", 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000118273 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1443 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3571712~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9943532630000007, 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021376223, 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1443 2024-09-21T22:15:52.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:52.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0399999999999996e-07 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544275+0000", 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3080000000000002e-06 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544281+0000", 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1460000000000001e-06 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544286+0000", 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6e-06 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565493+0000", 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021207777000000001 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565565+0000", 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1815000000000003e-05 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565648+0000", 2024-09-21T22:15:52.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3072999999999996e-05 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1444 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3637248~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9943332520000006, 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021549170999999999, 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.588 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1444 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544295+0000", 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1430000000000001e-06 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544301+0000", 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2079999999999997e-06 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544306+0000", 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565677+0000", 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021371547000000001 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565749+0000", 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1886999999999998e-05 2024-09-21T22:15:52.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565841+0000", 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1978999999999995e-05 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1445 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3702784~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.994312399, 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021733944000000002, 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.592 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1445 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:52.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2399999999999998e-07 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544315+0000", 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9659999999999999e-06 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544322+0000", 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4999999999999996e-06 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544327+0000", 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6999999999999999e-06 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565870+0000", 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021543715000000001 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565944+0000", 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3851999999999997e-05 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566047+0000", 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102687 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1446 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3768320~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9942924089999998, 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021911746999999999, 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1446 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:52.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1300000000000001e-07 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544337+0000", 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6069999999999999e-06 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544343+0000", 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9580000000000004e-06 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544348+0000", 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7450000000000003e-06 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566076+0000", 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021728313999999999 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566150+0000", 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4344000000000005e-05 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566245+0000", 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4365999999999997e-05 2024-09-21T22:15:52.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1447 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3833856~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9942714759999998, 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022083714000000001, 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1447 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8500000000000002e-07 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544356+0000", 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544362+0000", 2024-09-21T22:15:52.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9610000000000002e-06 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544367+0000", 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5569999999999997e-06 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566274+0000", 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021907115000000001 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566345+0000", 2024-09-21T22:15:52.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1316000000000006e-05 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566437+0000", 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2151000000000006e-05 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1448 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3899392~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9942522999999994, 2024-09-21T22:15:52.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022306970999999998, 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1448 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544375+0000", 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9609999999999999e-06 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544382+0000", 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1589999999999998e-06 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544387+0000", 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566493+0000", 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022106832 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566569+0000", 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5507999999999996e-05 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566680+0000", 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111055 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1449 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3964928~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:52.609 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9942325440000008, 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022531059999999999, 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1449 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:52.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544399+0000", 2024-09-21T22:15:52.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8379999999999998e-06 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544405+0000", 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4400000000000002e-06 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544411+0000", 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0510000000000002e-06 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566730+0000", 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022318521000000001 2024-09-21T22:15:52.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566818+0000", 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8342000000000002e-05 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566924+0000", 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010549500000000001 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.613 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1450 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4030464~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9942070980000004, 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022739365000000001, 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1450 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544419+0000", 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9999999999999997e-07 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544421+0000", 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2850000000000001e-06 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544428+0000", 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.849e-06 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544433+0000", 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566967+0000", 2024-09-21T22:15:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022534667000000001 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567064+0000", 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6525000000000002e-05 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567158+0000", 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3738000000000003e-05 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1451 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4096000~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9941864870000003, 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022898399, 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1451 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544441+0000", 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0499999999999999e-06 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544452+0000", 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.113e-05 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544458+0000", 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9610000000000002e-06 2024-09-21T22:15:52.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567187+0000", 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022728190999999998 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567254+0000", 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7662000000000004e-05 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567337+0000", 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2976e-05 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1452 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4161536~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.9941580830000003, 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.024156477999999999, 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:52.622 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1452 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:52.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544468+0000", 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544470+0000", 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7499999999999999e-06 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544478+0000", 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2969999999999998e-06 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544483+0000", 2024-09-21T22:15:52.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8099999999999997e-06 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567626+0000", 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023143009999999999 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567708+0000", 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2111e-05 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.568624+0000", 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00091596899999999998 2024-09-21T22:15:52.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.626 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.626 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.626 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:52.626 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:52.626 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:52.627 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:52.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:52.626+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:52.728 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:52.726+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:52.772 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:52.772 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:52.772 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:52.772 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:52.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:52.828 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:52.827+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:52.878 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:15:52.888 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:52.888 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:52.888 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:52.888 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:52.888 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:52.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:52.939 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:52.938+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:52.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:15:53.030 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:53.029+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:53.043 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:419 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 11.108164888999999, 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040014170000000002, 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.044 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 419 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933668+0000", 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.378e-06 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933675+0000", 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.109e-06 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933688+0000", 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3291e-05 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933695+0000", 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3520000000000001e-06 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933760+0000", 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4488999999999999e-05 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933846+0000", 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6199999999999995e-05 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933963+0000", 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000116937 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934556+0000", 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059266699999999996 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937613+0000", 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030571660000000001 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937641+0000", 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8381000000000002e-05 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937668+0000", 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6446999999999999e-05 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1020 3.1e 3:7af2d16a:::rbd_data.1185ff358907.0000000000000007:head [write 0~725994 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:53.049 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.533647363, 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067157170000000004, 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1020 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508185+0000", 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4920000000000001e-06 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509567+0000", 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0013821510000000001 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509585+0000", 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7813e-05 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509595+0000", 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9499999999999996e-06 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509669+0000", 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4260999999999999e-05 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509678+0000", 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6139999999999992e-06 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.512690+0000", 2024-09-21T22:15:53.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030124510000000002 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.512850+0000", 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000159271 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514765+0000", 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001915588 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514820+0000", 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4586000000000002e-05 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514899+0000", 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9540000000000001e-05 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.055 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1533 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 557056~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.4829658709999993, 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035474220000000002, 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1533 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558867+0000", 2024-09-21T22:15:53.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2669999999999999e-06 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558870+0000", 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2310000000000001e-06 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558873+0000", 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6479999999999999e-06 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562187+0000", 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003314862 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562265+0000", 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7714999999999997e-05 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562413+0000", 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014747800000000001 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.059 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1534 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 622592~20078 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.4829552249999995, 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040238330000000001, 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.060 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1534 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.22e-07 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558877+0000", 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0049999999999999e-06 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558880+0000", 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2179999999999999e-06 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558884+0000", 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.19e-06 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562450+0000", 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035664540000000002 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562575+0000", 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000125458 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562900+0000", 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032428600000000002 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1535 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.4829444140000003, 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042382110000000004, 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.064 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1535 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558888+0000", 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.122e-06 2024-09-21T22:15:53.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558891+0000", 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2650000000000001e-06 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558894+0000", 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.278e-06 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562932+0000", 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040381100000000001 2024-09-21T22:15:53.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563001+0000", 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9669e-05 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563125+0000", 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012355299999999999 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2140 3.1e 3:7fdd8e08:::rbd_header.118555b0e245:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.478417+0000", 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.5634138819999999, 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009158678, 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2140 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478417+0000", 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478417+0000", 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478419+0000", 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:15:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478431+0000", 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1471000000000001e-05 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478456+0000", 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.497e-05 2024-09-21T22:15:53.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478466+0000", 2024-09-21T22:15:53.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0424999999999999e-05 2024-09-21T22:15:53.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478531+0000", 2024-09-21T22:15:53.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4434e-05 2024-09-21T22:15:53.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:53.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478535+0000", 2024-09-21T22:15:53.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:15:53.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.484378+0000", 2024-09-21T22:15:53.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428159999999998 2024-09-21T22:15:53.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.484452+0000", 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4274000000000001e-05 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.487499+0000", 2024-09-21T22:15:53.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030467739999999999 2024-09-21T22:15:53.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.487531+0000", 2024-09-21T22:15:53.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1915999999999997e-05 2024-09-21T22:15:53.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.487576+0000", 2024-09-21T22:15:53.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4879999999999997e-05 2024-09-21T22:15:53.077 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.077 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2298 3.1e 3:7af2d16a:::rbd_data.1185ff358907.0000000000000007:5 [sparse-read 262144~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.499675+0000", 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.542155739, 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033023420000000002, 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.078 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2298 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.499675+0000", 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.499675+0000", 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.499676+0000", 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7900000000000007e-07 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.499681+0000", 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7419999999999997e-06 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.499693+0000", 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1871e-05 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.499701+0000", 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.502179+0000", 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024777330000000002 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.502276+0000", 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7731000000000003e-05 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.502978+0000", 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00070147000000000004 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.082 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2324 3.1e 3:7af2d16a:::rbd_data.1185ff358907.0000000000000007:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.500429+0000", 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.5414022840000001, 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033214619999999999, 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2324 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500429+0000", 2024-09-21T22:15:53.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500429+0000", 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500430+0000", 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.75e-07 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500434+0000", 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.617e-06 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500454+0000", 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0220999999999998e-05 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500463+0000", 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8650000000000007e-06 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.503010+0000", 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025466180000000001 2024-09-21T22:15:53.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.503088+0000", 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8015000000000004e-05 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.503750+0000", 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00066245099999999999 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.086 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2363 3.1e 3:7e684fc1:::rbd_data.118555b0e245.0000000000000007:head [write 0~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.523781+0000", 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.5180501680000003, 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044354340000000003, 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2363 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.523781+0000", 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.523781+0000", 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.523783+0000", 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6249999999999999e-06 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524847+0000", 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010643390000000001 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524870+0000", 2024-09-21T22:15:53.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3074999999999998e-05 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524882+0000", 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1564e-05 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.525044+0000", 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016197 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.525430+0000", 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038648799999999999 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.528076+0000", 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026454999999999998 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.528142+0000", 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6672000000000001e-05 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.528216+0000", 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4201000000000003e-05 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2420 3.1e 3:7fdd8e08:::rbd_header.118555b0e245:head [watch unwatch cookie 140355169389984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5460055390000003, 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005387172, 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.092 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2420 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.89e-07 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495828+0000", 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9209999999999999e-06 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495837+0000", 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0389999999999993e-06 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495843+0000", 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0639999999999999e-06 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496026+0000", 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000183086 2024-09-21T22:15:53.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496077+0000", 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0556999999999997e-05 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501060+0000", 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0049835820000000003 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501127+0000", 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6953999999999996e-05 2024-09-21T22:15:53.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501213+0000", 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5580000000000004e-05 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2421 3.1e 3:7fdd8e08:::rbd_header.118555b0e245:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:47.496067+0000", 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5457638820000001, 2024-09-21T22:15:53.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0052920240000000002, 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2421 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496067+0000", 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496067+0000", 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496068+0000", 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496071+0000", 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496077+0000", 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7390000000000002e-06 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496081+0000", 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8290000000000001e-06 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496317+0000", 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023590699999999999 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496373+0000", 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6517000000000001e-05 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501244+0000", 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048704730000000002 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501290+0000", 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5550999999999998e-05 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501359+0000", 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9747999999999997e-05 2024-09-21T22:15:53.102 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:3051 3.1e 3:7e684fc1:::rbd_data.118555b0e245.0000000000000007:head [delete] snapc 6=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.660794+0000", 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.3810372730000005, 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068941260000000004, 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.103 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 3051 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660794+0000", 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660794+0000", 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660796+0000", 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660807+0000", 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0866999999999999e-05 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660843+0000", 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6633e-05 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660864+0000", 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0859000000000001e-05 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661524+0000", 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00065968199999999998 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.662153+0000", 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062923700000000005 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667536+0000", 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053826739999999996 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667592+0000", 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:15:53.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667688+0000", 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5662999999999995e-05 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:3054 3.a 3:56eb0f72:::rbd_data.118555b0e245.000000000000000b:head [delete] snapc 6=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.661477+0000", 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.380354165, 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063515710000000003, 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.108 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 3054 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661477+0000", 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661477+0000", 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661478+0000", 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661482+0000", 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0180000000000003e-06 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661491+0000", 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8169999999999994e-06 2024-09-21T22:15:53.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661578+0000", 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6819999999999999e-05 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661685+0000", 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106277 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661765+0000", 2024-09-21T22:15:53.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0061000000000005e-05 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661870+0000", 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010555700000000001 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664579+0000", 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002709052 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667735+0000", 2024-09-21T22:15:53.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003156177 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667783+0000", 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7215000000000001e-05 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667829+0000", 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5908000000000002e-05 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:3063 3.10 3:0f4d94e8:::rbd_data.118555b0e245.0000000000000023:head [delete] snapc 6=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.664848+0000", 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.3769831320000003, 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0054606630000000001, 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 3063 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664848+0000", 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664848+0000", 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664849+0000", 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.33e-06 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664858+0000", 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7709999999999995e-06 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664873+0000", 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4610000000000001e-05 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664881+0000", 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1510000000000004e-06 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664928+0000", 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6745000000000001e-05 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664998+0000", 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0557999999999998e-05 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.665120+0000", 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178799999999999 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.669820+0000", 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0047001159999999998 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.670201+0000", 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000380663 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.670263+0000", 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2629e-05 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.670309+0000", 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5302000000000001e-05 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4403 3.a 3:5152097f:::rbd_data.1185e2328614.0000000000000029:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:51.894032+0000", 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.147799059, 2024-09-21T22:15:53.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0086112310000000004, 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4403 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894032+0000", 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894032+0000", 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894034+0000", 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8109999999999999e-06 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894042+0000", 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2230000000000007e-06 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894064+0000", 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899000000000002e-05 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894075+0000", 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0667e-05 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894148+0000", 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3642999999999999e-05 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894156+0000", 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.898296+0000", 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041406289999999998 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.898465+0000", 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016921199999999999 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.902643+0000", 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041778270000000003 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.91092887899999997, 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.124 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.129 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:4627 3.10 e38/23 ondisk, result = 0)", 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.141006+0000", 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.900824976, 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0054798349999999997, 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141006+0000", 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141006+0000", 2024-09-21T22:15:53.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141008+0000", 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3769999999999999e-06 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141012+0000", 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5419999999999999e-06 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141026+0000", 2024-09-21T22:15:53.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3779e-05 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141038+0000", 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2374e-05 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146466+0000", 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0054274090000000002 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146474+0000", 2024-09-21T22:15:53.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4349999999999997e-06 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146486+0000", 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1919000000000001e-05 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4630 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write 1892949~7595] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.147098+0000", 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.89473275600000002, 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036844199999999999, 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.133 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4630 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147098+0000", 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147098+0000", 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147100+0000", 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3179999999999999e-06 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147112+0000", 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147123+0000", 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.182e-05 2024-09-21T22:15:53.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147130+0000", 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6699999999999997e-06 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147172+0000", 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1519e-05 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147237+0000", 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5301000000000004e-05 2024-09-21T22:15:53.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147341+0000", 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000103912 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.148213+0000", 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00087215999999999997 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.150666+0000", 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024530039999999999 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.150725+0000", 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9403e-05 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.150783+0000", 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7487e-05 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.138 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88186905800000004, 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:15:53.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:15:53.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:4643 3.10 e38/23 ondisk, result = 0)", 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.168884+0000", 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.87294700000000003, 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066287070000000002, 2024-09-21T22:15:53.144 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168884+0000", 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168884+0000", 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168885+0000", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2600000000000001e-07 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168889+0000", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8029999999999998e-06 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168900+0000", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.079e-05 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168908+0000", 2024-09-21T22:15:53.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.038e-06 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175395+0000", 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064873489999999999 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175403+0000", 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9969999999999998e-06 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175513+0000", 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000109904 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.147 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.148 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.148 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:53.148 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:53.148 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:53.148 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [3] live_osds: [0, 1, 2, 4, 5, 6, 7] 2024-09-21T22:15:53.148 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-09-21T22:15:53.148 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T22:15:53.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T22:15:53.149 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:53.150 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:53.150 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:53.150 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:53.151 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:53.151 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:53.149+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:53.151 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:53.152 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:53.152 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:53.152 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:53.152 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:53.152 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:53.154 INFO:tasks.ceph.osd.3:Started 2024-09-21T22:15:53.154 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:15:53.157 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:53.157 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:53.175 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:53.176 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:53.180 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:53.180 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:53.251 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:53.250+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:53.252 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:config diff 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:config diff get 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:config help [] 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-21T22:15:53.253 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: invalid command 2024-09-21T22:15:53.255 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:15:53.255 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-21T22:15:53.296 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:53.297 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:53.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:53.390 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:53.389+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:53.450 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:53.450 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:53.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:53.451+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:53.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:53.553 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:53.552+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:53.603 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:53.603 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:53.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:53.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:53.655+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:53.715 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:53.716 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:53.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:53.765 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:53.764+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:53.856 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:53.855+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:53.868 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:53.868 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:53.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:53.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:53.956+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:54.019 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.019 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:54.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:54.070+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:54.158 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:54.158+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:54.196 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.196 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:54.259 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:54.258+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:54.307 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.307 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:54.360 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:54.359+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:54.418 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.419 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.427 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:54.461 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:54.460+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:54.530 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.531 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:54.585 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:54.584+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:54.593 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:54.592+0000 7ff53a00d640 -1 Falling back to public interface 2024-09-21T22:15:54.643 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.643 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:54.662 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:54.662+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:54.763 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:54.762+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:54.796 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.797 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.805 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:54.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:54.862+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:54.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:15:54.917 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:54.917 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:54.926 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:54.964 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:54.963+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:55.031 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:55.031 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:55.040 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-21T22:15:55.041 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:55.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:55.065+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:55.147 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:55.147 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:55.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:15:55.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:55.165+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:55.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:15:55.260 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:55.260 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:55.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:55.265+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:55.269 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:15:55.282 INFO:teuthology.orchestra.run.smithi134.stdout:786 write 0x702f6a thru 0x70c084 (0x911b bytes) 2024-09-21T22:15:55.287 INFO:teuthology.orchestra.run.smithi134.stdout:788 writesame 0x26fbf80 thru 0x2705f3c data_size 0x2b(0x9fbd bytes) 2024-09-21T22:15:55.289 INFO:teuthology.orchestra.run.smithi134.stdout:790 punch from 0x5bce3e5 to 0x5bd2d04, (0x491f bytes) 2024-09-21T22:15:55.289 INFO:teuthology.orchestra.run.smithi134.stdout:792 punch from 0x9bfd513 to 0x9bfed5f, (0x184c bytes) 2024-09-21T22:15:55.290 INFO:teuthology.orchestra.run.smithi134.stdout:793 write 0xafa4584 thru 0xafb16a2 (0xd11f bytes) 2024-09-21T22:15:55.290 INFO:teuthology.orchestra.run.smithi134.stdout:794 read 0xacb8b6 thru 0xaccff3 (0x173e bytes) 2024-09-21T22:15:55.291 INFO:teuthology.orchestra.run.smithi134.stdout:796 write 0x89a30ce thru 0x89b21d9 (0xf10c bytes) 2024-09-21T22:15:55.293 INFO:teuthology.orchestra.run.smithi134.stdout:797 read 0xc590b4d thru 0xc593198 (0x264c bytes) 2024-09-21T22:15:55.293 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.293 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.293 INFO:teuthology.orchestra.run.smithi134.stdout:801 write 0xea30c8 thru 0xea32c0 (0x1f9 bytes) 2024-09-21T22:15:55.296 INFO:teuthology.orchestra.run.smithi134.stdout:803 write 0xd246982 thru 0xd2473e4 (0xa63 bytes) 2024-09-21T22:15:55.297 INFO:teuthology.orchestra.run.smithi134.stdout:804 write 0x2c736b thru 0x2c89f8 (0x168e bytes) 2024-09-21T22:15:55.303 INFO:teuthology.orchestra.run.smithi134.stdout:805 trunc from 0xe3f43d0 to 0xb21e356 2024-09-21T22:15:55.310 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:55.311 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:55.317 INFO:teuthology.orchestra.run.smithi134.stdout:806 write 0x682e201 thru 0x682ea36 (0x836 bytes) 2024-09-21T22:15:55.321 INFO:teuthology.orchestra.run.smithi134.stdout:807 trunc from 0xb21e356 to 0x8c5e718 2024-09-21T22:15:55.329 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:55.330 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:55.346 INFO:teuthology.orchestra.run.smithi134.stdout:810 trunc from 0x8c5e718 to 0x1daf974 2024-09-21T22:15:55.347 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:55.347 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:55.348 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:55.367 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:55.366+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:55.368 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:55.368 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:55.377 INFO:teuthology.orchestra.run.smithi134.stdout:812 punch from 0x86b329 to 0x87a534, (0xf20b bytes) 2024-09-21T22:15:55.377 INFO:teuthology.orchestra.run.smithi134.stdout:813 read 0x1c1d651 thru 0x1c20564 (0x2f14 bytes) 2024-09-21T22:15:55.379 INFO:teuthology.orchestra.run.smithi134.stdout:814 trunc from 0x1daf974 to 0x338cfce 2024-09-21T22:15:55.384 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.384 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.385 INFO:teuthology.orchestra.run.smithi134.stdout:818 read 0x32678f3 thru 0x3270b04 (0x9212 bytes) 2024-09-21T22:15:55.386 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:55.387 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:55.387 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:55.387 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:55.387 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:55.387 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:55.387 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:55.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:15:55.399 INFO:teuthology.orchestra.run.smithi134.stdout:819 write 0x8c2dca6 thru 0x8c38b93 (0xaeee bytes) 2024-09-21T22:15:55.404 INFO:teuthology.orchestra.run.smithi134.stdout:820 read 0x6995d48 thru 0x69964a8 (0x761 bytes) 2024-09-21T22:15:55.404 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.404 INFO:teuthology.orchestra.run.smithi134.stdout:823 writesame 0x1ba0960 thru 0x1bac570 data_size 0x1(0xbc11 bytes) 2024-09-21T22:15:55.428 INFO:teuthology.orchestra.run.smithi134.stdout:824 trunc from 0x8c38b94 to 0xd66de68 2024-09-21T22:15:55.433 INFO:teuthology.orchestra.run.smithi134.stdout:825 write 0x17ef9b0 thru 0x17f7d81 (0x83d2 bytes) 2024-09-21T22:15:55.435 INFO:teuthology.orchestra.run.smithi134.stdout:826 write 0x535349a thru 0x535b1d6 (0x7d3d bytes) 2024-09-21T22:15:55.438 INFO:teuthology.orchestra.run.smithi134.stdout:827 trunc from 0xd66de68 to 0xd4ae1fc 2024-09-21T22:15:55.443 INFO:teuthology.orchestra.run.smithi134.stdout:828 read 0x9b5ae77 thru 0x9b60441 (0x55cb bytes) 2024-09-21T22:15:55.443 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.443 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.443 INFO:teuthology.orchestra.run.smithi134.stdout:831 punch from 0x2ada06a to 0x2adf28b, (0x5221 bytes) 2024-09-21T22:15:55.443 INFO:teuthology.orchestra.run.smithi134.stdout:832 punch from 0x702fbfe to 0x703d91f, (0xdd21 bytes) 2024-09-21T22:15:55.450 INFO:teuthology.orchestra.run.smithi134.stdout:834 trunc from 0xd4ae1fc to 0x73cfdcb 2024-09-21T22:15:55.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:55.467+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:55.471 INFO:teuthology.orchestra.run.smithi134.stdout:836 writesame 0xcaced01 thru 0xcad6f7c data_size 0xe(0x827c bytes) 2024-09-21T22:15:55.471 INFO:teuthology.orchestra.run.smithi134.stdout:839 read 0x7747e71 thru 0x774da61 (0x5bf1 bytes) 2024-09-21T22:15:55.471 INFO:teuthology.orchestra.run.smithi134.stdout:840 read 0x29a37f5 thru 0x29a9baa (0x63b6 bytes) 2024-09-21T22:15:55.471 INFO:teuthology.orchestra.run.smithi134.stdout:841 read 0x283e61a thru 0x2844b0a (0x64f1 bytes) 2024-09-21T22:15:55.471 INFO:teuthology.orchestra.run.smithi134.stdout:843 writesame 0x7683466 thru 0x7691da1 data_size 0x76(0xe93c bytes) 2024-09-21T22:15:55.479 INFO:teuthology.orchestra.run.smithi134.stdout:845 write 0x31e5e80 thru 0x31efd54 (0x9ed5 bytes) 2024-09-21T22:15:55.481 INFO:teuthology.orchestra.run.smithi134.stdout:846 write 0x708cd55 thru 0x708d7d0 (0xa7c bytes) 2024-09-21T22:15:55.484 INFO:teuthology.orchestra.run.smithi134.stdout:847 read 0x8edf9dc thru 0x8ee1847 (0x1e6c bytes) 2024-09-21T22:15:55.484 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.484 INFO:teuthology.orchestra.run.smithi134.stdout:851 write 0xae5fb70 thru 0xae656e1 (0x5b72 bytes) 2024-09-21T22:15:55.490 INFO:teuthology.orchestra.run.smithi134.stdout:852 trunc from 0xcad6f7d to 0xd958bde 2024-09-21T22:15:55.495 INFO:teuthology.orchestra.run.smithi134.stdout:854 punch from 0x5e71899 to 0x5e7dd8c, (0xc4f3 bytes) 2024-09-21T22:15:55.503 INFO:teuthology.orchestra.run.smithi134.stdout:855 write 0xeca3341 thru 0xecb2b33 (0xf7f3 bytes) 2024-09-21T22:15:55.510 INFO:teuthology.orchestra.run.smithi134.stdout:856 read 0x49982b5 thru 0x499a7d5 (0x2521 bytes) 2024-09-21T22:15:55.511 INFO:teuthology.orchestra.run.smithi134.stdout:857 writesame 0x5f90f30 thru 0x5f9ea55 data_size 0x1(0xdb26 bytes) 2024-09-21T22:15:55.528 INFO:teuthology.orchestra.run.smithi134.stdout:859 read 0xe733afb thru 0xe73e103 (0xa609 bytes) 2024-09-21T22:15:55.529 INFO:teuthology.orchestra.run.smithi134.stdout:860 write 0xc955471 thru 0xc95ab47 (0x56d7 bytes) 2024-09-21T22:15:55.533 INFO:teuthology.orchestra.run.smithi134.stdout:863 write 0xd27c6aa thru 0xd27de7b (0x17d2 bytes) 2024-09-21T22:15:55.536 INFO:teuthology.orchestra.run.smithi134.stdout:864 punch from 0x8756ec0 to 0x8759af2, (0x2c32 bytes) 2024-09-21T22:15:55.536 INFO:teuthology.orchestra.run.smithi134.stdout:865 writesame 0xe9b6cb1 thru 0xe9bedeb data_size 0x1(0x813b bytes) 2024-09-21T22:15:55.551 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:55.551 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:55.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1433 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 2916352~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005771228, 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019321876000000002, 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1433 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:15:55.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543850+0000", 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9999999999999998e-07 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543852+0000", 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3080000000000002e-06 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543859+0000", 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6030000000000001e-06 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543865+0000", 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.173e-06 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562995+0000", 2024-09-21T22:15:55.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019130261999999999 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563071+0000", 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6055000000000003e-05 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563171+0000", 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9975000000000004e-05 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.556 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1434 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 2981888~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005748435999999, 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019712555, 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.557 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1434 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:15:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543873+0000", 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.39e-07 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543876+0000", 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1520000000000001e-06 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543882+0000", 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9290000000000003e-06 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543887+0000", 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.118e-06 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563381+0000", 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019494177000000001 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563476+0000", 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5427999999999995e-05 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563585+0000", 2024-09-21T22:15:55.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108312 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1435 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3047424~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005727276, 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019941364999999999, 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.562 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1435 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543894+0000", 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543896+0000", 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543948+0000", 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2201999999999999e-05 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544048+0000", 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9625999999999998e-05 2024-09-21T22:15:55.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563634+0000", 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019586076000000001 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563723+0000", 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8473999999999994e-05 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563835+0000", 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011205900000000001 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1436 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3112960~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005560371, 2024-09-21T22:15:55.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019987041000000001, 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1436 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544061+0000", 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544064+0000", 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4489999999999999e-06 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544072+0000", 2024-09-21T22:15:55.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.311e-06 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544077+0000", 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563868+0000", 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019791362999999999 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563944+0000", 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6064999999999998e-05 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564047+0000", 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010273299999999999 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1437 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3178496~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005535879, 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020126950000000001, 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1437 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.27e-07 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544087+0000", 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2079999999999999e-06 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544093+0000", 2024-09-21T22:15:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.874e-06 2024-09-21T22:15:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544098+0000", 2024-09-21T22:15:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6650000000000002e-06 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564082+0000", 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019984483000000001 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564150+0000", 2024-09-21T22:15:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7430999999999999e-05 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1861999999999998e-05 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1438 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3244032~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005512592000001, 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020359434999999999, 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1438 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544111+0000", 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544117+0000", 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544122+0000", 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7060000000000003e-06 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564258+0000", 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020136582 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564347+0000", 2024-09-21T22:15:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9288000000000003e-05 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564467+0000", 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000119948 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1439 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3309568~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005492045, 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020562668999999999, 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1439 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:15:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5300000000000004e-07 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544131+0000", 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544137+0000", 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9519999999999999e-06 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544142+0000", 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7550000000000002e-06 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564501+0000", 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020358883000000001 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564581+0000", 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0351000000000004e-05 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564691+0000", 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110195 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1440 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3375104~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:15:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005470153999999, 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020796948999999999, 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1440 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544151+0000", 2024-09-21T22:15:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.82e-07 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544153+0000", 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.869e-06 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544159+0000", 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5769999999999999e-06 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544199+0000", 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9601999999999998e-05 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564737+0000", 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020537581999999999 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564838+0000", 2024-09-21T22:15:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101467 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564947+0000", 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010937 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1441 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3440640~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005404212, 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020999262000000001, 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1441 2024-09-21T22:15:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544217+0000", 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5700000000000001e-07 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544222+0000", 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3599999999999998e-06 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544232+0000", 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0233e-05 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544239+0000", 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0079999999999996e-06 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564996+0000", 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020757512999999998 2024-09-21T22:15:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565085+0000", 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8566000000000006e-05 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565216+0000", 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013072499999999999 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1442 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3506176~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005370581999999, 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021211990999999999, 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1442 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544251+0000", 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.99e-07 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544253+0000", 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5909999999999998e-06 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544260+0000", 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544265+0000", 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1850000000000003e-06 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565255+0000", 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020989622999999999 2024-09-21T22:15:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565344+0000", 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9011999999999994e-05 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565462+0000", 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000118273 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1443 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3571712~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005348567, 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021376223, 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1443 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0399999999999996e-07 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544275+0000", 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3080000000000002e-06 2024-09-21T22:15:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544281+0000", 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1460000000000001e-06 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544286+0000", 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6e-06 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565493+0000", 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021207777000000001 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565565+0000", 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1815000000000003e-05 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565648+0000", 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3072999999999996e-05 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1444 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3637248~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005328556, 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021549170999999999, 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1444 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544295+0000", 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1430000000000001e-06 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544301+0000", 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2079999999999997e-06 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544306+0000", 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:15:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565677+0000", 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021371547000000001 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565749+0000", 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1886999999999998e-05 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565841+0000", 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1978999999999995e-05 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1445 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3702784~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005307703, 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021733944000000002, 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1445 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2399999999999998e-07 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544315+0000", 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9659999999999999e-06 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544322+0000", 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4999999999999996e-06 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544327+0000", 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6999999999999999e-06 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565870+0000", 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021543715000000001 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565944+0000", 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3851999999999997e-05 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566047+0000", 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102687 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1446 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3768320~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005287713, 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021911746999999999, 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1446 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1300000000000001e-07 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544337+0000", 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6069999999999999e-06 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544343+0000", 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9580000000000004e-06 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544348+0000", 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7450000000000003e-06 2024-09-21T22:15:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566076+0000", 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021728313999999999 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566150+0000", 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4344000000000005e-05 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566245+0000", 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4365999999999997e-05 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1447 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3833856~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005266779999999, 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022083714000000001, 2024-09-21T22:15:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1447 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8500000000000002e-07 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544356+0000", 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544362+0000", 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9610000000000002e-06 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544367+0000", 2024-09-21T22:15:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5569999999999997e-06 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566274+0000", 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021907115000000001 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566345+0000", 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1316000000000006e-05 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566437+0000", 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2151000000000006e-05 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1448 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3899392~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005247603999999, 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022306970999999998, 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1448 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:15:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544375+0000", 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9609999999999999e-06 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544382+0000", 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1589999999999998e-06 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544387+0000", 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566493+0000", 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022106832 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566569+0000", 2024-09-21T22:15:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5507999999999996e-05 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566680+0000", 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111055 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1449 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3964928~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005227848000001, 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022531059999999999, 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1449 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544399+0000", 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8379999999999998e-06 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544405+0000", 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4400000000000002e-06 2024-09-21T22:15:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544411+0000", 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0510000000000002e-06 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566730+0000", 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022318521000000001 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566818+0000", 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8342000000000002e-05 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566924+0000", 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010549500000000001 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1450 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4030464~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005202402, 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022739365000000001, 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1450 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:15:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544419+0000", 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9999999999999997e-07 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544421+0000", 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2850000000000001e-06 2024-09-21T22:15:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544428+0000", 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.849e-06 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544433+0000", 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566967+0000", 2024-09-21T22:15:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022534667000000001 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567064+0000", 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6525000000000002e-05 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567158+0000", 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3738000000000003e-05 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1451 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4096000~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005181791, 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022898399, 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1451 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544441+0000", 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0499999999999999e-06 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544452+0000", 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.113e-05 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544458+0000", 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9610000000000002e-06 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567187+0000", 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022728190999999998 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567254+0000", 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7662000000000004e-05 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567337+0000", 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2976e-05 2024-09-21T22:15:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1452 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4161536~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.005153387, 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.024156477999999999, 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1452 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544468+0000", 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544470+0000", 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7499999999999999e-06 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544478+0000", 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2969999999999998e-06 2024-09-21T22:15:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544483+0000", 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8099999999999997e-06 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567626+0000", 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023143009999999999 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567708+0000", 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2111e-05 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.568624+0000", 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00091596899999999998 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:55.655 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:55.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:55.658 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:55.656+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:55.659 INFO:teuthology.orchestra.run.smithi134.stdout:866 read 0xe0b2a02 thru 0xe0c298b (0xff8a bytes) 2024-09-21T22:15:55.659 INFO:teuthology.orchestra.run.smithi134.stdout:867 punch from 0xe7eb6bc to 0xe7f1bb9, (0x64fd bytes) 2024-09-21T22:15:55.659 INFO:teuthology.orchestra.run.smithi134.stdout:868 read 0xafb72eb thru 0xafc2960 (0xb676 bytes) 2024-09-21T22:15:55.659 INFO:teuthology.orchestra.run.smithi134.stdout:870 writesame 0x50ebaa6 thru 0x50fa90e data_size 0x1(0xee69 bytes) 2024-09-21T22:15:55.659 INFO:teuthology.orchestra.run.smithi134.stdout:872 write 0x2b10227 thru 0x2b1b8a3 (0xb67d bytes) 2024-09-21T22:15:55.659 INFO:teuthology.orchestra.run.smithi134.stdout:873 writesame 0xd1086c3 thru 0xd115958 data_size 0x2d(0xd296 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:874 writesame 0x32b1274 thru 0x32bfd21 data_size 0x72(0xeaae bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:877 read 0xc00f68f thru 0xc016d53 (0x76c5 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:878 punch from 0x9a1537f to 0x9a1e441, (0x90c2 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:879 write 0x3eb5f95 thru 0x3ebeb75 (0x8be1 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:881 read 0xaa10d95 thru 0xaa19f95 (0x9201 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:882 read 0x43226b5 thru 0x432d68b (0xafd7 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:884 read 0x61d1fb0 thru 0x61d5142 (0x3193 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:885 read 0xb98c394 thru 0xb99182c (0x5499 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:886 writesame 0xa9971f6 thru 0xa99acec data_size 0x1(0x3af7 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:887 write 0xd2d5472 thru 0xd2e2631 (0xd1c0 bytes) 2024-09-21T22:15:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.661 INFO:teuthology.orchestra.run.smithi134.stdout:889 read 0xeb912f9 thru 0xeba0997 (0xf69f bytes) 2024-09-21T22:15:55.661 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:55.661 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:55.662 INFO:teuthology.orchestra.run.smithi134.stdout:890 read 0x5ef8655 thru 0x5eff38f (0x6d3b bytes) 2024-09-21T22:15:55.662 INFO:teuthology.orchestra.run.smithi134.stdout:891 writesame 0x49954 thru 0x49f3d data_size 0x1(0x5ea bytes) 2024-09-21T22:15:55.662 INFO:teuthology.orchestra.run.smithi134.stdout:892 read 0x8adb421 thru 0x8ae4ce8 (0x98c8 bytes) 2024-09-21T22:15:55.662 INFO:teuthology.orchestra.run.smithi134.stdout:893 read 0x323b33a thru 0x3247958 (0xc61f bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:894 write 0xbeedc77 thru 0xbefa7ce (0xcb58 bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:895 read 0xc957fa3 thru 0xc960752 (0x87b0 bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:896 write 0x8855b2 thru 0x892df2 (0xd841 bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:898 read 0x54ae31d thru 0x54b9c52 (0xb936 bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:899 punch from 0x83b6922 to 0x83c51a5, (0xe883 bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:900 read 0x2003696 thru 0x2008dad (0x5718 bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:901 writesame 0x3a766cd thru 0x3a7dd53 data_size 0x1(0x7687 bytes) 2024-09-21T22:15:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:55.664 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:55.664 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:55.664 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:902 writesame 0x2778413 thru 0x277923e data_size 0x2(0xe2c bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:904 write 0xec061cf thru 0xec118bf (0xb6f1 bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:905 writesame 0xd1a9956 thru 0xd1a9c17 data_size 0x1(0x2c2 bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:906 read 0x5604db6 thru 0x56107cf (0xba1a bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:907 read 0x3c0eabb thru 0x3c10cea (0x2230 bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:909 write 0x2d08621 thru 0x2d143bd (0xbd9d bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:911 punch from 0xbc58e20 to 0xbc5db00, (0x4ce0 bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:912 write 0x60e2f01 thru 0x60ea7d4 (0x78d4 bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:913 write 0x4bfe24b thru 0x4bfe34c (0x102 bytes) 2024-09-21T22:15:55.667 INFO:teuthology.orchestra.run.smithi134.stdout:914 read 0xc16fdf3 thru 0xc171ec2 (0x20d0 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:916 punch from 0xca5a986 to 0xca6557e, (0xabf8 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:917 read 0xcb8777c thru 0xcb899b8 (0x223d bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:918 read 0x65bc66b thru 0x65bd0d3 (0xa69 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:919 read 0xe3eb593 thru 0xe3f8205 (0xcc73 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:921 write 0xbcf2bc4 thru 0xbcfcfe7 (0xa424 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:922 writesame 0xcb4af74 thru 0xcb52945 data_size 0x1f(0x79d2 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:923 read 0xb23dea2 thru 0xb245518 (0x7677 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:924 write 0x5bdb0c7 thru 0x5bdc36a (0x12a4 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:925 writesame 0x8479c26 thru 0x8484abf data_size 0x1(0xae9a bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:926 write 0xe5128e4 thru 0xe5140a6 (0x17c3 bytes) 2024-09-21T22:15:55.668 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.669 INFO:teuthology.orchestra.run.smithi134.stdout:930 read 0x47c8b88 thru 0x47cfd81 (0x71fa bytes) 2024-09-21T22:15:55.669 INFO:teuthology.orchestra.run.smithi134.stdout:932 writesame 0x5e66b2b thru 0x5e73a07 data_size 0x1(0xcedd bytes) 2024-09-21T22:15:55.681 INFO:teuthology.orchestra.run.smithi134.stdout:933 write 0xdb5ffbe thru 0xdb60ff1 (0x1034 bytes) 2024-09-21T22:15:55.682 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.685 INFO:teuthology.orchestra.run.smithi134.stdout:937 trunc from 0xecb2b34 to 0xc32b8e7 2024-09-21T22:15:55.701 INFO:teuthology.orchestra.run.smithi134.stdout:938 read 0x7ccad9b thru 0x7cd0863 (0x5ac9 bytes) 2024-09-21T22:15:55.702 INFO:teuthology.orchestra.run.smithi134.stdout:939 write 0xb3fa5e8 thru 0xb401d6f (0x7788 bytes) 2024-09-21T22:15:55.703 INFO:teuthology.orchestra.run.smithi134.stdout:940 punch from 0x64457a8 to 0x6445b07, (0x35f bytes) 2024-09-21T22:15:55.703 INFO:teuthology.orchestra.run.smithi134.stdout:941 read 0xa01cce2 thru 0xa021c82 (0x4fa1 bytes) 2024-09-21T22:15:55.703 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.703 INFO:teuthology.orchestra.run.smithi134.stdout:944 read 0xc03fc36 thru 0xc04bb72 (0xbf3d bytes) 2024-09-21T22:15:55.704 INFO:teuthology.orchestra.run.smithi134.stdout:945 read 0xd08286 thru 0xd13d06 (0xba81 bytes) 2024-09-21T22:15:55.704 INFO:teuthology.orchestra.run.smithi134.stdout:946 punch from 0xad0e977 to 0xad15f03, (0x758c bytes) 2024-09-21T22:15:55.704 INFO:teuthology.orchestra.run.smithi134.stdout:947 read 0xa8dffcc thru 0xa8e543c (0x5471 bytes) 2024-09-21T22:15:55.704 INFO:teuthology.orchestra.run.smithi134.stdout:948 writesame 0x8752b2c thru 0x8760510 data_size 0x1(0xd9e5 bytes) 2024-09-21T22:15:55.717 INFO:teuthology.orchestra.run.smithi134.stdout:950 write 0x66c3284 thru 0x66c35a1 (0x31e bytes) 2024-09-21T22:15:55.725 INFO:teuthology.orchestra.run.smithi134.stdout:951 writesame 0xe222505 thru 0xe2300b2 data_size 0x2a(0xdbae bytes) 2024-09-21T22:15:55.730 INFO:teuthology.orchestra.run.smithi134.stdout:952 trunc from 0xe2300b3 to 0xa2f49aa 2024-09-21T22:15:55.739 INFO:teuthology.orchestra.run.smithi134.stdout:953 punch from 0x2506bd1 to 0x250b638, (0x4a67 bytes) 2024-09-21T22:15:55.744 INFO:teuthology.orchestra.run.smithi134.stdout:954 trunc from 0xa2f49aa to 0x5b62575 2024-09-21T22:15:55.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:55.756+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:55.763 INFO:teuthology.orchestra.run.smithi134.stdout:955 trunc from 0x5b62575 to 0x270b1e1 2024-09-21T22:15:55.779 INFO:teuthology.orchestra.run.smithi134.stdout:956 read 0x254b168 thru 0x2557dd6 (0xcc6f bytes) 2024-09-21T22:15:55.779 INFO:teuthology.orchestra.run.smithi134.stdout:958 read 0x25e6a1 thru 0x268abd (0xa41d bytes) 2024-09-21T22:15:55.780 INFO:teuthology.orchestra.run.smithi134.stdout:959 read 0x1a5b90c thru 0x1a5d245 (0x193a bytes) 2024-09-21T22:15:55.793 INFO:teuthology.orchestra.run.smithi134.stdout:961 write 0x89bcd1e thru 0x89c44f1 (0x77d4 bytes) 2024-09-21T22:15:55.801 INFO:teuthology.orchestra.run.smithi134.stdout:962 writesame 0x22d0245 thru 0x22d5b81 data_size 0x5(0x593d bytes) 2024-09-21T22:15:55.804 INFO:teuthology.orchestra.run.smithi134.stdout:964 read 0x6bb5464 thru 0x6bc53f7 (0xff94 bytes) 2024-09-21T22:15:55.805 INFO:teuthology.orchestra.run.smithi134.stdout:965 trunc from 0x89c44f2 to 0x901bbb7 2024-09-21T22:15:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:966 read 0x47e008c thru 0x47e9a87 (0x99fc bytes) 2024-09-21T22:15:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:967 read 0x438daaf thru 0x439a3f3 (0xc945 bytes) 2024-09-21T22:15:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:971 read 0x7461603 thru 0x746a1ae (0x8bac bytes) 2024-09-21T22:15:55.812 INFO:teuthology.orchestra.run.smithi134.stdout:972 trunc from 0x901bbb7 to 0x779af26 2024-09-21T22:15:55.812 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:55.813 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:55.813 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:55.813 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:55.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:55.832 INFO:teuthology.orchestra.run.smithi134.stdout:973 writesame 0xe04f4fd thru 0xe05b687 data_size 0x1(0xc18b bytes) 2024-09-21T22:15:55.842 INFO:teuthology.orchestra.run.smithi134.stdout:974 trunc from 0xe05b688 to 0x5932e58 2024-09-21T22:15:55.854 INFO:teuthology.orchestra.run.smithi134.stdout:975 punch from 0x154a4b4 to 0x154c2e6, (0x1e32 bytes) 2024-09-21T22:15:55.854 INFO:teuthology.orchestra.run.smithi134.stdout:976 write 0x2514f2c thru 0x25240e9 (0xf1be bytes) 2024-09-21T22:15:55.856 INFO:teuthology.orchestra.run.smithi134.stdout:980 read 0x1e4de70 thru 0x1e59b6d (0xbcfe bytes) 2024-09-21T22:15:55.856 INFO:teuthology.orchestra.run.smithi134.stdout:981 punch from 0x227d5aa to 0x228b4d6, (0xdf2c bytes) 2024-09-21T22:15:55.858 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:55.857+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:55.865 INFO:teuthology.orchestra.run.smithi134.stdout:982 trunc from 0x5932e58 to 0xc88c5bd 2024-09-21T22:15:55.877 INFO:teuthology.orchestra.run.smithi134.stdout:983 write 0xd522e74 thru 0xd52fe74 (0xd001 bytes) 2024-09-21T22:15:55.890 INFO:teuthology.orchestra.run.smithi134.stdout:985 trunc from 0xd52fe75 to 0x774e34d 2024-09-21T22:15:55.892 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:15:55.907 INFO:teuthology.orchestra.run.smithi134.stdout:988 write 0x61d605b thru 0x61e389e (0xd844 bytes) 2024-09-21T22:15:55.912 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.912 INFO:teuthology.orchestra.run.smithi134.stdout:991 read 0x1fd9993 thru 0x1fdb181 (0x17ef bytes) 2024-09-21T22:15:55.917 INFO:teuthology.orchestra.run.smithi134.stdout:992 write 0x7b17f25 thru 0x7b221fc (0xa2d8 bytes) 2024-09-21T22:15:55.923 INFO:teuthology.orchestra.run.smithi134.stdout:993 writesame 0x1950700 thru 0x195bb82 data_size 0x1(0xb483 bytes) 2024-09-21T22:15:55.935 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:55.935 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:55.935 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:55.935 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:55.935 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:55.940 INFO:teuthology.orchestra.run.smithi134.stdout:994 read 0x491ad49 thru 0x4925cb5 (0xaf6d bytes) 2024-09-21T22:15:55.940 INFO:teuthology.orchestra.run.smithi134.stdout:996 read 0x44016ef thru 0x440b18b (0x9a9d bytes) 2024-09-21T22:15:55.940 INFO:teuthology.orchestra.run.smithi134.stdout:998 read 0x3aeecae thru 0x3af90c6 (0xa419 bytes) 2024-09-21T22:15:55.940 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:55.940 INFO:teuthology.orchestra.run.smithi134.stdout:1000 punch from 0x17c5a3e to 0x17c5a85, (0x47 bytes) 2024-09-21T22:15:55.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:55.948 INFO:teuthology.orchestra.run.smithi134.stdout:1001 writesame 0x8ea2050 thru 0x8ea7109 data_size 0x1(0x50ba bytes) 2024-09-21T22:15:55.948 INFO:teuthology.orchestra.run.smithi134.stdout:1002 write 0x6e3e0a2 thru 0x6e4bece (0xde2d bytes) 2024-09-21T22:15:55.951 INFO:teuthology.orchestra.run.smithi134.stdout:1003 write 0x3a316c2 thru 0x3a34c3b (0x357a bytes) 2024-09-21T22:15:55.956 INFO:teuthology.orchestra.run.smithi134.stdout:1004 read 0x43f9fb0 thru 0x43fd660 (0x36b1 bytes) 2024-09-21T22:15:55.966 INFO:teuthology.orchestra.run.smithi134.stdout:1005 write 0xc37cd69 thru 0xc38afac (0xe244 bytes) 2024-09-21T22:15:55.986 INFO:teuthology.orchestra.run.smithi134.stdout:1008 trunc from 0xc38afad to 0x9a2cd8 2024-09-21T22:15:55.990 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:55.989+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:56.002 INFO:teuthology.orchestra.run.smithi134.stdout:1009 read 0x38ed40 thru 0x39a168 (0xb429 bytes) 2024-09-21T22:15:56.002 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.002 INFO:teuthology.orchestra.run.smithi134.stdout:1011 read 0x4782a5 thru 0x480a0c (0x8768 bytes) 2024-09-21T22:15:56.022 INFO:teuthology.orchestra.run.smithi134.stdout:1012 writesame 0xbdb5701 thru 0xbdc1084 data_size 0x3e(0xb984 bytes) 2024-09-21T22:15:56.022 INFO:teuthology.orchestra.run.smithi134.stdout:1013 read 0x8a64b5a thru 0x8a6be55 (0x72fc bytes) 2024-09-21T22:15:56.022 INFO:teuthology.orchestra.run.smithi134.stdout:1016 read 0x13056d8 thru 0x13095fc (0x3f25 bytes) 2024-09-21T22:15:56.023 INFO:teuthology.orchestra.run.smithi134.stdout:1017 writesame 0x793f745 thru 0x79463c9 data_size 0x1(0x6c85 bytes) 2024-09-21T22:15:56.035 INFO:teuthology.orchestra.run.smithi134.stdout:1019 punch from 0x29731fe to 0x29801dd, (0xcfdf bytes) 2024-09-21T22:15:56.035 INFO:teuthology.orchestra.run.smithi134.stdout:1020 punch from 0x2d1c03f to 0x2d29625, (0xd5e6 bytes) 2024-09-21T22:15:56.035 INFO:teuthology.orchestra.run.smithi134.stdout:1021 read 0x6d18f06 thru 0x6d23799 (0xa894 bytes) 2024-09-21T22:15:56.044 INFO:teuthology.orchestra.run.smithi134.stdout:1022 trunc from 0xbdc1085 to 0x4381d68 2024-09-21T22:15:56.053 INFO:teuthology.orchestra.run.smithi134.stdout:1025 read 0x2bf45ba thru 0x2bff52c (0xaf73 bytes) 2024-09-21T22:15:56.053 INFO:teuthology.orchestra.run.smithi134.stdout:1026 read 0x9abff9 thru 0x9ac6b1 (0x6b9 bytes) 2024-09-21T22:15:56.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:56.059+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:56.061 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:56.061 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:56.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:56.061 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:56.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.061 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:419 3.10 3:0f641a21:::rbd_data.11856a5cf33b.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.125609941, 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040014170000000002, 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 419 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933666+0000", 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933668+0000", 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.378e-06 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933675+0000", 2024-09-21T22:15:56.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.109e-06 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933688+0000", 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3291e-05 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933695+0000", 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3520000000000001e-06 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933760+0000", 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4488999999999999e-05 2024-09-21T22:15:56.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933846+0000", 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6199999999999995e-05 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.933963+0000", 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000116937 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.934556+0000", 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059266699999999996 2024-09-21T22:15:56.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937613+0000", 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030571660000000001 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937641+0000", 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8381000000000002e-05 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:41.937668+0000", 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6446999999999999e-05 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1020 3.1e 3:7af2d16a:::rbd_data.1185ff358907.0000000000000007:head [write 0~725994 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.551092414999999, 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0067157170000000004, 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1020 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508184+0000", 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508185+0000", 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4920000000000001e-06 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509567+0000", 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0013821510000000001 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509585+0000", 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7813e-05 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509595+0000", 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9499999999999996e-06 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509669+0000", 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4260999999999999e-05 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509678+0000", 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6139999999999992e-06 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.512690+0000", 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030124510000000002 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.512850+0000", 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000159271 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514765+0000", 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001915588 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514820+0000", 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4586000000000002e-05 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.514899+0000", 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9540000000000001e-05 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1533 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 557056~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.500410923, 2024-09-21T22:15:56.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035474220000000002, 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1533 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558865+0000", 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558867+0000", 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2669999999999999e-06 2024-09-21T22:15:56.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558870+0000", 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2310000000000001e-06 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558873+0000", 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6479999999999999e-06 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562187+0000", 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003314862 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562265+0000", 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7714999999999997e-05 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562413+0000", 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014747800000000001 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1534 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:3 [read 622592~20078 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.076 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.500400277000001, 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040238330000000001, 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1534 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558876+0000", 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.22e-07 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558877+0000", 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0049999999999999e-06 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558880+0000", 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2179999999999999e-06 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558884+0000", 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.19e-06 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562450+0000", 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035664540000000002 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562575+0000", 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000125458 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562900+0000", 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032428600000000002 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1535 3.1e 3:7a25eff8:::rbd_data.11856a5cf33b.0000000000000030:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:56.080 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.500389466, 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042382110000000004, 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1535 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:56.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558887+0000", 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558888+0000", 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.122e-06 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558891+0000", 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2650000000000001e-06 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.558894+0000", 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.278e-06 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562932+0000", 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040381100000000001 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563001+0000", 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9669e-05 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563125+0000", 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012355299999999999 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.084 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2140 3.1e 3:7fdd8e08:::rbd_header.118555b0e245:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.478417+0000", 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.5808589340000001, 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009158678, 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2140 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478417+0000", 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478417+0000", 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478419+0000", 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478431+0000", 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1471000000000001e-05 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478456+0000", 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.497e-05 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478466+0000", 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0424999999999999e-05 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478531+0000", 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4434e-05 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.478535+0000", 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.484378+0000", 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058428159999999998 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.484452+0000", 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4274000000000001e-05 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.487499+0000", 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030467739999999999 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.487531+0000", 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1915999999999997e-05 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.487576+0000", 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4879999999999997e-05 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2324 3.1e 3:7af2d16a:::rbd_data.1185ff358907.0000000000000007:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.500429+0000", 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.5588473359999995, 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033214619999999999, 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2324 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500429+0000", 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500429+0000", 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500430+0000", 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.75e-07 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500434+0000", 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.617e-06 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500454+0000", 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0220999999999998e-05 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.500463+0000", 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8650000000000007e-06 2024-09-21T22:15:56.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.503010+0000", 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025466180000000001 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.503088+0000", 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8015000000000004e-05 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.503750+0000", 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00066245099999999999 2024-09-21T22:15:56.093 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2363 3.1e 3:7e684fc1:::rbd_data.118555b0e245.0000000000000007:head [write 0~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.523781+0000", 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.5354952199999996, 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044354340000000003, 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2363 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.523781+0000", 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.523781+0000", 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.523783+0000", 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6249999999999999e-06 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524847+0000", 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010643390000000001 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524870+0000", 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3074999999999998e-05 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524882+0000", 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1564e-05 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.525044+0000", 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016197 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.525430+0000", 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038648799999999999 2024-09-21T22:15:56.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.528076+0000", 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026454999999999998 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.528142+0000", 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6672000000000001e-05 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.528216+0000", 2024-09-21T22:15:56.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4201000000000003e-05 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2420 3.1e 3:7fdd8e08:::rbd_header.118555b0e245:head [watch unwatch cookie 140355169389984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.5634505910000005, 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005387172, 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.099 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2420 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495826+0000", 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.89e-07 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495828+0000", 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9209999999999999e-06 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495837+0000", 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0389999999999993e-06 2024-09-21T22:15:56.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.495843+0000", 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0639999999999999e-06 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496026+0000", 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000183086 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496077+0000", 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0556999999999997e-05 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501060+0000", 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0049835820000000003 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501127+0000", 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6953999999999996e-05 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501213+0000", 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5580000000000004e-05 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2421 3.1e 3:7fdd8e08:::rbd_header.118555b0e245:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:47.496067+0000", 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.5632089340000004, 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0052920240000000002, 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.104 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2421 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496067+0000", 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496067+0000", 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496068+0000", 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496071+0000", 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.711e-06 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496077+0000", 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7390000000000002e-06 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496081+0000", 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8290000000000001e-06 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496317+0000", 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023590699999999999 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.496373+0000", 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6517000000000001e-05 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501244+0000", 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048704730000000002 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501290+0000", 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5550999999999998e-05 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:47.501359+0000", 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9747999999999997e-05 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.108 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:3051 3.1e 3:7e684fc1:::rbd_data.118555b0e245.0000000000000007:head [delete] snapc 6=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.660794+0000", 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 7.3984823249999998, 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068941260000000004, 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 3051 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.109 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660794+0000", 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660794+0000", 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660796+0000", 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:15:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660807+0000", 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0866999999999999e-05 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660843+0000", 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6633e-05 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.660864+0000", 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0859000000000001e-05 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661524+0000", 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00065968199999999998 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.662153+0000", 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062923700000000005 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667536+0000", 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053826739999999996 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667592+0000", 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667688+0000", 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5662999999999995e-05 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:3054 3.a 3:56eb0f72:::rbd_data.118555b0e245.000000000000000b:head [delete] snapc 6=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.661477+0000", 2024-09-21T22:15:56.113 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 7.3977992170000002, 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0063515710000000003, 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 3054 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661477+0000", 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661477+0000", 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661478+0000", 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6899999999999997e-07 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661482+0000", 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0180000000000003e-06 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661491+0000", 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8169999999999994e-06 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661578+0000", 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6819999999999999e-05 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661685+0000", 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106277 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661765+0000", 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0061000000000005e-05 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.661870+0000", 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010555700000000001 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664579+0000", 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002709052 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667735+0000", 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003156177 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667783+0000", 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7215000000000001e-05 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.667829+0000", 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5908000000000002e-05 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:3063 3.10 3:0f4d94e8:::rbd_data.118555b0e245.0000000000000023:head [delete] snapc 6=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.664848+0000", 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 7.3944281839999997, 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0054606630000000001, 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.119 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 3063 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664848+0000", 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664848+0000", 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664849+0000", 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.33e-06 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664858+0000", 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7709999999999995e-06 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664873+0000", 2024-09-21T22:15:56.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4610000000000001e-05 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664881+0000", 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1510000000000004e-06 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664928+0000", 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6745000000000001e-05 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.664998+0000", 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0557999999999998e-05 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.665120+0000", 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178799999999999 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.669820+0000", 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0047001159999999998 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.670201+0000", 2024-09-21T22:15:56.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000380663 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.670263+0000", 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2629e-05 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.670309+0000", 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5302000000000001e-05 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4403 3.a 3:5152097f:::rbd_data.1185e2328614.0000000000000029:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:51.894032+0000", 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.1652441109999998, 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0086112310000000004, 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4403 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894032+0000", 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894032+0000", 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894034+0000", 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8109999999999999e-06 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894042+0000", 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2230000000000007e-06 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894064+0000", 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899000000000002e-05 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894075+0000", 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0667e-05 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894148+0000", 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3642999999999999e-05 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.894156+0000", 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.898296+0000", 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041406289999999998 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.898465+0000", 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016921199999999999 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:51.902643+0000", 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041778270000000003 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:15:56.129 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.9283739309999999, 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:15:56.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:4627 3.10 e38/23 ondisk, result = 0)", 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.141006+0000", 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.9182700280000002, 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0054798349999999997, 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.135 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141006+0000", 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141006+0000", 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141008+0000", 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3769999999999999e-06 2024-09-21T22:15:56.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141012+0000", 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5419999999999999e-06 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141026+0000", 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3779e-05 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.141038+0000", 2024-09-21T22:15:56.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2374e-05 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146466+0000", 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0054274090000000002 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146474+0000", 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4349999999999997e-06 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146486+0000", 2024-09-21T22:15:56.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1919000000000001e-05 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4630 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write 1892949~7595] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.147098+0000", 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.912177808, 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036844199999999999, 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.139 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4630 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147098+0000", 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147098+0000", 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147100+0000", 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3179999999999999e-06 2024-09-21T22:15:56.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147112+0000", 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147123+0000", 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.182e-05 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147130+0000", 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6699999999999997e-06 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147172+0000", 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1519e-05 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147237+0000", 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5301000000000004e-05 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.147341+0000", 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000103912 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.148213+0000", 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00087215999999999997 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.150666+0000", 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024530039999999999 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.150725+0000", 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9403e-05 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.150783+0000", 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7487e-05 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.8993141100000002, 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.144 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop_reply(client.4485.0:4643 3.10 e38/23 ondisk, result = 0)", 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.168884+0000", 2024-09-21T22:15:56.149 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.8903920520000002, 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0066287070000000002, 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168884+0000", 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168884+0000", 2024-09-21T22:15:56.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168885+0000", 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2600000000000001e-07 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168889+0000", 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8029999999999998e-06 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168900+0000", 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.079e-05 2024-09-21T22:15:56.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.168908+0000", 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.038e-06 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175395+0000", 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0064873489999999999 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175403+0000", 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9969999999999998e-06 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175513+0000", 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000109904 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8227 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.800932+0000", 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.25834428100000001, 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036102069999999998, 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.153 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8227 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.800932+0000", 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.800932+0000", 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.800933+0000", 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4559999999999999e-06 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.800941+0000", 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8089999999999993e-06 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.800955+0000", 2024-09-21T22:15:56.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3831e-05 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.800962+0000", 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6900000000000003e-06 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.801030+0000", 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7992999999999998e-05 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.801132+0000", 2024-09-21T22:15:56.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010217000000000001 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.801729+0000", 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059747800000000003 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.804111+0000", 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023813189999999998 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.804425+0000", 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031448400000000002 2024-09-21T22:15:56.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.804490+0000", 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4445999999999999e-05 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.804542+0000", 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2531000000000002e-05 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.158 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:56.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:56.161 INFO:teuthology.orchestra.run.smithi134.stdout:1027 write 0xe8570e4 thru 0xe85fe54 (0x8d71 bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1028 trunc from 0xe85fe55 to 0xea82934 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1030 read 0xd66473a thru 0xd671e90 (0xd757 bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1031 read 0x5959e49 thru 0x5965393 (0xb54b bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1032 read 0x79411e thru 0x79d453 (0x9336 bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1033 write 0xb0c36be thru 0xb0c6e0b (0x374e bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1035 trunc from 0xea82934 to 0xd3c2eda 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1036 read 0x55caa57 thru 0x55d2b12 (0x80bc bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1037 punch from 0x6b63743 to 0x6b67e29, (0x46e6 bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1038 trunc from 0xd3c2eda to 0xaaffa4d 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1039 write 0xd30c792 thru 0xd313f9e (0x780d bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1040 write 0x877b1ae thru 0x877bd51 (0xba4 bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1041 read 0xce8a36 thru 0xcf62b0 (0xd87b bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1042 writesame 0x7345e3e thru 0x734854e data_size 0x1(0x2711 bytes) 2024-09-21T22:15:56.162 INFO:teuthology.orchestra.run.smithi134.stdout:1044 writesame 0xb35510f thru 0xb356d27 data_size 0x1(0x1c19 bytes) 2024-09-21T22:15:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:1045 write 0xc24dd03 thru 0xc256e81 (0x917f bytes) 2024-09-21T22:15:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:1046 write 0xe52d048 thru 0xe5324e6 (0x549f bytes) 2024-09-21T22:15:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:1048 write 0xcf9357f thru 0xcf9fdf8 (0xc87a bytes) 2024-09-21T22:15:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:1049 write 0x9a00e2d thru 0x9a0cb1a (0xbcee bytes) 2024-09-21T22:15:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:1051 read 0x22c2ed8 thru 0x22c4559 (0x1682 bytes) 2024-09-21T22:15:56.164 INFO:teuthology.orchestra.run.smithi134.stdout:1052 writesame 0x170966c thru 0x17126d4 data_size 0x1(0x9069 bytes) 2024-09-21T22:15:56.175 INFO:teuthology.orchestra.run.smithi134.stdout:1053 punch from 0x35e78fd to 0x35ea0fc, (0x27ff bytes) 2024-09-21T22:15:56.175 INFO:teuthology.orchestra.run.smithi134.stdout:1054 read 0x2670a8a thru 0x2672502 (0x1a79 bytes) 2024-09-21T22:15:56.176 INFO:teuthology.orchestra.run.smithi134.stdout:1055 trunc from 0xe5324e7 to 0xd7fff7c 2024-09-21T22:15:56.200 INFO:teuthology.orchestra.run.smithi134.stdout:1056 trunc from 0xd7fff7c to 0x20746cb 2024-09-21T22:15:56.201 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:56.200+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:56.217 INFO:teuthology.orchestra.run.smithi134.stdout:1057 trunc from 0x20746cb to 0x6b2c278 2024-09-21T22:15:56.225 INFO:teuthology.orchestra.run.smithi134.stdout:1060 trunc from 0x6b2c278 to 0x909370e 2024-09-21T22:15:56.235 INFO:teuthology.orchestra.run.smithi134.stdout:1061 trunc from 0x909370e to 0x55c2a07 2024-09-21T22:15:56.240 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.252 INFO:teuthology.orchestra.run.smithi134.stdout:1066 write 0xb25028a thru 0xb252325 (0x209c bytes) 2024-09-21T22:15:56.255 INFO:teuthology.orchestra.run.smithi134.stdout:1067 write 0x4b0f80b thru 0x4b14a0b (0x5201 bytes) 2024-09-21T22:15:56.262 INFO:teuthology.orchestra.run.smithi134.stdout:1069 punch from 0x4c5e0b5 to 0x4c617fc, (0x3747 bytes) 2024-09-21T22:15:56.262 INFO:teuthology.orchestra.run.smithi134.stdout:1071 read 0x6c2f58d thru 0x6c324c2 (0x2f36 bytes) 2024-09-21T22:15:56.262 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.262 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.262 INFO:teuthology.orchestra.run.smithi134.stdout:1076 read 0xa971a7e thru 0xa97fb48 (0xe0cb bytes) 2024-09-21T22:15:56.262 INFO:teuthology.orchestra.run.smithi134.stdout:1077 writesame 0x86dc1a1 thru 0x86dc8a7 data_size 0x1(0x707 bytes) 2024-09-21T22:15:56.264 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:56.263+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:56.265 INFO:teuthology.orchestra.run.smithi134.stdout:1078 writesame 0x2ae624b thru 0x2aec112 data_size 0x24(0x5ec8 bytes) 2024-09-21T22:15:56.271 INFO:teuthology.orchestra.run.smithi134.stdout:1081 write 0xab5500f thru 0xab5f3ab (0xa39d bytes) 2024-09-21T22:15:56.276 INFO:teuthology.orchestra.run.smithi134.stdout:1082 writesame 0x68a262f thru 0x68a3fe5 data_size 0x1(0x19b7 bytes) 2024-09-21T22:15:56.280 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.280 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.289 INFO:teuthology.orchestra.run.smithi134.stdout:1086 trunc from 0xb252326 to 0x322944c 2024-09-21T22:15:56.301 INFO:teuthology.orchestra.run.smithi134.stdout:1087 read 0x4f82f4 thru 0x506954 (0xe661 bytes) 2024-09-21T22:15:56.311 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:56.311 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:56.311 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:15:56.311 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:56.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:56.322 INFO:teuthology.orchestra.run.smithi134.stdout:1089 write 0xe6b8fb6 thru 0xe6bf7f5 (0x6840 bytes) 2024-09-21T22:15:56.325 INFO:teuthology.orchestra.run.smithi134.stdout:1090 writesame 0x7d11f3b thru 0x7d17aee data_size 0x2(0x5bb4 bytes) 2024-09-21T22:15:56.331 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.331 INFO:teuthology.orchestra.run.smithi134.stdout:1092 punch from 0x42dca45 to 0x42dfcf6, (0x32b1 bytes) 2024-09-21T22:15:56.332 INFO:teuthology.orchestra.run.smithi134.stdout:1093 write 0xc715636 thru 0xc722282 (0xcc4d bytes) 2024-09-21T22:15:56.341 INFO:teuthology.orchestra.run.smithi134.stdout:1094 read 0xa5f2c45 thru 0xa5fb592 (0x894e bytes) 2024-09-21T22:15:56.348 INFO:teuthology.orchestra.run.smithi134.stdout:1095 trunc from 0xe6bf7f6 to 0x819f2d7 2024-09-21T22:15:56.360 INFO:teuthology.orchestra.run.smithi134.stdout:1096 read 0x3ce6782 thru 0x3cea5fc (0x3e7b bytes) 2024-09-21T22:15:56.360 INFO:teuthology.orchestra.run.smithi134.stdout:1097 writesame 0x2990c72 thru 0x299dad0 data_size 0x1(0xce5f bytes) 2024-09-21T22:15:56.365 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:56.364+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:56.384 INFO:teuthology.orchestra.run.smithi134.stdout:1099 write 0xa431be8 thru 0xa43d686 (0xba9f bytes) 2024-09-21T22:15:56.388 INFO:teuthology.orchestra.run.smithi134.stdout:1100 write 0x77f133a thru 0x7800cd0 (0xf997 bytes) 2024-09-21T22:15:56.393 INFO:teuthology.orchestra.run.smithi134.stdout:1101 write 0x6e5c369 thru 0x6e62d93 (0x6a2b bytes) 2024-09-21T22:15:56.397 INFO:teuthology.orchestra.run.smithi134.stdout:1103 writesame 0x188ad1 thru 0x190a04 data_size 0xe(0x7f34 bytes) 2024-09-21T22:15:56.398 INFO:teuthology.orchestra.run.smithi134.stdout:1105 write 0x4787d6a thru 0x478dc39 (0x5ed0 bytes) 2024-09-21T22:15:56.408 INFO:teuthology.orchestra.run.smithi134.stdout:1106 write 0xb9e30a4 thru 0xb9e45ff (0x155c bytes) 2024-09-21T22:15:56.411 INFO:teuthology.orchestra.run.smithi134.stdout:1107 writesame 0x946e237 thru 0x9470214 data_size 0x1(0x1fde bytes) 2024-09-21T22:15:56.416 INFO:teuthology.orchestra.run.smithi134.stdout:1108 read 0x163bbce thru 0x163fffe (0x4431 bytes) 2024-09-21T22:15:56.416 INFO:teuthology.orchestra.run.smithi134.stdout:1109 punch from 0x384675a to 0x3854248, (0xdaee bytes) 2024-09-21T22:15:56.416 INFO:teuthology.orchestra.run.smithi134.stdout:1111 read 0x25e7104 thru 0x25f512a (0xe027 bytes) 2024-09-21T22:15:56.419 INFO:teuthology.orchestra.run.smithi134.stdout:1112 trunc from 0xb9e4600 to 0xd75be4a 2024-09-21T22:15:56.424 INFO:teuthology.orchestra.run.smithi134.stdout:1114 write 0x6ea1f66 thru 0x6ea655a (0x45f5 bytes) 2024-09-21T22:15:56.427 INFO:teuthology.orchestra.run.smithi134.stdout:1115 writesame 0x5aeceec thru 0x5af49d8 data_size 0x1(0x7aed bytes) 2024-09-21T22:15:56.437 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.438 INFO:teuthology.orchestra.run.smithi134.stdout:1117 write 0xca5dae7 thru 0xca64385 (0x689f bytes) 2024-09-21T22:15:56.442 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:56.442 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:15:56.442 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:15:56.442 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:15:56.442 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:56.448 INFO:teuthology.orchestra.run.smithi134.stdout:1119 write 0xe6d1c79 thru 0xe6dde34 (0xc1bc bytes) 2024-09-21T22:15:56.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:56.455 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.455 INFO:teuthology.orchestra.run.smithi134.stdout:1122 read 0x4f9581b thru 0x4f972d8 (0x1abe bytes) 2024-09-21T22:15:56.455 INFO:teuthology.orchestra.run.smithi134.stdout:1123 punch from 0x43ec21a to 0x43f30db, (0x6ec1 bytes) 2024-09-21T22:15:56.465 INFO:teuthology.orchestra.run.smithi134.stdout:1126 trunc from 0xe6dde35 to 0x55c58e2 2024-09-21T22:15:56.484 INFO:teuthology.orchestra.run.smithi134.stdout:1127 write 0x2c85c5a thru 0x2c94b04 (0xeeab bytes) 2024-09-21T22:15:56.490 INFO:teuthology.orchestra.run.smithi134.stdout:1132 read 0x149ff0e thru 0x14a0328 (0x41b bytes) 2024-09-21T22:15:56.491 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.494 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:56.494+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:56.495 INFO:teuthology.orchestra.run.smithi134.stdout:1136 trunc from 0x55c58e2 to 0x91bd362 2024-09-21T22:15:56.503 INFO:teuthology.orchestra.run.smithi134.stdout:1137 punch from 0x4973325 to 0x497f590, (0xc26b bytes) 2024-09-21T22:15:56.503 INFO:teuthology.orchestra.run.smithi134.stdout:1138 read 0x7a99f12 thru 0x7a9de9a (0x3f89 bytes) 2024-09-21T22:15:56.503 INFO:teuthology.orchestra.run.smithi134.stdout:1140 punch from 0x5ce022d to 0x5ce2574, (0x2347 bytes) 2024-09-21T22:15:56.503 INFO:teuthology.orchestra.run.smithi134.stdout:1143 write 0x5370d84 thru 0x537641c (0x5699 bytes) 2024-09-21T22:15:56.506 INFO:teuthology.orchestra.run.smithi134.stdout:1144 trunc from 0x91bd362 to 0x9a4525e 2024-09-21T22:15:56.511 INFO:teuthology.orchestra.run.smithi134.stdout:1145 punch from 0x5ed3d34 to 0x5ed59c3, (0x1c8f bytes) 2024-09-21T22:15:56.511 INFO:teuthology.orchestra.run.smithi134.stdout:1147 punch from 0x198cb to 0x26759, (0xce8e bytes) 2024-09-21T22:15:56.511 INFO:teuthology.orchestra.run.smithi134.stdout:1149 writesame 0x38a3f8d thru 0x38b2caf data_size 0x1(0xed23 bytes) 2024-09-21T22:15:56.533 INFO:teuthology.orchestra.run.smithi134.stdout:1150 trunc from 0x9a4525e to 0xaebffe1 2024-09-21T22:15:56.541 INFO:teuthology.orchestra.run.smithi134.stdout:1151 write 0x4ddabdb thru 0x4ddb7ca (0xbf0 bytes) 2024-09-21T22:15:56.542 INFO:teuthology.orchestra.run.smithi134.stdout:1156 read 0xa476253 thru 0xa47e1f2 (0x7fa0 bytes) 2024-09-21T22:15:56.542 INFO:teuthology.orchestra.run.smithi134.stdout:1157 read 0x1ab112d thru 0x1abef72 (0xde46 bytes) 2024-09-21T22:15:56.542 INFO:teuthology.orchestra.run.smithi134.stdout:1158 write 0x7d44a01 thru 0x7d4792f (0x2f2f bytes) 2024-09-21T22:15:56.545 INFO:teuthology.orchestra.run.smithi134.stdout:1160 write 0x8cbda2a thru 0x8cbfbf9 (0x21d0 bytes) 2024-09-21T22:15:56.551 INFO:teuthology.orchestra.run.smithi134.stdout:1167 read 0x311dd34 thru 0x3122e1e (0x50eb bytes) 2024-09-21T22:15:56.551 INFO:teuthology.orchestra.run.smithi134.stdout:1168 write 0x9319b3a thru 0x9324018 (0xa4df bytes) 2024-09-21T22:15:56.555 INFO:teuthology.orchestra.run.smithi134.stdout:1170 read 0x7f1d2b1 thru 0x7f2673e (0x948e bytes) 2024-09-21T22:15:56.560 INFO:teuthology.orchestra.run.smithi134.stdout:1172 trunc from 0xaebffe1 to 0x69cbcd9 2024-09-21T22:15:56.566 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:56.565+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:836 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3801088~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.083042937, 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013595324000000001, 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.568 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 836 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482743+0000", 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482744+0000", 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1599999999999999e-06 2024-09-21T22:15:56.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482747+0000", 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1089999999999998e-06 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482749+0000", 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3e-06 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496166+0000", 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013416855 2024-09-21T22:15:56.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496240+0000", 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3579999999999997e-05 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496338+0000", 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8098999999999997e-05 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.572 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:837 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3866624~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.083033235, 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013717548, 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 837 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482752+0000", 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482753+0000", 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1399999999999995e-07 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482757+0000", 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8020000000000002e-06 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482759+0000", 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2589999999999999e-06 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496374+0000", 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013614446000000001 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496412+0000", 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8325999999999999e-05 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496470+0000", 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7593999999999998e-05 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:838 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3932160~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.083023305999999, 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013928474, 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 838 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482762+0000", 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482763+0000", 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0800000000000001e-07 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482763+0000", 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4600000000000003e-07 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482767+0000", 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0900000000000001e-06 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482769+0000", 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.283e-06 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496503+0000", 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013734 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496581+0000", 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8578999999999994e-05 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496691+0000", 2024-09-21T22:15:56.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000109268 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:839 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 3997696~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.083013176, 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014045281999999999, 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 839 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482772+0000", 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482773+0000", 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482777+0000", 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7639999999999996e-06 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482781+0000", 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3759999999999999e-06 2024-09-21T22:15:56.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482783+0000", 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.357e-06 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496727+0000", 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013944061000000001 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496768+0000", 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1318e-05 2024-09-21T22:15:56.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496818+0000", 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9202000000000001e-05 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:840 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 4063232~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.082999214000001, 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014530977, 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.585 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 840 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482786+0000", 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482787+0000", 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482788+0000", 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0669999999999999e-06 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482791+0000", 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.004e-06 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482793+0000", 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.847e-06 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496863+0000", 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014069504 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.496940+0000", 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6724000000000006e-05 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497317+0000", 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037761199999999999 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:841 3.13 3:cc6c8caa:::rbd_data.11856a5cf33b.0000000000000000:3 [read 4128768~567 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.082989147999999, 2024-09-21T22:15:56.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014781610000000001, 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 841 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:56.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482796+0000", 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482797+0000", 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.05e-07 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482798+0000", 2024-09-21T22:15:56.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9699999999999994e-07 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482801+0000", 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0690000000000002e-06 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.482803+0000", 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497346+0000", 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014543512 2024-09-21T22:15:56.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497388+0000", 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1618e-05 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.497578+0000", 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018990000000000001 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1015 3.15 3:ad0e59cf:::rbd_data.11856a5cf33b.0000000000000002:3 [read 3571712~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.593 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.058191618, 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013982695999999999, 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1015 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507594+0000", 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507596+0000", 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.996e-06 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507609+0000", 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2276000000000001e-05 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507614+0000", 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521139+0000", 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01352561 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521192+0000", 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2317000000000001e-05 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521577+0000", 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038497599999999998 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.597 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1016 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.058163755000001, 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014357010999999999, 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1016 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507622+0000", 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:15:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507624+0000", 2024-09-21T22:15:56.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:15:56.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507632+0000", 2024-09-21T22:15:56.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8269999999999998e-06 2024-09-21T22:15:56.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.507635+0000", 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521625+0000", 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013989661 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521759+0000", 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013431900000000001 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.521979+0000", 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000219803 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1018 3.15 3:ae013215:::rbd_data.1185ff358907.0000000000000002:head [write 0~1016375 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.057738666000001, 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019909570000000001, 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.603 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1018 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0399999999999996e-07 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509915+0000", 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018678049999999999 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509926+0000", 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0729e-05 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509937+0000", 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1447999999999999e-05 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522027+0000", 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012089379000000001 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522161+0000", 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134525 2024-09-21T22:15:56.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527828+0000", 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056671430000000004 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527880+0000", 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1329000000000003e-05 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527956+0000", 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6607999999999996e-05 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.607 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1019 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.05583296, 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014915193, 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1019 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.608 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509953+0000", 2024-09-21T22:15:56.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1099999999999995e-07 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509955+0000", 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509959+0000", 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509964+0000", 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5129999999999998e-06 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524643+0000", 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014679073000000001 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524742+0000", 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8604999999999995e-05 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524868+0000", 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012606299999999999 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1021 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.055816822000001, 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015100463, 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1021 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509969+0000", 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7300000000000002e-07 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509971+0000", 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.886e-06 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509974+0000", 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3720000000000001e-06 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509977+0000", 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7520000000000001e-06 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524899+0000", 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014921751 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.524964+0000", 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5703000000000004e-05 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525069+0000", 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104726 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1023 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:56.616 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.055368510999999, 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014865608000000001, 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1023 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:56.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510417+0000", 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510418+0000", 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4199999999999995e-07 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510422+0000", 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4220000000000002e-06 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510431+0000", 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4619999999999996e-06 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.510436+0000", 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3070000000000002e-06 2024-09-21T22:15:56.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525098+0000", 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014661990999999999 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525171+0000", 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2889e-05 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525283+0000", 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111795 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1134 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1277952~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.039995761, 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013821072, 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1134 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525790+0000", 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525793+0000", 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3269999999999999e-06 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525800+0000", 2024-09-21T22:15:56.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1640000000000004e-06 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525805+0000", 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0540000000000002e-06 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539256+0000", 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013451174 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539419+0000", 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00016245800000000001 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539611+0000", 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00019230500000000001 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1135 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1343488~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.039972516000001, 2024-09-21T22:15:56.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014032734, 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1135 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525813+0000", 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525814+0000", 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9299999999999997e-07 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525816+0000", 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7410000000000001e-06 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525828+0000", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1389999999999999e-05 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525835+0000", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5680000000000002e-06 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539642+0000", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013806992000000001 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539717+0000", 2024-09-21T22:15:56.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4788000000000003e-05 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539846+0000", 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012856200000000001 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1136 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1409024~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.039943055, 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014210109, 2024-09-21T22:15:56.629 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1136 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525842+0000", 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525843+0000", 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525845+0000", 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3760000000000002e-06 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525852+0000", 2024-09-21T22:15:56.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.613e-06 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525857+0000", 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7779999999999998e-06 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539873+0000", 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014016673 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.539942+0000", 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8436999999999995e-05 2024-09-21T22:15:56.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540053+0000", 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110808 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1137 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1474560~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.039922871, 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014416333, 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.633 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1137 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525863+0000", 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525866+0000", 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2310000000000001e-06 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525873+0000", 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6030000000000001e-06 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525877+0000", 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000002e-06 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540084+0000", 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014206185 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540160+0000", 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6132999999999998e-05 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540279+0000", 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011923 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1138 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1540096~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.039901832, 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015066355999999999, 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1138 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525884+0000", 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525890+0000", 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525897+0000", 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8519999999999998e-06 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525902+0000", 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4909999999999999e-06 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540309+0000", 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014407392999999999 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540386+0000", 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6775999999999998e-05 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540950+0000", 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00056422700000000004 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1139 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.039876955, 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017975142999999999, 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:15:56.641 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1139 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525911+0000", 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525917+0000", 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8599999999999998e-06 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525921+0000", 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540743+0000", 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014821166 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540833+0000", 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0853000000000006e-05 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543884+0000", 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030503219999999998 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2695 3.11 3:8c4b5157:::rbd_data.118555b0e245.0000000000000008:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.153569+0000", 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4122161569999996, 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014115437, 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2695 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153569+0000", 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153569+0000", 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153572+0000", 2024-09-21T22:15:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153586+0000", 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3997e-05 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153617+0000", 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1352000000000001e-05 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153633+0000", 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5670000000000001e-05 2024-09-21T22:15:56.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153750+0000", 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000116828 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.153903+0000", 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015335699999999999 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.156173+0000", 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022701599999999998 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.167603+0000", 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011429405 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.167616+0000", 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3468e-05 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.167649+0000", 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3154999999999997e-05 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.167685+0000", 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5404999999999997e-05 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8334 3.f 3:f4a3ce0c:::rbd_data.1185acca6c1f.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.923269+0000", 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.64251638, 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016045460000000001, 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:15:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8334 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923269+0000", 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923269+0000", 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:15:56.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923270+0000", 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1099999999999995e-07 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923273+0000", 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1810000000000001e-06 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923281+0000", 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4789999999999996e-06 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923289+0000", 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6709999999999999e-06 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923341+0000", 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1365e-05 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.923426+0000", 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5672000000000002e-05 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:56.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.926013+0000", 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025867389999999998 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.939184+0000", 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013170967 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.939228+0000", 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4298999999999997e-05 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:15:56.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.939273+0000", 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5083999999999997e-05 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.939315+0000", 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1291999999999997e-05 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:15:56.655 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:15:56.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:1173 read 0xf8c2f6 thru 0xf9a709 (0xe414 bytes) 2024-09-21T22:15:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:1177 writesame 0x6452687 thru 0x645d625 data_size 0x1(0xaf9f bytes) 2024-09-21T22:15:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:1179 writesame 0x98d0282 thru 0x98d98d5 data_size 0x12(0x9654 bytes) 2024-09-21T22:15:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:1180 trunc from 0x98d98d6 to 0x6675fe0 2024-09-21T22:15:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:1183 write 0x444961a thru 0x444b1b8 (0x1b9f bytes) 2024-09-21T22:15:56.658 INFO:teuthology.orchestra.run.smithi134.stdout:1185 writesame 0xe3cbe7c thru 0xe3da115 data_size 0x5(0xe29a bytes) 2024-09-21T22:15:56.658 INFO:teuthology.orchestra.run.smithi134.stdout:1186 read 0xc010357 thru 0xc01eb13 (0xe7bd bytes) 2024-09-21T22:15:56.658 INFO:teuthology.orchestra.run.smithi134.stdout:1189 trunc from 0xe3da116 to 0x42ace3e 2024-09-21T22:15:56.660 INFO:teuthology.orchestra.run.smithi134.stdout:1190 write 0xcb1b881 thru 0xcb23aee (0x826e bytes) 2024-09-21T22:15:56.663 INFO:teuthology.orchestra.run.smithi134.stdout:1191 punch from 0x855df5a to 0x856d7ac, (0xf852 bytes) 2024-09-21T22:15:56.663 INFO:teuthology.orchestra.run.smithi134.stdout:1194 punch from 0xa543860 to 0xa545590, (0x1d30 bytes) 2024-09-21T22:15:56.663 INFO:teuthology.orchestra.run.smithi134.stdout:1195 read 0x862ae40 thru 0x862db4a (0x2d0b bytes) 2024-09-21T22:15:56.663 INFO:teuthology.orchestra.run.smithi134.stdout:1196 write 0xa23ff7d thru 0xa24521d (0x52a1 bytes) 2024-09-21T22:15:56.667 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:15:56.666+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:15:56.672 INFO:teuthology.orchestra.run.smithi134.stdout:1197 write 0xe4d2c0f thru 0xe4d9ba9 (0x6f9b bytes) 2024-09-21T22:15:56.691 INFO:teuthology.orchestra.run.smithi134.stdout:1198 trunc from 0xe4d9baa to 0x33af072 2024-09-21T22:15:56.707 INFO:teuthology.orchestra.run.smithi134.stdout:1199 punch from 0x1a7979c to 0x1a87539, (0xdd9d bytes) 2024-09-21T22:15:56.707 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.712 INFO:teuthology.orchestra.run.smithi134.stdout:1201 writesame 0x37bcec0 thru 0x37c4ce1 data_size 0x5(0x7e22 bytes) 2024-09-21T22:15:56.713 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.732 INFO:teuthology.orchestra.run.smithi134.stdout:1203 write 0xe3e8168 thru 0xe3ea2a0 (0x2139 bytes) 2024-09-21T22:15:56.734 INFO:teuthology.orchestra.run.smithi134.stdout:1204 read 0x1d39841 thru 0x1d3e477 (0x4c37 bytes) 2024-09-21T22:15:56.735 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.735 INFO:teuthology.orchestra.run.smithi134.stdout:1207 read 0x2264f75 thru 0x2270ae9 (0xbb75 bytes) 2024-09-21T22:15:56.735 INFO:teuthology.orchestra.run.smithi134.stdout:1208 punch from 0x6e6f5a5 to 0x6e7dc0a, (0xe665 bytes) 2024-09-21T22:15:56.735 INFO:teuthology.orchestra.run.smithi134.stdout:1209 read 0x5900a69 thru 0x590b601 (0xab99 bytes) 2024-09-21T22:15:56.735 INFO:teuthology.orchestra.run.smithi134.stdout:1211 write 0x1a303ad thru 0x1a37d2e (0x7982 bytes) 2024-09-21T22:15:56.736 INFO:teuthology.orchestra.run.smithi134.stdout:1212 write 0xe0c0756 thru 0xe0ca0df (0x998a bytes) 2024-09-21T22:15:56.743 INFO:teuthology.orchestra.run.smithi134.stdout:1215 write 0x7abecb3 thru 0x7ac8ee8 (0xa236 bytes) 2024-09-21T22:15:56.751 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.751 INFO:teuthology.orchestra.run.smithi134.stdout:1217 write 0x629abb2 thru 0x629fad0 (0x4f1f bytes) 2024-09-21T22:15:56.754 INFO:teuthology.orchestra.run.smithi134.stdout:1218 punch from 0xc7e2be4 to 0xc7e9a6d, (0x6e89 bytes) 2024-09-21T22:15:56.754 INFO:teuthology.orchestra.run.smithi134.stdout:1220 punch from 0x6dd0666 to 0x6dd8948, (0x82e2 bytes) 2024-09-21T22:15:56.754 INFO:teuthology.orchestra.run.smithi134.stdout:1222 punch from 0x9d297ba to 0x9d33a61, (0xa2a7 bytes) 2024-09-21T22:15:56.754 INFO:teuthology.orchestra.run.smithi134.stdout:1223 read 0x61cb656 thru 0x61cbb27 (0x4d2 bytes) 2024-09-21T22:15:56.754 INFO:teuthology.orchestra.run.smithi134.stdout:1224 write 0x7bbe758 thru 0x7bc650c (0x7db5 bytes) 2024-09-21T22:15:56.757 INFO:teuthology.orchestra.run.smithi134.stdout:1227 punch from 0x337c9c8 to 0x3385b53, (0x918b bytes) 2024-09-21T22:15:56.757 INFO:teuthology.orchestra.run.smithi134.stdout:1229 punch from 0xc05832a to 0xc0627f7, (0xa4cd bytes) 2024-09-21T22:15:56.757 INFO:teuthology.orchestra.run.smithi134.stdout:1230 writesame 0xd7b535e thru 0xd7c30e1 data_size 0x2(0xdd84 bytes) 2024-09-21T22:15:56.767 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:56.767+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:56.769 INFO:teuthology.orchestra.run.smithi134.stdout:1231 punch from 0x7b8234f to 0x7b8c54e, (0xa1ff bytes) 2024-09-21T22:15:56.769 INFO:teuthology.orchestra.run.smithi134.stdout:1232 read 0x2b1fa8d thru 0x2b1fb76 (0xea bytes) 2024-09-21T22:15:56.770 INFO:teuthology.orchestra.run.smithi134.stdout:1233 read 0x6041839 thru 0x604b858 (0xa020 bytes) 2024-09-21T22:15:56.773 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:56.773 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:56.773 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:56.774 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:56.782 INFO:teuthology.orchestra.run.smithi134.stdout:1234 trunc from 0xe3ea2a1 to 0x4643c66 2024-09-21T22:15:56.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:15:56.809 INFO:teuthology.orchestra.run.smithi134.stdout:1236 writesame 0xe7fd45a thru 0xe80640c data_size 0x1(0x8fb3 bytes) 2024-09-21T22:15:56.809 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.809 INFO:teuthology.orchestra.run.smithi134.stdout:1238 write 0x92ae8d8 thru 0x92b346c (0x4b95 bytes) 2024-09-21T22:15:56.813 INFO:teuthology.orchestra.run.smithi134.stdout:1239 write 0x2418f5a thru 0x241b66d (0x2714 bytes) 2024-09-21T22:15:56.813 INFO:teuthology.orchestra.run.smithi134.stdout:1240 write 0x4c97135 thru 0x4c9dc17 (0x6ae3 bytes) 2024-09-21T22:15:56.823 INFO:teuthology.orchestra.run.smithi134.stdout:1241 trunc from 0xe80640d to 0x970ad71 2024-09-21T22:15:56.829 INFO:teuthology.orchestra.run.smithi134.stdout:1242 read 0x407c28f thru 0x4085676 (0x93e8 bytes) 2024-09-21T22:15:56.836 INFO:teuthology.orchestra.run.smithi134.stdout:1243 write 0xb9f51f5 thru 0xb9f92b4 (0x40c0 bytes) 2024-09-21T22:15:56.840 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.844 INFO:teuthology.orchestra.run.smithi134.stdout:1248 trunc from 0xb9f92b5 to 0x80d47df 2024-09-21T22:15:56.853 INFO:teuthology.orchestra.run.smithi134.stdout:1250 write 0x243187d thru 0x243dc20 (0xc3a4 bytes) 2024-09-21T22:15:56.854 INFO:teuthology.orchestra.run.smithi134.stdout:1251 write 0x3f05ac6 thru 0x3f11b6c (0xc0a7 bytes) 2024-09-21T22:15:56.858 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.866 INFO:teuthology.orchestra.run.smithi134.stdout:1254 write 0xa78fea9 thru 0xa794c6a (0x4dc2 bytes) 2024-09-21T22:15:56.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:56.867+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:56.872 INFO:teuthology.orchestra.run.smithi134.stdout:1256 write 0x3a97a43 thru 0x3a9fe8c (0x844a bytes) 2024-09-21T22:15:56.876 INFO:teuthology.orchestra.run.smithi134.stdout:1257 punch from 0x2b1d7d5 to 0x2b2a940, (0xd16b bytes) 2024-09-21T22:15:56.876 INFO:teuthology.orchestra.run.smithi134.stdout:1258 read 0x6baead2 thru 0x6bb6801 (0x7d30 bytes) 2024-09-21T22:15:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:1259 trunc from 0xa794c6b to 0xc2b0a77 2024-09-21T22:15:56.883 INFO:teuthology.orchestra.run.smithi134.stdout:1260 punch from 0x515ab00 to 0x51668ad, (0xbdad bytes) 2024-09-21T22:15:56.883 INFO:teuthology.orchestra.run.smithi134.stdout:1261 punch from 0x58ad0dc to 0x58b3b7e, (0x6aa2 bytes) 2024-09-21T22:15:56.883 INFO:teuthology.orchestra.run.smithi134.stdout:1262 write 0x3412a6a thru 0x34170d6 (0x466d bytes) 2024-09-21T22:15:56.884 INFO:teuthology.orchestra.run.smithi134.stdout:1263 write 0x20b053c thru 0x20be109 (0xdbce bytes) 2024-09-21T22:15:56.885 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.885 INFO:teuthology.orchestra.run.smithi134.stdout:1266 punch from 0xa6814da to 0xa683e73, (0x2999 bytes) 2024-09-21T22:15:56.886 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.886 INFO:teuthology.orchestra.run.smithi134.stdout:1270 writesame 0x530612f thru 0x53129a4 data_size 0x9(0xc876 bytes) 2024-09-21T22:15:56.890 INFO:teuthology.orchestra.run.smithi134.stdout:1271 write 0x16b557 thru 0x1703f4 (0x4e9e bytes) 2024-09-21T22:15:56.892 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.892 INFO:teuthology.orchestra.run.smithi134.stdout:1273 write 0x7d6e21a thru 0x7d721c6 (0x3fad bytes) 2024-09-21T22:15:56.903 INFO:teuthology.orchestra.run.smithi134.stdout:1274 write 0xecf8108 thru 0xecfd7ce (0x56c7 bytes) 2024-09-21T22:15:56.907 INFO:teuthology.orchestra.run.smithi134.stdout:1275 read 0x7e039c2 thru 0x7e0e274 (0xa8b3 bytes) 2024-09-21T22:15:56.907 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.907 INFO:teuthology.orchestra.run.smithi134.stdout:1278 write 0x86c3415 thru 0x86c38ce (0x4ba bytes) 2024-09-21T22:15:56.910 INFO:teuthology.orchestra.run.smithi134.stdout:1279 read 0x8bca392 thru 0x8bcc83b (0x24aa bytes) 2024-09-21T22:15:56.911 INFO:teuthology.orchestra.run.smithi134.stdout:1280 write 0x5b99135 thru 0x5ba5dfb (0xccc7 bytes) 2024-09-21T22:15:56.925 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:56.925 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:56.925 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:56.925 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:56.925 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:56.931 INFO:teuthology.orchestra.run.smithi134.stdout:1281 trunc from 0xecfd7cf to 0x1231b31 2024-09-21T22:15:56.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:15:56.955 INFO:teuthology.orchestra.run.smithi134.stdout:1282 read 0xe102f9 thru 0xe1febd (0xfbc5 bytes) 2024-09-21T22:15:56.965 INFO:teuthology.orchestra.run.smithi134.stdout:1283 write 0x502e825 thru 0x503350f (0x4ceb bytes) 2024-09-21T22:15:56.970 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.970 INFO:teuthology.orchestra.run.smithi134.stdout:1285 punch from 0x4ac6da8 to 0x4ad43c2, (0xd61a bytes) 2024-09-21T22:15:56.970 INFO:teuthology.orchestra.run.smithi134.stdout:1287 punch from 0x455c2dd to 0x455c56d, (0x290 bytes) 2024-09-21T22:15:56.970 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:56.969+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:56.976 INFO:teuthology.orchestra.run.smithi134.stdout:1288 write 0x61eca4d thru 0x61f2b73 (0x6127 bytes) 2024-09-21T22:15:56.980 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:56.992 INFO:teuthology.orchestra.run.smithi134.stdout:1291 write 0xb92fd0d thru 0xb93e7d9 (0xeacd bytes) 2024-09-21T22:15:57.000 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:57.000 INFO:teuthology.orchestra.run.smithi134.stdout:1293 writesame 0x70456e6 thru 0x7049fd0 data_size 0x1(0x48eb bytes) 2024-09-21T22:15:57.007 INFO:teuthology.orchestra.run.smithi134.stdout:1294 read 0x8113ce1 thru 0x811c16d (0x848d bytes) 2024-09-21T22:15:57.007 INFO:teuthology.orchestra.run.smithi134.stdout:1296 write 0x5b0e12b thru 0x5b13139 (0x500f bytes) 2024-09-21T22:15:57.012 INFO:teuthology.orchestra.run.smithi134.stdout:1297 read 0x4f0812f thru 0x4f13867 (0xb739 bytes) 2024-09-21T22:15:57.012 INFO:teuthology.orchestra.run.smithi134.stdout:1298 read 0x5c0eceb thru 0x5c17655 (0x896b bytes) 2024-09-21T22:15:57.021 INFO:teuthology.orchestra.run.smithi134.stdout:1299 writesame 0xe311d33 thru 0xe321037 data_size 0x1(0xf305 bytes) 2024-09-21T22:15:57.021 INFO:teuthology.orchestra.run.smithi134.stdout:1301 writesame 0x4b90721 thru 0x4b90765 data_size 0x1(0x45 bytes) 2024-09-21T22:15:57.022 INFO:teuthology.orchestra.run.smithi134.stdout:1302 punch from 0x3848a4e to 0x385017c, (0x772e bytes) 2024-09-21T22:15:57.022 INFO:teuthology.orchestra.run.smithi134.stdout:1303 read 0xac3c7b1 thru 0xac41592 (0x4de2 bytes) 2024-09-21T22:15:57.023 INFO:teuthology.orchestra.run.smithi134.stdout:1305 read 0x305e157 thru 0x30626f8 (0x45a2 bytes) 2024-09-21T22:15:57.023 INFO:teuthology.orchestra.run.smithi134.stdout:1306 read 0xc1dd0d2 thru 0xc1e16ef (0x461e bytes) 2024-09-21T22:15:57.023 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:57.023 INFO:teuthology.orchestra.run.smithi134.stdout:1308 read 0x43f94eb thru 0x4404442 (0xaf58 bytes) 2024-09-21T22:15:57.023 INFO:teuthology.orchestra.run.smithi134.stdout:1309 read 0x8ec887d thru 0x8ed14ef (0x8c73 bytes) 2024-09-21T22:15:57.023 INFO:teuthology.orchestra.run.smithi134.stdout:1310 read 0x6d795aa thru 0x6d845d0 (0xb027 bytes) 2024-09-21T22:15:57.024 INFO:teuthology.orchestra.run.smithi134.stdout:1313 writesame 0x1c630a0 thru 0x1c6d95f data_size 0x40(0xa8c0 bytes) 2024-09-21T22:15:57.028 INFO:teuthology.orchestra.run.smithi134.stdout:1314 read 0xc68d717 thru 0xc69d393 (0xfc7d bytes) 2024-09-21T22:15:57.028 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:57.028 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:15:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:1317 write 0x5194efb thru 0x51a27e8 (0xd8ee bytes) 2024-09-21T22:15:57.037 INFO:teuthology.orchestra.run.smithi134.stdout:1318 punch from 0x3ce4f5f to 0x3ce4fec, (0x8d bytes) 2024-09-21T22:15:57.037 INFO:teuthology.orchestra.run.smithi134.stdout:1319 punch from 0x6aed144 to 0x6af9651, (0xc50d bytes) 2024-09-21T22:15:57.037 INFO:teuthology.orchestra.run.smithi134.stdout:1320 write 0xd279d72 thru 0xd2852b6 (0xb545 bytes) 2024-09-21T22:15:57.040 INFO:teuthology.orchestra.run.smithi134.stdout:1321 writesame 0x4262ec6 thru 0x426cb29 data_size 0x2(0x9c64 bytes) 2024-09-21T22:15:57.045 INFO:teuthology.orchestra.run.smithi134.stdout:1322 read 0x35d6196 thru 0x35d9c5d (0x3ac8 bytes) 2024-09-21T22:15:57.045 INFO:teuthology.orchestra.run.smithi134.stdout:1323 write 0x3a41b37 thru 0x3a4b769 (0x9c33 bytes) 2024-09-21T22:15:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:1324 read 0x3e409f6 thru 0x3e479cd (0x6fd8 bytes) 2024-09-21T22:15:57.049 INFO:teuthology.orchestra.run.smithi134.stdout:1325 punch from 0xbe05fe to 0xbeba55, (0xb457 bytes) 2024-09-21T22:15:57.049 INFO:teuthology.orchestra.run.smithi134.stdout:1326 read 0xcde757d thru 0xcde84da (0xf5e bytes) 2024-09-21T22:15:57.049 INFO:teuthology.orchestra.run.smithi134.stdout:1327 punch from 0xab8ba0f to 0xab8d933, (0x1f24 bytes) 2024-09-21T22:15:57.050 INFO:teuthology.orchestra.run.smithi134.stdout:1330 punch from 0x4e03344 to 0x4e085ed, (0x52a9 bytes) 2024-09-21T22:15:57.050 INFO:teuthology.orchestra.run.smithi134.stdout:1331 punch from 0x6aa7d28 to 0x6ab096c, (0x8c44 bytes) 2024-09-21T22:15:57.050 INFO:teuthology.orchestra.run.smithi134.stdout:1332 read 0x126fb57 thru 0x1275a8f (0x5f39 bytes) 2024-09-21T22:15:57.050 INFO:teuthology.orchestra.run.smithi134.stdout:1334 read 0x3b69c0d thru 0x3b750f4 (0xb4e8 bytes) 2024-09-21T22:15:57.050 INFO:teuthology.orchestra.run.smithi134.stdout:1335 write 0x4882b4f thru 0x488e321 (0xb7d3 bytes) 2024-09-21T22:15:57.051 INFO:teuthology.orchestra.run.smithi134.stdout:1337 write 0x7917114 thru 0x7919991 (0x287e bytes) 2024-09-21T22:15:57.054 INFO:teuthology.orchestra.run.smithi134.stdout:1339 write 0xbc8ef9 thru 0xbcd3ed (0x44f5 bytes) 2024-09-21T22:15:57.061 INFO:teuthology.orchestra.run.smithi134.stdout:1341 write 0xe8de1ac thru 0xe8e7579 (0x93ce bytes) 2024-09-21T22:15:57.064 INFO:teuthology.orchestra.run.smithi134.stdout:1342 punch from 0x32e0a69 to 0x32eeb1d, (0xe0b4 bytes) 2024-09-21T22:15:57.065 INFO:teuthology.orchestra.run.smithi134.stdout:1343 write 0xe7215dd thru 0xe72adba (0x97de bytes) 2024-09-21T22:15:57.068 INFO:teuthology.orchestra.run.smithi134.stdout:1344 read 0x5f57fa8 thru 0x5f6339a (0xb3f3 bytes) 2024-09-21T22:15:57.068 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:956 3.6 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.571335356000001, 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010751263, 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 956 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494873+0000", 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0049999999999999e-06 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495626+0000", 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075252999999999995 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495638+0000", 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1952e-05 2024-09-21T22:15:57.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495650+0000", 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1739000000000001e-05 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495713+0000", 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999995e-05 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495836+0000", 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012285799999999999 2024-09-21T22:15:57.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495924+0000", 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7663000000000004e-05 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501700+0000", 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057759159999999999 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505497+0000", 2024-09-21T22:15:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003797417 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505574+0000", 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6917999999999998e-05 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505623+0000", 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8705000000000002e-05 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2308 3.b 3:d590e8c0:::rbd_data.1185ff358907.0000000000000009:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.566179524000001, 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011159749, 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2308 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500028+0000", 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500030+0000", 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500036+0000", 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8819999999999998e-06 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500042+0000", 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.993e-06 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510584+0000", 2024-09-21T22:15:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010542674 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510667+0000", 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3008000000000002e-05 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511187+0000", 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051960799999999996 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2310 3.1b 3:dc8a8db5:::rbd_data.1185ff358907.000000000000000b:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.566157352999999, 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011142944, 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2310 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500050+0000", 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500052+0000", 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1959999999999998e-06 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500058+0000", 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.212e-06 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500063+0000", 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.882e-06 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510572+0000", 2024-09-21T22:15:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010508639 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510659+0000", 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7677999999999996e-05 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511192+0000", 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053292499999999996 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2319 3.1b 3:de16f4f6:::rbd_data.1185ff358907.0000000000000004:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.565821010000001, 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011297852000000001, 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2319 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0399999999999996e-07 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500389+0000", 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500396+0000", 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4479999999999997e-06 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500401+0000", 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511205+0000", 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010804258000000001 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511257+0000", 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1751e-05 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511684+0000", 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042683100000000002 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2320 3.1b 3:de16f4f6:::rbd_data.1185ff358907.0000000000000004:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.565799282, 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011845501, 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2320 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500408+0000", 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4400000000000001e-07 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500410+0000", 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1390000000000002e-06 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500416+0000", 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7769999999999999e-06 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500420+0000", 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2849999999999996e-06 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511718+0000", 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011298450999999999 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511801+0000", 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2105000000000001e-05 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512253+0000", 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045239999999999999 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2325 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.565667592, 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014066749999999999, 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2325 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500540+0000", 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9100000000000003e-07 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500544+0000", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500555+0000", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1318000000000001e-05 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500565+0000", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0079e-05 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512283+0000", 2024-09-21T22:15:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011717049 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512360+0000", 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7093000000000002e-05 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512607+0000", 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024718400000000001 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514440+0000", 2024-09-21T22:15:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018330460000000001 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514515+0000", 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4818000000000001e-05 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514563+0000", 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7862999999999999e-05 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514606+0000", 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3389000000000001e-05 2024-09-21T22:15:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2326 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.562238808, 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010731123, 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2326 2024-09-21T22:15:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503970+0000", 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8560000000000001e-06 2024-09-21T22:15:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503979+0000", 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2469999999999997e-06 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503991+0000", 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2201999999999999e-05 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504002+0000", 2024-09-21T22:15:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0530000000000001e-05 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512946+0000", 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089438360000000001 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513034+0000", 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8038e-05 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513347+0000", 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031344499999999998 2024-09-21T22:15:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514500+0000", 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011528230000000001 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514615+0000", 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011526700000000001 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514661+0000", 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5726999999999998e-05 2024-09-21T22:15:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514699+0000", 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8152000000000003e-05 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2327 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.561777492000001, 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014161098, 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2327 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504430+0000", 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.172e-06 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504444+0000", 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3957999999999999e-05 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504457+0000", 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2693e-05 2024-09-21T22:15:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504465+0000", 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513649+0000", 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091831199999999995 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513731+0000", 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2293000000000006e-05 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514070+0000", 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033902599999999998 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516042+0000", 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019719730000000001 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518484+0000", 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002441927 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518545+0000", 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0816999999999997e-05 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518590+0000", 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5738999999999997e-05 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2328 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.559952429999999, 2024-09-21T22:15:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014248399, 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2328 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506255+0000", 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4200000000000004e-07 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506259+0000", 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9160000000000003e-06 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506268+0000", 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0140000000000004e-06 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506273+0000", 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514744+0000", 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084708739999999998 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514802+0000", 2024-09-21T22:15:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8187999999999999e-05 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514989+0000", 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018687399999999999 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517620+0000", 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002631272 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520440+0000", 2024-09-21T22:15:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028199660000000001 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520474+0000", 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.349e-05 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520503+0000", 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8824e-05 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2329 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.558092391000001, 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012486248, 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2329 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:15:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508115+0000", 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1399999999999996e-07 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508119+0000", 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0589999999999996e-06 2024-09-21T22:15:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508129+0000", 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4169999999999998e-06 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508134+0000", 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9819999999999999e-06 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515275+0000", 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071415619999999997 2024-09-21T22:15:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515357+0000", 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2099000000000001e-05 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515706+0000", 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034926400000000001 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518603+0000", 2024-09-21T22:15:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028969930000000001 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520544+0000", 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019409290000000001 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520575+0000", 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1044999999999998e-05 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520601+0000", 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5184000000000001e-05 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2340 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.556636964999999, 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013061006999999999, 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2340 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509571+0000", 2024-09-21T22:15:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7599999999999996e-07 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509575+0000", 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0670000000000002e-06 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509584+0000", 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6290000000000005e-06 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509589+0000", 2024-09-21T22:15:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516089+0000", 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064993739999999996 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516161+0000", 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1958999999999993e-05 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516524+0000", 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036302699999999998 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518609+0000", 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020855330000000001 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522528+0000", 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039189799999999999 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522589+0000", 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0411999999999997e-05 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522631+0000", 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2249000000000002e-05 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2341 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.556375024999999, 2024-09-21T22:15:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012992413, 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2341 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5000000000000002e-07 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509836+0000", 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7680000000000002e-06 2024-09-21T22:15:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509844+0000", 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5680000000000002e-06 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509854+0000", 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0332999999999999e-05 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516927+0000", 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070725029999999999 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517000+0000", 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3350999999999996e-05 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517317+0000", 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031706600000000002 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519821+0000", 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025039649999999999 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522678+0000", 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002856716 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522755+0000", 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7756000000000006e-05 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522824+0000", 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8737000000000003e-05 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2342 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.556041337, 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012819782, 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2342 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510166+0000", 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510170+0000", 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.693e-06 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510178+0000", 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2490000000000001e-06 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510182+0000", 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2300000000000002e-06 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517673+0000", 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074904000000000004 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517756+0000", 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2899999999999996e-05 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518080+0000", 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032417399999999999 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520516+0000", 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002435857 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522891+0000", 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023752539999999998 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522947+0000", 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6338999999999997e-05 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522985+0000", 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7985000000000003e-05 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2343 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.554698140999999, 2024-09-21T22:15:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011604199000000001, 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2343 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.06e-07 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511514+0000", 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3630000000000004e-06 2024-09-21T22:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511524+0000", 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511530+0000", 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1739999999999997e-06 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518635+0000", 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071051120000000002 2024-09-21T22:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518711+0000", 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5659000000000002e-05 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518903+0000", 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019194399999999999 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.521701+0000", 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027975489999999999 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523042+0000", 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013413500000000001 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523075+0000", 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2928000000000001e-05 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523113+0000", 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7898999999999997e-05 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2344 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.553696228, 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014323447, 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2344 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1200000000000002e-07 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512516+0000", 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4000000000000002e-06 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512527+0000", 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1015999999999999e-05 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512532+0000", 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0749999999999997e-06 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519269+0000", 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067374419999999997 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519320+0000", 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0447e-05 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:15:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519537+0000", 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000217584 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523121+0000", 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003583859 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526752+0000", 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036310639999999998 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526798+0000", 2024-09-21T22:15:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6270000000000003e-05 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526834+0000", 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5577999999999997e-05 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2362 3.17 3:ed4fe5a8:::rbd_data.118555b0e245.0000000000000006:head [write 0~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.542485751999999, 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011794905, 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2362 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523723+0000", 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5090000000000001e-06 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524071+0000", 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034883499999999998 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524085+0000", 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3774000000000001e-05 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524096+0000", 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0713999999999999e-05 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524153+0000", 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7367000000000001e-05 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524237+0000", 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3567999999999997e-05 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524321+0000", 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4309999999999997e-05 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526229+0000", 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019082669999999999 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535431+0000", 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092015959999999994 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535470+0000", 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9320000000000003e-05 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535516+0000", 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5645000000000001e-05 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:4644 3.1f 3:fe6371c1:::rbd_data.1185e2328614.0000000000000023:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9036770409999999, 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012061578999999999, 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4644 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0200000000000002e-07 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162537+0000", 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.297e-06 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162545+0000", 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162550+0000", 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9679999999999997e-06 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162592+0000", 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2487000000000002e-05 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162683+0000", 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0240000000000003e-05 2024-09-21T22:15:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.164424+0000", 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017417660000000001 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174516+0000", 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010091216 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174528+0000", 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2014999999999999e-05 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174560+0000", 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2233999999999997e-05 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174591+0000", 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1430000000000002e-05 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7980 3.1f 3:fe5a2518:::rbd_data.1185acca6c1f.0000000000000015:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.512924+0000", 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5532827220000001, 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014219617, 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7980 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512924+0000", 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512924+0000", 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512926+0000", 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.809e-06 2024-09-21T22:15:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512935+0000", 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3200000000000006e-06 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512951+0000", 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5780000000000001e-05 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512960+0000", 2024-09-21T22:15:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9279999999999999e-06 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513044+0000", 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3813999999999994e-05 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513098+0000", 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4252999999999997e-05 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.515243+0000", 2024-09-21T22:15:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002145194 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527022+0000", 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011778729999999999 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527062+0000", 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0355000000000002e-05 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527104+0000", 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1386e-05 2024-09-21T22:15:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527144+0000", 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0048e-05 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8078 3.12 3:4b6efdab:::rbd_data.1185acca6c1f.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.648828+0000", 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.4173784979999999, 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012897707, 2024-09-21T22:15:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8078 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648828+0000", 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648828+0000", 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648829+0000", 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0400000000000005e-07 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648833+0000", 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1139999999999999e-06 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648843+0000", 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8030000000000008e-06 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648848+0000", 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.242e-06 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648887+0000", 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8503e-05 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648934+0000", 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7352999999999999e-05 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.650755+0000", 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00182058 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661646+0000", 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010891764999999999 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661658+0000", 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1685000000000001e-05 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661691+0000", 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661726+0000", 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4697999999999999e-05 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8129 3.12 3:4b6efdab:::rbd_data.1185acca6c1f.0000000000000020:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.704734+0000", 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3614729589999999, 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011006299000000001, 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8129 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704734+0000", 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704734+0000", 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704735+0000", 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4900000000000005e-07 2024-09-21T22:15:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704740+0000", 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1200000000000001e-06 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704750+0000", 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0198e-05 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704755+0000", 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4149999999999998e-06 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704808+0000", 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2611999999999997e-05 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704858+0000", 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139000000000002e-05 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.706482+0000", 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016233860000000001 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715586+0000", 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091041319999999992 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715631+0000", 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4990000000000001e-05 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715689+0000", 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8833999999999999e-05 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715740+0000", 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0624000000000002e-05 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.172 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:57.173 INFO:teuthology.orchestra.run.smithi134.stdout:1345 write 0x7220569 thru 0x72211ea (0xc82 bytes) 2024-09-21T22:15:57.173 INFO:teuthology.orchestra.run.smithi134.stdout:1346 read 0xcbc6c1d thru 0xcbcc442 (0x5826 bytes) 2024-09-21T22:15:57.173 INFO:teuthology.orchestra.run.smithi134.stdout:1348 writesame 0x587147a thru 0x587a82f data_size 0x25(0x93b6 bytes) 2024-09-21T22:15:57.173 INFO:teuthology.orchestra.run.smithi134.stdout:1349 read 0xb38acf3 thru 0xb38e977 (0x3c85 bytes) 2024-09-21T22:15:57.173 INFO:teuthology.orchestra.run.smithi134.stdout:1351 read 0x706c688 thru 0x7070a6d (0x43e6 bytes) 2024-09-21T22:15:57.173 INFO:teuthology.orchestra.run.smithi134.stdout:1354 writesame 0xe2abb1b thru 0xe2b2cd9 data_size 0x1(0x71bf bytes) 2024-09-21T22:15:57.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:15:57.174 INFO:teuthology.orchestra.run.smithi134.stdout:1356 punch from 0x8f8f686 to 0x8f91d29, (0x26a3 bytes) 2024-09-21T22:15:57.174 INFO:teuthology.orchestra.run.smithi134.stdout:1357 clone 5 order 23 su 262144 sc 3 2024-09-21T22:15:57.175 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:57.175+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:57.276 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:57.275+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:57.318 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:57.319 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:57.328 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:15:57.377 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:57.376+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:57.430 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:15:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:15:57.430 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:57.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:15:57.478 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:57.477+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:57.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:57.577+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.138705882, 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043089249999999999, 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443484+0000", 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5140000000000002e-06 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443492+0000", 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4259999999999997e-06 2024-09-21T22:15:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443501+0000", 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3980000000000005e-06 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443536+0000", 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4604000000000003e-05 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443551+0000", 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5387999999999999e-05 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447726+0000", 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041748530000000001 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447789+0000", 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3540000000000005e-05 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:956 3.6 e30/23 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head v 30'7, mlcod=28'5)", 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.086154697, 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091893070000000007, 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497369+0000", 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001336804 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497387+0000", 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8014999999999999e-05 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497398+0000", 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1581e-05 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497480+0000", 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1874999999999998e-05 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497511+0000", 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1103999999999999e-05 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505165+0000", 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076536219999999997 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505221+0000", 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6026000000000002e-05 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:960 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.084221146000001, 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084308620000000008, 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 960 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497968+0000", 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.429e-06 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498743+0000", 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077512399999999997 2024-09-21T22:15:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498766+0000", 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2983999999999999e-05 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498790+0000", 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389e-05 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498881+0000", 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0780999999999997e-05 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498890+0000", 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7579999999999998e-06 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500819+0000", 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929491 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500968+0000", 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014854199999999999 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501114+0000", 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146298 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505622+0000", 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045081649999999997 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506247+0000", 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062455099999999999 2024-09-21T22:15:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506353+0000", 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010586699999999999 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506396+0000", 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3482999999999997e-05 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:1617 3.8 3:1519a0ec:::rbd_data.1185ff358907.0000000000000063:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.010628174000001, 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043537289999999998, 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 1617 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571561+0000", 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2350000000000002e-06 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571851+0000", 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029007799999999998 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571866+0000", 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5241e-05 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571875+0000", 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4439999999999997e-06 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571949+0000", 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4082e-05 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.572140+0000", 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019105599999999999 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575746+0000", 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036054630000000002 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575815+0000", 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9402999999999999e-05 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575912+0000", 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6726999999999997e-05 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2305 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.082269204999999, 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042464419999999996, 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2305 2024-09-21T22:15:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499918+0000", 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:15:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499921+0000", 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7879999999999998e-06 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499932+0000", 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1629e-05 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499940+0000", 2024-09-21T22:15:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0590000000000003e-06 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503530+0000", 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035898150000000001 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503609+0000", 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9284999999999997e-05 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504164+0000", 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055435700000000001 2024-09-21T22:15:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2306 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.082237087999999, 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004774197, 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2306 2024-09-21T22:15:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499950+0000", 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0800000000000005e-07 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499952+0000", 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.261e-06 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499959+0000", 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499964+0000", 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:15:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504193+0000", 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004229684 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504269+0000", 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5956000000000003e-05 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504724+0000", 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045437400000000001 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2346 3.0 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.067184352, 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083135759999999996, 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2346 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515003+0000", 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-06 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515950+0000", 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094629499999999999 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515967+0000", 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7554000000000002e-05 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515974+0000", 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516038+0000", 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3176999999999995e-05 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516167+0000", 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012979800000000001 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516306+0000", 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138887 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522280+0000", 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059732750000000001 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523229+0000", 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094895000000000005 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523280+0000", 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1554999999999997e-05 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523316+0000", 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5602999999999998e-05 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2364 3.0 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head [write 0~983607 [fadvise_sequential+fadvise_nocache],write 1048576~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.055058798999999, 2024-09-21T22:15:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077052980000000002, 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2364 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527129+0000", 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527492+0000", 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036298100000000001 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527504+0000", 2024-09-21T22:15:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1814000000000001e-05 2024-09-21T22:15:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527510+0000", 2024-09-21T22:15:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4649999999999999e-06 2024-09-21T22:15:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527564+0000", 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3893000000000001e-05 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527665+0000", 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101468 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527817+0000", 2024-09-21T22:15:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015177100000000001 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534445+0000", 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066276169999999997 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534752+0000", 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030757499999999998 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534799+0000", 2024-09-21T22:15:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6310000000000002e-05 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534833+0000", 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341999999999997e-05 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2417 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.092118392, 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043883469999999999, 2024-09-21T22:15:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2417 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490070+0000", 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490081+0000", 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0893000000000001e-05 2024-09-21T22:15:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490099+0000", 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7648000000000001e-05 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490108+0000", 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0000000000000002e-06 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490162+0000", 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4846000000000003e-05 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490168+0000", 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7749999999999998e-06 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492060+0000", 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018918450000000001 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492159+0000", 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8827999999999996e-05 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492338+0000", 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017905500000000001 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.493985+0000", 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016466 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494382+0000", 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039761899999999999 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494424+0000", 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1544000000000001e-05 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494456+0000", 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2706000000000002e-05 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2625 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5351870539999997, 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045043440000000004, 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2625 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047001+0000", 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5939999999999999e-06 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047017+0000", 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5919000000000001e-05 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047034+0000", 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6818000000000001e-05 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047044+0000", 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0083e-05 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047129+0000", 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5205999999999997e-05 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047253+0000", 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012408699999999999 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047731+0000", 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047771700000000001 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051255+0000", 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035239619999999998 2024-09-21T22:15:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051430+0000", 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017474 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051466+0000", 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6492999999999998e-05 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051504+0000", 2024-09-21T22:15:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7725000000000002e-05 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2636 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5236325849999997, 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004016632, 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2636 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058555+0000", 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.398e-06 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058563+0000", 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7379999999999994e-06 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058579+0000", 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5662999999999999e-05 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058586+0000", 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2649999999999999e-06 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058636+0000", 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0358999999999997e-05 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058704+0000", 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8182999999999994e-05 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058948+0000", 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000243322 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059681+0000", 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073306399999999996 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062499+0000", 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028180499999999999 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062534+0000", 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4799999999999999e-05 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062571+0000", 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6789999999999998e-05 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2722 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3729910000000007, 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041655779999999996, 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2722 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209198+0000", 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.351e-06 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209213+0000", 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4847e-05 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209239+0000", 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6533000000000002e-05 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209252+0000", 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2998e-05 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209326+0000", 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4041999999999993e-05 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209405+0000", 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9246999999999995e-05 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209669+0000", 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026352999999999999 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.212980+0000", 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033110209999999999 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213279+0000", 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029891100000000001 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213320+0000", 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0930999999999998e-05 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213361+0000", 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1167000000000001e-05 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:4703 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:52.918982+0000", 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6632044979999998, 2024-09-21T22:15:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049461419999999997, 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4703 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918982+0000", 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918982+0000", 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918983+0000", 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918986+0000", 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.428e-06 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918994+0000", 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918999+0000", 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9690000000000002e-06 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.919028+0000", 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9609000000000001e-05 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.919071+0000", 2024-09-21T22:15:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2724e-05 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.923831+0000", 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047593710000000001 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.923865+0000", 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499000000000003e-05 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.923928+0000", 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3097999999999998e-05 2024-09-21T22:15:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7887 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.1782776269999999, 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019112581, 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7887 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403910+0000", 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3300000000000001e-07 2024-09-21T22:15:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403914+0000", 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1370000000000004e-06 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403924+0000", 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0365e-05 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403929+0000", 2024-09-21T22:15:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403979+0000", 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0420000000000002e-05 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.404033+0000", 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3489999999999998e-05 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.407250+0000", 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003216975 2024-09-21T22:15:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422946+0000", 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015696266 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422957+0000", 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0608000000000001e-05 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422987+0000", 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0552999999999997e-05 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.423021+0000", 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4056000000000001e-05 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:7887 3.4 e41/23 ondisk, result = 0)", 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.165974056, 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067395329999999998, 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416213+0000", 2024-09-21T22:15:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416216+0000", 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0989999999999999e-06 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416227+0000", 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0604e-05 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416232+0000", 2024-09-21T22:15:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.938e-06 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422936+0000", 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067038089999999998 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422942+0000", 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5939999999999999e-06 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422952+0000", 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8090000000000004e-06 2024-09-21T22:15:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7981 3.0 3:03cb8c30:::rbd_data.1185acca6c1f.000000000000001b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.0688443599999999, 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015150808999999999, 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7981 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513343+0000", 2024-09-21T22:15:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6000000000000003e-07 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513347+0000", 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9910000000000004e-06 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513358+0000", 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0772e-05 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513363+0000", 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1490000000000002e-06 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513403+0000", 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0290000000000002e-05 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513450+0000", 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7349999999999999e-05 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.515475+0000", 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020249640000000002 2024-09-21T22:15:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528357+0000", 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012881782 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528396+0000", 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8674000000000003e-05 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528438+0000", 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2006999999999999e-05 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528493+0000", 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.507e-05 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:7981 3.0 e41/23 ondisk, result = 0)", 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.524248+0000", 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.0579386550000001, 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042513150000000003, 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524248+0000", 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524248+0000", 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524249+0000", 2024-09-21T22:15:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5600000000000005e-07 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524252+0000", 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2320000000000001e-06 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524263+0000", 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1561e-05 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524270+0000", 2024-09-21T22:15:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1959999999999996e-06 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528385+0000", 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041150980000000002 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528392+0000", 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0389999999999999e-06 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528499+0000", 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107433 2024-09-21T22:15:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8534 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.4199413860000001, 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013031713, 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8534 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162246+0000", 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162250+0000", 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9550000000000002e-06 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162259+0000", 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5780000000000005e-06 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162264+0000", 2024-09-21T22:15:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162312+0000", 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7361000000000003e-05 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162368+0000", 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6104999999999999e-05 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.164384+0000", 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020158120000000001 2024-09-21T22:15:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175199+0000", 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010815455 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175212+0000", 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2422000000000001e-05 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175243+0000", 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1142000000000001e-05 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175277+0000", 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4057999999999998e-05 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:8534 3.4 e42/23 ondisk, result = 0)", 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.170846+0000", 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.411340357, 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043594439999999996, 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170846+0000", 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170846+0000", 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170847+0000", 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:15:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170849+0000", 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5969999999999999e-06 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170860+0000", 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0231000000000001e-05 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170865+0000", 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1749999999999996e-06 2024-09-21T22:15:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175189+0000", 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043239849999999998 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175195+0000", 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3069999999999999e-06 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175206+0000", 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0509000000000001e-05 2024-09-21T22:15:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:9279 3.8 3:16ab6a84:::rbd_data.1185acca6c1f.0000000000000011:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.040377+0000", 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.54180986099999995, 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041612400000000001, 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:15:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 9279 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040377+0000", 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040377+0000", 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040378+0000", 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5889999999999999e-06 2024-09-21T22:15:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040387+0000", 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6889999999999993e-06 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040404+0000", 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7271000000000001e-05 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040412+0000", 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8180000000000004e-06 2024-09-21T22:15:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040468+0000", 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5559000000000001e-05 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040537+0000", 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9142999999999999e-05 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.044420+0000", 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038829419999999999 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.044462+0000", 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2237000000000002e-05 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.044538+0000", 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5992e-05 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:15:57.683 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:57.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:15:57.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:15:57.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:57.684+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:57.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:57.784+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:57.832 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:15:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:15:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:15:57.832 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:15:57.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:15:57.847 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:15:57.847 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:15:57.864 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:15:57.865 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:15:57.881 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:15:57.881 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:15:57.881 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-21T22:15:57.886 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:57.886+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:57.900 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:15:57.901 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:15:57.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:15:57.921 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:15:57.921 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:15:57.944 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:15:57.944 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:15:57.959 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:57.959 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:57.962 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:15:57.962 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:15:57.965 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T22:15:57.965 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T22:15:57.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:15:57.987 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:57.987+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:58.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:58.087+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:58.115 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:58.115 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:58.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:15:58.189 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:58.189+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:58.236 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:58.278 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:58.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:15:58.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:15:58.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:58.322+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:config diff 2024-09-21T22:15:58.378 INFO:teuthology.orchestra.run.smithi134.stderr:config diff get 2024-09-21T22:15:58.379 INFO:teuthology.orchestra.run.smithi134.stderr:config get 2024-09-21T22:15:58.379 INFO:teuthology.orchestra.run.smithi134.stderr:config help [] 2024-09-21T22:15:58.379 INFO:teuthology.orchestra.run.smithi134.stderr:config set ... 2024-09-21T22:15:58.379 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: invalid command 2024-09-21T22:15:58.380 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:15:58.381 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-21T22:15:58.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:58.421+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:58.423 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:58.423 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:58.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:15:58.491 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:15:58.491+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:15:58.535 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:58.535 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:58.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:15:58.628 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:58.627+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:58.668 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:58.667+0000 7ff53a00d640 -1 osd.3 26 log_to_monitors true 2024-09-21T22:15:58.688 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:58.688 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:58.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:58.692+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:58.697 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:15:58.793 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:58.793+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:58.841 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:58.841 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:58.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:15:58.900 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:15:58.912 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:15:58.911+0000 7ff52d86b640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:15:58.934 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:58.933+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:58.995 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:58.994+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:59.061 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:59.062 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:59.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:15:59.121 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:15:59.120+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:15:59.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:15:59.196+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:15:59.225 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:59.225 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:59.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:15:59.298 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:59.297+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:59.338 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:59.338 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:59.347 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:15:59.431 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:59.430+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:59.491 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:59.491 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:59.498 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:59.498+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:59.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:15:59.599 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:15:59.598+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:15:59.644 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:59.644 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:59.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:15:59.737 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:59.736+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:59.797 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:59.797 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:59.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:15:59.800+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:15:59.806 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:15:59.901 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:15:59.900+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:15:59.952 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:15:59.952 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:15:59.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:15:59.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:00.005 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:00.004+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:00.073 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:00.073 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:00.082 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:00.126 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:00.125+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:00.130 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:00.130 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:00.147 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:00.148 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:00.164 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:00.164 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:00.180 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:00.180 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-21T22:16:00.190 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:00.191 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:00.191 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:00.191 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:00.191 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:00.197 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:00.198 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:00.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:00.215 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:00.215 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:00.216 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:00.214+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:00.232 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:00.232 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:00.249 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:00.249 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:00.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:00.303+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:00.323 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:00.323 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:00.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:00.323 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:00.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:956 3.6 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:00.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.825788429999999, 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010751263, 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 956 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:16:00.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494871+0000", 2024-09-21T22:16:00.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.494873+0000", 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0049999999999999e-06 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495626+0000", 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075252999999999995 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495638+0000", 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1952e-05 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495650+0000", 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1739000000000001e-05 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495713+0000", 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999995e-05 2024-09-21T22:16:00.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495836+0000", 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012285799999999999 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.495924+0000", 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7663000000000004e-05 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501700+0000", 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057759159999999999 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505497+0000", 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003797417 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505574+0000", 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6917999999999998e-05 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505623+0000", 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8705000000000002e-05 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2308 3.b 3:d590e8c0:::rbd_data.1185ff358907.0000000000000009:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.820632598, 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011159749, 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2308 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500027+0000", 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500028+0000", 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500030+0000", 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500036+0000", 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8819999999999998e-06 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500042+0000", 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.993e-06 2024-09-21T22:16:00.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510584+0000", 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010542674 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510667+0000", 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3008000000000002e-05 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511187+0000", 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051960799999999996 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2310 3.1b 3:dc8a8db5:::rbd_data.1185ff358907.000000000000000b:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.820610427, 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011142944, 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2310 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500049+0000", 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500050+0000", 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500052+0000", 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1959999999999998e-06 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500058+0000", 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.212e-06 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500063+0000", 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.882e-06 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510572+0000", 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010508639 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510659+0000", 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7677999999999996e-05 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511192+0000", 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053292499999999996 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2319 3.1b 3:de16f4f6:::rbd_data.1185ff358907.0000000000000004:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.820274083999999, 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011297852000000001, 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2319 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500386+0000", 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0399999999999996e-07 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500389+0000", 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500396+0000", 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4479999999999997e-06 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500401+0000", 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511205+0000", 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010804258000000001 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511257+0000", 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1751e-05 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511684+0000", 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042683100000000002 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2320 3.1b 3:de16f4f6:::rbd_data.1185ff358907.0000000000000004:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.820252355999999, 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011845501, 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2320 2024-09-21T22:16:00.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500407+0000", 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500408+0000", 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4400000000000001e-07 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500410+0000", 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1390000000000002e-06 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500416+0000", 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7769999999999999e-06 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500420+0000", 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2849999999999996e-06 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511718+0000", 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011298450999999999 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511801+0000", 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2105000000000001e-05 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512253+0000", 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045239999999999999 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2325 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.820120665999999, 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014066749999999999, 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2325 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500539+0000", 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500540+0000", 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9100000000000003e-07 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500544+0000", 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500555+0000", 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1318000000000001e-05 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.500565+0000", 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0079e-05 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512283+0000", 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011717049 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512360+0000", 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7093000000000002e-05 2024-09-21T22:16:00.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512607+0000", 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024718400000000001 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514440+0000", 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018330460000000001 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514515+0000", 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4818000000000001e-05 2024-09-21T22:16:00.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514563+0000", 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7862999999999999e-05 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514606+0000", 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3389000000000001e-05 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.354 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2326 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.816691882000001, 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010731123, 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2326 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:16:00.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503968+0000", 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503970+0000", 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8560000000000001e-06 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503979+0000", 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2469999999999997e-06 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503991+0000", 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2201999999999999e-05 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504002+0000", 2024-09-21T22:16:00.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0530000000000001e-05 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512946+0000", 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089438360000000001 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513034+0000", 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8038e-05 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513347+0000", 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031344499999999998 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514500+0000", 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011528230000000001 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514615+0000", 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011526700000000001 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514661+0000", 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5726999999999998e-05 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514699+0000", 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8152000000000003e-05 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2327 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.816230566, 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014161098, 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2327 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.361 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504429+0000", 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504430+0000", 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.172e-06 2024-09-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504444+0000", 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3957999999999999e-05 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504457+0000", 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2693e-05 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504465+0000", 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T22:16:00.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513649+0000", 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091831199999999995 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.513731+0000", 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2293000000000006e-05 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514070+0000", 2024-09-21T22:16:00.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033902599999999998 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516042+0000", 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019719730000000001 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518484+0000", 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002441927 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518545+0000", 2024-09-21T22:16:00.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0816999999999997e-05 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518590+0000", 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5738999999999997e-05 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2328 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.814405504, 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014248399, 2024-09-21T22:16:00.366 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2328 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506254+0000", 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506255+0000", 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4200000000000004e-07 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506259+0000", 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9160000000000003e-06 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506268+0000", 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0140000000000004e-06 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.506273+0000", 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514744+0000", 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084708739999999998 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514802+0000", 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8187999999999999e-05 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.514989+0000", 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018687399999999999 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517620+0000", 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002631272 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520440+0000", 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028199660000000001 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520474+0000", 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.349e-05 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520503+0000", 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8824e-05 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2329 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.812545464999999, 2024-09-21T22:16:00.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012486248, 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2329 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508114+0000", 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508115+0000", 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1399999999999996e-07 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508119+0000", 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0589999999999996e-06 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508129+0000", 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4169999999999998e-06 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.508134+0000", 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9819999999999999e-06 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515275+0000", 2024-09-21T22:16:00.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071415619999999997 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515357+0000", 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2099000000000001e-05 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515706+0000", 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034926400000000001 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518603+0000", 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028969930000000001 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520544+0000", 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019409290000000001 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520575+0000", 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1044999999999998e-05 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520601+0000", 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5184000000000001e-05 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2340 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.811090039, 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013061006999999999, 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2340 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509570+0000", 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509571+0000", 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7599999999999996e-07 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509575+0000", 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0670000000000002e-06 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509584+0000", 2024-09-21T22:16:00.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6290000000000005e-06 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509589+0000", 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516089+0000", 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064993739999999996 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516161+0000", 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1958999999999993e-05 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516524+0000", 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036302699999999998 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518609+0000", 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020855330000000001 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522528+0000", 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039189799999999999 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522589+0000", 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0411999999999997e-05 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522631+0000", 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2249000000000002e-05 2024-09-21T22:16:00.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2341 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.810828099, 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012992413, 2024-09-21T22:16:00.384 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2341 2024-09-21T22:16:00.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.386 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:16:00.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509832+0000", 2024-09-21T22:16:00.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5000000000000002e-07 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509836+0000", 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7680000000000002e-06 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509844+0000", 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5680000000000002e-06 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.509854+0000", 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0332999999999999e-05 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516927+0000", 2024-09-21T22:16:00.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070725029999999999 2024-09-21T22:16:00.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517000+0000", 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3350999999999996e-05 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517317+0000", 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031706600000000002 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519821+0000", 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025039649999999999 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522678+0000", 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002856716 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522755+0000", 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7756000000000006e-05 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522824+0000", 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8737000000000003e-05 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2342 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.810494411000001, 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012819782, 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2342 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510165+0000", 2024-09-21T22:16:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510166+0000", 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510170+0000", 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.693e-06 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510178+0000", 2024-09-21T22:16:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2490000000000001e-06 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.510182+0000", 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2300000000000002e-06 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517673+0000", 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074904000000000004 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517756+0000", 2024-09-21T22:16:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2899999999999996e-05 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518080+0000", 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032417399999999999 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.520516+0000", 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002435857 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522891+0000", 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023752539999999998 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522947+0000", 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6338999999999997e-05 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522985+0000", 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7985000000000003e-05 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2343 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.809151215, 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011604199000000001, 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2343 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:16:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:16:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511509+0000", 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.06e-07 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511514+0000", 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3630000000000004e-06 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511524+0000", 2024-09-21T22:16:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.511530+0000", 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1739999999999997e-06 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518635+0000", 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071051120000000002 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518711+0000", 2024-09-21T22:16:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5659000000000002e-05 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.518903+0000", 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019194399999999999 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.521701+0000", 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027975489999999999 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523042+0000", 2024-09-21T22:16:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013413500000000001 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523075+0000", 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2928000000000001e-05 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523113+0000", 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7898999999999997e-05 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2344 3.1b 3:d891f274:::rbd_object_map.118555b0e245.0000000000000006:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.808149302, 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014323447, 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2344 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512511+0000", 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1200000000000002e-07 2024-09-21T22:16:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512516+0000", 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4000000000000002e-06 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512527+0000", 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1015999999999999e-05 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.512532+0000", 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0749999999999997e-06 2024-09-21T22:16:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519269+0000", 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067374419999999997 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519320+0000", 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0447e-05 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.519537+0000", 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000217584 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523121+0000", 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003583859 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526752+0000", 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036310639999999998 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526798+0000", 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6270000000000003e-05 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526834+0000", 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5577999999999997e-05 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2362 3.17 3:ed4fe5a8:::rbd_data.118555b0e245.0000000000000006:head [write 0~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.796938826, 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011794905, 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2362 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:16:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523721+0000", 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523723+0000", 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5090000000000001e-06 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524071+0000", 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034883499999999998 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524085+0000", 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3774000000000001e-05 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524096+0000", 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0713999999999999e-05 2024-09-21T22:16:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524153+0000", 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7367000000000001e-05 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524237+0000", 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3567999999999997e-05 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.524321+0000", 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4309999999999997e-05 2024-09-21T22:16:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.526229+0000", 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019082669999999999 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535431+0000", 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092015959999999994 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535470+0000", 2024-09-21T22:16:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9320000000000003e-05 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.535516+0000", 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5645000000000001e-05 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:4644 3.1f 3:fe6371c1:::rbd_data.1185e2328614.0000000000000023:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.1581301150000005, 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012061578999999999, 2024-09-21T22:16:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4644 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:16:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162530+0000", 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0200000000000002e-07 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162537+0000", 2024-09-21T22:16:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.297e-06 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162545+0000", 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162550+0000", 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9679999999999997e-06 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162592+0000", 2024-09-21T22:16:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2487000000000002e-05 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.162683+0000", 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0240000000000003e-05 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.164424+0000", 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017417660000000001 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174516+0000", 2024-09-21T22:16:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010091216 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174528+0000", 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2014999999999999e-05 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174560+0000", 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2233999999999997e-05 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.174591+0000", 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1430000000000002e-05 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7980 3.1f 3:fe5a2518:::rbd_data.1185acca6c1f.0000000000000015:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.512924+0000", 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.8077357960000002, 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014219617, 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7980 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512924+0000", 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512924+0000", 2024-09-21T22:16:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512926+0000", 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.809e-06 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512935+0000", 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3200000000000006e-06 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512951+0000", 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5780000000000001e-05 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.512960+0000", 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9279999999999999e-06 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513044+0000", 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3813999999999994e-05 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513098+0000", 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4252999999999997e-05 2024-09-21T22:16:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:16:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.515243+0000", 2024-09-21T22:16:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002145194 2024-09-21T22:16:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527022+0000", 2024-09-21T22:16:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011778729999999999 2024-09-21T22:16:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527062+0000", 2024-09-21T22:16:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0355000000000002e-05 2024-09-21T22:16:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527104+0000", 2024-09-21T22:16:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1386e-05 2024-09-21T22:16:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.527144+0000", 2024-09-21T22:16:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0048e-05 2024-09-21T22:16:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8078 3.12 3:4b6efdab:::rbd_data.1185acca6c1f.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.648828+0000", 2024-09-21T22:16:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6718315720000003, 2024-09-21T22:16:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012897707, 2024-09-21T22:16:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8078 2024-09-21T22:16:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648828+0000", 2024-09-21T22:16:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648828+0000", 2024-09-21T22:16:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648829+0000", 2024-09-21T22:16:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0400000000000005e-07 2024-09-21T22:16:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648833+0000", 2024-09-21T22:16:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1139999999999999e-06 2024-09-21T22:16:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648843+0000", 2024-09-21T22:16:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8030000000000008e-06 2024-09-21T22:16:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648848+0000", 2024-09-21T22:16:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.242e-06 2024-09-21T22:16:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648887+0000", 2024-09-21T22:16:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8503e-05 2024-09-21T22:16:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.648934+0000", 2024-09-21T22:16:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7352999999999999e-05 2024-09-21T22:16:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.650755+0000", 2024-09-21T22:16:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00182058 2024-09-21T22:16:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661646+0000", 2024-09-21T22:16:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010891764999999999 2024-09-21T22:16:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661658+0000", 2024-09-21T22:16:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1685000000000001e-05 2024-09-21T22:16:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661691+0000", 2024-09-21T22:16:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:16:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.661726+0000", 2024-09-21T22:16:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4697999999999999e-05 2024-09-21T22:16:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8129 3.12 3:4b6efdab:::rbd_data.1185acca6c1f.0000000000000020:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.704734+0000", 2024-09-21T22:16:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.615926033, 2024-09-21T22:16:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011006299000000001, 2024-09-21T22:16:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8129 2024-09-21T22:16:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704734+0000", 2024-09-21T22:16:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704734+0000", 2024-09-21T22:16:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704735+0000", 2024-09-21T22:16:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4900000000000005e-07 2024-09-21T22:16:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704740+0000", 2024-09-21T22:16:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1200000000000001e-06 2024-09-21T22:16:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704750+0000", 2024-09-21T22:16:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0198e-05 2024-09-21T22:16:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704755+0000", 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4149999999999998e-06 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704808+0000", 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2611999999999997e-05 2024-09-21T22:16:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.704858+0000", 2024-09-21T22:16:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139000000000002e-05 2024-09-21T22:16:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.706482+0000", 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016233860000000001 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715586+0000", 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091041319999999992 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715631+0000", 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4990000000000001e-05 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715689+0000", 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8833999999999999e-05 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.715740+0000", 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0624000000000002e-05 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.454 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:00.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:00.456 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:00.455+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:00.556 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:00.555+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:00.600 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:00.601 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:00.601 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:00.601 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:00.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:00.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:00.692+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:00.752 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:00.752 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:00.752 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:00.752 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:00.752 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:00.758 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:00.758+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:00.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:00.859 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:00.858+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:00.906 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.460965577, 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043089249999999999, 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443481+0000", 2024-09-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443484+0000", 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5140000000000002e-06 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443492+0000", 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4259999999999997e-06 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443501+0000", 2024-09-21T22:16:00.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3980000000000005e-06 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443536+0000", 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4604000000000003e-05 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.443551+0000", 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5387999999999999e-05 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447726+0000", 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041748530000000001 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:38.447789+0000", 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3540000000000005e-05 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:956 3.6 e30/23 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:00.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.408414392000001, 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091893070000000007, 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:00.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497369+0000", 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001336804 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497387+0000", 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8014999999999999e-05 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497398+0000", 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1581e-05 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497480+0000", 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1874999999999998e-05 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497511+0000", 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1103999999999999e-05 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505165+0000", 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076536219999999997 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505221+0000", 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6026000000000002e-05 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:960 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.406480841, 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084308620000000008, 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 960 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497968+0000", 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.429e-06 2024-09-21T22:16:00.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498743+0000", 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077512399999999997 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498766+0000", 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2983999999999999e-05 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498790+0000", 2024-09-21T22:16:00.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389e-05 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498881+0000", 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0780999999999997e-05 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498890+0000", 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7579999999999998e-06 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500819+0000", 2024-09-21T22:16:00.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929491 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500968+0000", 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014854199999999999 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501114+0000", 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146298 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505622+0000", 2024-09-21T22:16:00.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045081649999999997 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506247+0000", 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062455099999999999 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506353+0000", 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010586699999999999 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506396+0000", 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3482999999999997e-05 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:1617 3.8 3:1519a0ec:::rbd_data.1185ff358907.0000000000000063:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.332887869, 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043537289999999998, 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 1617 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571558+0000", 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571561+0000", 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2350000000000002e-06 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571851+0000", 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029007799999999998 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571866+0000", 2024-09-21T22:16:00.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5241e-05 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571875+0000", 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4439999999999997e-06 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.571949+0000", 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4082e-05 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.572140+0000", 2024-09-21T22:16:00.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019105599999999999 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575746+0000", 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036054630000000002 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575815+0000", 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9402999999999999e-05 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.575912+0000", 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6726999999999997e-05 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2305 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 393216~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.404528900000001, 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042464419999999996, 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2305 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499917+0000", 2024-09-21T22:16:00.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499918+0000", 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499921+0000", 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7879999999999998e-06 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499932+0000", 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1629e-05 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499940+0000", 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0590000000000003e-06 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503530+0000", 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035898150000000001 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.503609+0000", 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9284999999999997e-05 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504164+0000", 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055435700000000001 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2306 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:5 [sparse-read 917504~131072 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.404496783000001, 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004774197, 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2306 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499949+0000", 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499950+0000", 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0800000000000005e-07 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499952+0000", 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.261e-06 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499959+0000", 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:16:00.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.499964+0000", 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504193+0000", 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004229684 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504269+0000", 2024-09-21T22:16:00.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5956000000000003e-05 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.504724+0000", 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045437400000000001 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2346 3.0 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.389444047, 2024-09-21T22:16:00.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083135759999999996, 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2346 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515003+0000", 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-06 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515950+0000", 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094629499999999999 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515967+0000", 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7554000000000002e-05 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515974+0000", 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516038+0000", 2024-09-21T22:16:00.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3176999999999995e-05 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516167+0000", 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012979800000000001 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516306+0000", 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138887 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522280+0000", 2024-09-21T22:16:00.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059732750000000001 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523229+0000", 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094895000000000005 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523280+0000", 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1554999999999997e-05 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523316+0000", 2024-09-21T22:16:00.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5602999999999998e-05 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2364 3.0 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head [write 0~983607 [fadvise_sequential+fadvise_nocache],write 1048576~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.377318494000001, 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077052980000000002, 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2364 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527129+0000", 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527492+0000", 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036298100000000001 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527504+0000", 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1814000000000001e-05 2024-09-21T22:16:00.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527510+0000", 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4649999999999999e-06 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527564+0000", 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3893000000000001e-05 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527665+0000", 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101468 2024-09-21T22:16:00.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527817+0000", 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015177100000000001 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534445+0000", 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066276169999999997 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534752+0000", 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030757499999999998 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534799+0000", 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6310000000000002e-05 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534833+0000", 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341999999999997e-05 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.947 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2417 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.414378086999999, 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043883469999999999, 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2417 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490068+0000", 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490070+0000", 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490081+0000", 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0893000000000001e-05 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490099+0000", 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7648000000000001e-05 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490108+0000", 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0000000000000002e-06 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490162+0000", 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4846000000000003e-05 2024-09-21T22:16:00.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.490168+0000", 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7749999999999998e-06 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492060+0000", 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018918450000000001 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492159+0000", 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8827999999999996e-05 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.492338+0000", 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017905500000000001 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.493985+0000", 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016466 2024-09-21T22:16:00.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494382+0000", 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039761899999999999 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494424+0000", 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1544000000000001e-05 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.494456+0000", 2024-09-21T22:16:00.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2706000000000002e-05 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2625 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.857446748999999, 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045043440000000004, 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.955 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2625 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.046999+0000", 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047001+0000", 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5939999999999999e-06 2024-09-21T22:16:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047017+0000", 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5919000000000001e-05 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047034+0000", 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6818000000000001e-05 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047044+0000", 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0083e-05 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047129+0000", 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5205999999999997e-05 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047253+0000", 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012408699999999999 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047731+0000", 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047771700000000001 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051255+0000", 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035239619999999998 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051430+0000", 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017474 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051466+0000", 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6492999999999998e-05 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051504+0000", 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7725000000000002e-05 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2636 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.845892279999999, 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004016632, 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2636 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058554+0000", 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058555+0000", 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.398e-06 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058563+0000", 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7379999999999994e-06 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058579+0000", 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5662999999999999e-05 2024-09-21T22:16:00.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058586+0000", 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2649999999999999e-06 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058636+0000", 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0358999999999997e-05 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058704+0000", 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8182999999999994e-05 2024-09-21T22:16:00.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.058948+0000", 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000243322 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059681+0000", 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073306399999999996 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062499+0000", 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028180499999999999 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062534+0000", 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4799999999999999e-05 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062571+0000", 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6789999999999998e-05 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2722 3.0 3:053415b0:::rbd_object_map.118555b0e245:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:16:00.965 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.695250695, 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041655779999999996, 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2722 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209195+0000", 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209198+0000", 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.351e-06 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209213+0000", 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4847e-05 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209239+0000", 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6533000000000002e-05 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209252+0000", 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2998e-05 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209326+0000", 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4041999999999993e-05 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209405+0000", 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9246999999999995e-05 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209669+0000", 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026352999999999999 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.212980+0000", 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033110209999999999 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213279+0000", 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029891100000000001 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213320+0000", 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0930999999999998e-05 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213361+0000", 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1167000000000001e-05 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:4703 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:52.918982+0000", 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.9854641930000003, 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049461419999999997, 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4703 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918982+0000", 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918982+0000", 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918983+0000", 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918986+0000", 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.428e-06 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918994+0000", 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.918999+0000", 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9690000000000002e-06 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.919028+0000", 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9609000000000001e-05 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.919071+0000", 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2724e-05 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.923831+0000", 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047593710000000001 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.923865+0000", 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499000000000003e-05 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:52.923928+0000", 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3097999999999998e-05 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7887 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:00.975 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.5005373219999996, 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019112581, 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7887 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403910+0000", 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3300000000000001e-07 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403914+0000", 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1370000000000004e-06 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403924+0000", 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0365e-05 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403929+0000", 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403979+0000", 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0420000000000002e-05 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.404033+0000", 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3489999999999998e-05 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.407250+0000", 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003216975 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422946+0000", 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015696266 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422957+0000", 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0608000000000001e-05 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422987+0000", 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0552999999999997e-05 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.423021+0000", 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4056000000000001e-05 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:7887 3.4 e41/23 ondisk, result = 0)", 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4882337510000001, 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067395329999999998, 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416213+0000", 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416216+0000", 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0989999999999999e-06 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416227+0000", 2024-09-21T22:16:00.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0604e-05 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416232+0000", 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.938e-06 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422936+0000", 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067038089999999998 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422942+0000", 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5939999999999999e-06 2024-09-21T22:16:00.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422952+0000", 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8090000000000004e-06 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7981 3.0 3:03cb8c30:::rbd_data.1185acca6c1f.000000000000001b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.3911040549999996, 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015150808999999999, 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.984 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7981 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513343+0000", 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6000000000000003e-07 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513347+0000", 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9910000000000004e-06 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513358+0000", 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0772e-05 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513363+0000", 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1490000000000002e-06 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513403+0000", 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0290000000000002e-05 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513450+0000", 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7349999999999999e-05 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.515475+0000", 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020249640000000002 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528357+0000", 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012881782 2024-09-21T22:16:00.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528396+0000", 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8674000000000003e-05 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528438+0000", 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2006999999999999e-05 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528493+0000", 2024-09-21T22:16:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.507e-05 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:7981 3.0 e41/23 ondisk, result = 0)", 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.524248+0000", 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.3801983499999997, 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042513150000000003, 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524248+0000", 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524248+0000", 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524249+0000", 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5600000000000005e-07 2024-09-21T22:16:00.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524252+0000", 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2320000000000001e-06 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524263+0000", 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1561e-05 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.524270+0000", 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1959999999999996e-06 2024-09-21T22:16:00.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528385+0000", 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041150980000000002 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528392+0000", 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0389999999999999e-06 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528499+0000", 2024-09-21T22:16:00.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107433 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8534 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7422010810000002, 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013031713, 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:00.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8534 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162246+0000", 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162250+0000", 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9550000000000002e-06 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162259+0000", 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5780000000000005e-06 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162264+0000", 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162312+0000", 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7361000000000003e-05 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162368+0000", 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6104999999999999e-05 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.164384+0000", 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020158120000000001 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175199+0000", 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010815455 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175212+0000", 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2422000000000001e-05 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:00.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175243+0000", 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1142000000000001e-05 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175277+0000", 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4057999999999998e-05 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:8534 3.4 e42/23 ondisk, result = 0)", 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.170846+0000", 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7336000519999999, 2024-09-21T22:16:00.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043594439999999996, 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170846+0000", 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170846+0000", 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170847+0000", 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170849+0000", 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5969999999999999e-06 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170860+0000", 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0231000000000001e-05 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.170865+0000", 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1749999999999996e-06 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175189+0000", 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043239849999999998 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175195+0000", 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3069999999999999e-06 2024-09-21T22:16:01.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175206+0000", 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0509000000000001e-05 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:9279 3.8 3:16ab6a84:::rbd_data.1185acca6c1f.0000000000000011:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.040377+0000", 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.864069556, 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041612400000000001, 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 9279 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040377+0000", 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040377+0000", 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040378+0000", 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5889999999999999e-06 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040387+0000", 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6889999999999993e-06 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040404+0000", 2024-09-21T22:16:01.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7271000000000001e-05 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040412+0000", 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8180000000000004e-06 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040468+0000", 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5559000000000001e-05 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.040537+0000", 2024-09-21T22:16:01.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9142999999999999e-05 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.044420+0000", 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038829419999999999 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.044462+0000", 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2237000000000002e-05 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.044538+0000", 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5992e-05 2024-09-21T22:16:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.008 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:01.008 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:16:01.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:01.010 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:01.008+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:01.111 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:01.110+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:01.158 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:01.167 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:01.211 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:01.210+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:01.272 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:01.272 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:01.272 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:01.272 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:01.272 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:01.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:01.312 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:01.311+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:01.385 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:259 3.4 e28/23 3:226e6cb4:::rbd_data.11856a5cf33b.000000000000003a:head v 28'6, mlcod=28'4)", 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.618444203999999, 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030935889999999999, 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765080+0000", 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765082+0000", 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9350000000000001e-06 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765094+0000", 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2045000000000001e-05 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765114+0000", 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9556999999999999e-05 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765136+0000", 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2257999999999999e-05 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765208+0000", 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2192000000000003e-05 2024-09-21T22:16:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.765232+0000", 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4107000000000001e-05 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768126+0000", 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028939159999999998 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:41.768174+0000", 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7579e-05 2024-09-21T22:16:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.882233633999999, 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:16:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:16:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:16:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.867050174999999, 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:16:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.855603736999999, 2024-09-21T22:16:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2603 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'36, mlcod=34'34)", 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.384400719, 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032135610000000002, 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999129+0000", 2024-09-21T22:16:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999139+0000", 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5300000000000002e-06 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999143+0000", 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999184+0000", 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999198+0000", 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3971999999999999e-05 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002303+0000", 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031052179999999999 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002337+0000", 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3992000000000003e-05 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2614 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'38, mlcod=34'36)", 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.368139773999999, 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002984273, 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015385+0000", 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015386+0000", 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6700000000000002e-07 2024-09-21T22:16:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015392+0000", 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4999999999999996e-06 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015404+0000", 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1864e-05 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015411+0000", 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9e-06 2024-09-21T22:16:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015478+0000", 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7067e-05 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.015493+0000", 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5398000000000001e-05 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018334+0000", 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002840679 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.018369+0000", 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4897999999999997e-05 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.335697398000001, 2024-09-21T22:16:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:16:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2636 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'42, mlcod=34'40)", 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.324506169999999, 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033367480000000001, 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059019+0000", 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-06 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059029+0000", 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4509999999999998e-06 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059044+0000", 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5218000000000001e-05 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059052+0000", 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059114+0000", 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2094999999999994e-05 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059139+0000", 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-05 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062305+0000", 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031661020000000001 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062355+0000", 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0129000000000001e-05 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2659 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'49, mlcod=34'47)", 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.286178271000001, 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024912200000000002, 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097346+0000", 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097347+0000", 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097357+0000", 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9040000000000004e-06 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097375+0000", 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8284999999999999e-05 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097389+0000", 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3053e-05 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097438+0000", 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9184999999999997e-05 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.097456+0000", 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8022000000000001e-05 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.099805+0000", 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023490479999999998 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.099837+0000", 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2487000000000003e-05 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2672 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'52, mlcod=34'50)", 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.262590125999999, 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024984180000000001, 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120934+0000", 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120935+0000", 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.034e-06 2024-09-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120944+0000", 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9120000000000004e-06 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120957+0000", 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2398999999999999e-05 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.120964+0000", 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0480000000000001e-06 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.121020+0000", 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6514999999999997e-05 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.121038+0000", 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8105999999999999e-05 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123389+0000", 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023506930000000001 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.123433+0000", 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3711000000000002e-05 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2681 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'53, mlcod=34'51)", 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:16:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.255164798999999, 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024865360000000001, 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128360+0000", 2024-09-21T22:16:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128361+0000", 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.850000000000001e-07 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128371+0000", 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0293e-05 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128384+0000", 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3546e-05 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128393+0000", 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2090000000000005e-06 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128440+0000", 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7120999999999998e-05 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.128456+0000", 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6503000000000001e-05 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.130815+0000", 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023583419999999998 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.130846+0000", 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1537e-05 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2719 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'64, mlcod=34'62)", 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.18467491, 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029567959999999998, 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198849+0000", 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198850+0000", 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6599999999999995e-07 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198855+0000", 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2939999999999996e-06 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198866+0000", 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0239e-05 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198873+0000", 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198927+0000", 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4548e-05 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.198949+0000", 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2243999999999999e-05 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201757+0000", 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028075700000000001 2024-09-21T22:16:01.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.201806+0000", 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9258000000000002e-05 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.173762591999999, 2024-09-21T22:16:01.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:16:01.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2835 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'85, mlcod=34'83)", 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.034745359, 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002476645, 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348779+0000", 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348780+0000", 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.311e-06 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348791+0000", 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0257e-05 2024-09-21T22:16:01.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348808+0000", 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7546000000000001e-05 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348817+0000", 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3090000000000001e-06 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348881+0000", 2024-09-21T22:16:01.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3615999999999995e-05 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.348908+0000", 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7483000000000001e-05 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.351202+0000", 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022931449999999999 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.351256+0000", 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3977999999999997e-05 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:8183 3.9 e41/23 3:915aea64:::rbd_data.1185acca6c1f.0000000000000012:head v 41'72, mlcod=41'69)", 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.6169032320000003, 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031809400000000002, 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766622+0000", 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0500000000000003e-07 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766627+0000", 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9899999999999997e-06 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766634+0000", 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3669999999999999e-06 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766639+0000", 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4070000000000001e-06 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766677+0000", 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7242e-05 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766695+0000", 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8694000000000001e-05 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769713+0000", 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030172060000000001 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769802+0000", 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9429e-05 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:8390 3.4 e42/23 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head v 42'34, mlcod=41'32)", 2024-09-21T22:16:01.450 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.993913+0000", 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.3896108979999999, 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024985939999999998, 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.993913+0000", 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.993913+0000", 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.993914+0000", 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.99e-07 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.993920+0000", 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.993931+0000", 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1623999999999999e-05 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.993940+0000", 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6200000000000005e-06 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.993993+0000", 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3344999999999998e-05 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.994014+0000", 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0982e-05 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.996382+0000", 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023677260000000001 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.996412+0000", 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0145999999999999e-05 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:8760 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'73, mlcod=41'71)", 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.451365+0000", 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9321598240000002, 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030508919999999999, 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451365+0000", 2024-09-21T22:16:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451365+0000", 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451365+0000", 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.29e-07 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451410+0000", 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4801e-05 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451419+0000", 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451425+0000", 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0680000000000002e-06 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451476+0000", 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0637999999999999e-05 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.451491+0000", 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5529999999999999e-05 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.454383+0000", 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002891879 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.454415+0000", 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2437000000000001e-05 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9185 3.4 e42/23 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head v 42'42, mlcod=42'40)", 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.4383044920000003, 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033010399999999999, 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945221+0000", 2024-09-21T22:16:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199999999999998e-07 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945226+0000", 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3449999999999996e-06 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945236+0000", 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044e-05 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945241+0000", 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1499999999999998e-06 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945289+0000", 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7142999999999999e-05 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945310+0000", 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1314e-05 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948453+0000", 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031435539999999998 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948521+0000", 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7422000000000006e-05 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9187 3.0 e42/23 3:057833b6:::rbd_data.1185acca6c1f.0000000000000004:head v 42'223, mlcod=42'221)", 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.4382708060000002, 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003477997, 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7100000000000001e-07 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945256+0000", 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5610000000000001e-06 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945261+0000", 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5290000000000002e-06 2024-09-21T22:16:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945264+0000", 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.078e-06 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945304+0000", 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0345000000000001e-05 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945326+0000", 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1733999999999999e-05 2024-09-21T22:16:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948698+0000", 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033719520000000001 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948732+0000", 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3627000000000002e-05 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.3055165090000003, 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:01.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:01.472 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:01.473 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:01.474 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:01.472+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:01.574 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:01.573+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:01.586 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:01.586 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:01.586 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:01.586 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:01.595 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:01.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:01.674+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:01.742 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:01.742 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:01.742 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:01.742 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:01.743 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:01.751 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:01.795 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:01.794+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1594 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1343488~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.290129174, 2024-09-21T22:16:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097734940000000006, 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1594 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564069+0000", 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564080+0000", 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1171e-05 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564083+0000", 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573614+0000", 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095306309999999995 2024-09-21T22:16:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573740+0000", 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000125549 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573840+0000", 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100825 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1595 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1409024~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.290107204999998, 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0099579890000000004, 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1595 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:16:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564092+0000", 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3319999999999999e-06 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564098+0000", 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1079999999999998e-06 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564102+0000", 2024-09-21T22:16:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573875+0000", 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097733290000000007 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573950+0000", 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4399000000000004e-05 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574047+0000", 2024-09-21T22:16:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7082000000000003e-05 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1596 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1474560~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.290088558000001, 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010121099, 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1596 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564108+0000", 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.41e-07 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564110+0000", 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0810000000000001e-06 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564116+0000", 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0689999999999998e-06 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564122+0000", 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574087+0000", 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0099650099999999998 2024-09-21T22:16:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574163+0000", 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6147000000000001e-05 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574229+0000", 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5718999999999999e-05 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1597 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1540096~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.290054658999999, 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010324866, 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1597 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564142+0000", 2024-09-21T22:16:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6000000000000004e-07 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564144+0000", 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2029999999999999e-06 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564151+0000", 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3489999999999997e-06 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564156+0000", 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1399999999999999e-06 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574271+0000", 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010115017 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574355+0000", 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4820000000000004e-05 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574466+0000", 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110777 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1598 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.29003363, 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010531304999999999, 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1598 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564163+0000", 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4799999999999999e-07 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564165+0000", 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564171+0000", 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564176+0000", 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574511+0000", 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010335075000000001 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574600+0000", 2024-09-21T22:16:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9220000000000003e-05 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574694+0000", 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3848e-05 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1599 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1671168~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.290014559999999, 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010750302, 2024-09-21T22:16:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1599 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564182+0000", 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564184+0000", 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9539999999999998e-06 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564190+0000", 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.494e-06 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564195+0000", 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999999e-06 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574732+0000", 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010537556999999999 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574816+0000", 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4146000000000004e-05 2024-09-21T22:16:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574932+0000", 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011539099999999999 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.289994123, 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.289952117999999, 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.289854655999999, 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:16:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.289799599999998, 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.289757594000001, 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:16:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.289696996, 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.289674803, 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.906 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.288769995999999, 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:01.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:16:01.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.333335264, 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:16:01.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:16:01.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.330196021999999, 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:01.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:01.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:16:01.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:16:01.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.924 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2737 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.627165544, 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010753749, 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2737 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:01.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0999999999999997e-07 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227036+0000", 2024-09-21T22:16:01.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227046+0000", 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227051+0000", 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000004e-06 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227099+0000", 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7920000000000002e-05 2024-09-21T22:16:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227152+0000", 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2753000000000001e-05 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.228909+0000", 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017568519999999999 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237712+0000", 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088031670000000006 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237722+0000", 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0478e-05 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237750+0000", 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7885000000000002e-05 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237784+0000", 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4186000000000001e-05 2024-09-21T22:16:01.929 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.2371823969999998, 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.930 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:16:01.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:16:01.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:16:01.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:16:01.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8743 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.427334+0000", 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.4268623590000002, 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098254859999999996, 2024-09-21T22:16:01.935 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8743 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427334+0000", 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427334+0000", 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427335+0000", 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7499999999999998e-07 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427340+0000", 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1959999999999999e-06 2024-09-21T22:16:01.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427353+0000", 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2736e-05 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427361+0000", 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427406+0000", 2024-09-21T22:16:01.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5385e-05 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427463+0000", 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6824999999999999e-05 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.428998+0000", 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015344250000000001 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:01.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437004+0000", 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080057610000000001 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437047+0000", 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3887999999999997e-05 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437107+0000", 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0028000000000002e-05 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437159+0000", 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1758000000000001e-05 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.2813171050000003, 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:01.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:01.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:16:01.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:16:01.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:16:01.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:01.946 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:01.947 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:16:01.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:01.949 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:01.947+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:02.048 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:02.048+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:02.094 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-21T22:16:02.098 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:02.098 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:02.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:02.150 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:02.149+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:02.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:02.249+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:02.251 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:02.251 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:02.252 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:02.252 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:02.252 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:02.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:02.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:02.346 INFO:teuthology.orchestra.run.smithi134.stdout:1358 punch from 0x6001b51 to 0x6006f0a, (0x53b9 bytes) 2024-09-21T22:16:02.350 INFO:teuthology.orchestra.run.smithi134.stdout:1359 read 0xa1de265 thru 0xa1e54f2 (0x728e bytes) 2024-09-21T22:16:02.350 INFO:teuthology.orchestra.run.smithi134.stdout:1360 read 0x129bc3d thru 0x12a3c32 (0x7ff6 bytes) 2024-09-21T22:16:02.351 INFO:teuthology.orchestra.run.smithi134.stdout:1362 read 0x70d7811 thru 0x70e602f (0xe81f bytes) 2024-09-21T22:16:02.351 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:02.350+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:02.356 INFO:teuthology.orchestra.run.smithi134.stdout:1363 writesame 0xebbddda thru 0xebc88c1 data_size 0xc(0xaae8 bytes) 2024-09-21T22:16:02.358 INFO:teuthology.orchestra.run.smithi134.stdout:1364 write 0x8c699c9 thru 0x8c6a6a7 (0xcdf bytes) 2024-09-21T22:16:02.359 INFO:teuthology.orchestra.run.smithi134.stdout:1365 punch from 0x5f77a9 to 0x5fdd0e, (0x6565 bytes) 2024-09-21T22:16:02.359 INFO:teuthology.orchestra.run.smithi134.stdout:1366 write 0xddb0d99 thru 0xddb8743 (0x79ab bytes) 2024-09-21T22:16:02.360 INFO:teuthology.orchestra.run.smithi134.stdout:1369 read 0x1aec1b1 thru 0x1aec5a8 (0x3f8 bytes) 2024-09-21T22:16:02.361 INFO:teuthology.orchestra.run.smithi134.stdout:1370 writesame 0xd58a602 thru 0xd58a63b data_size 0x1(0x3a bytes) 2024-09-21T22:16:02.362 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:02.362 INFO:teuthology.orchestra.run.smithi134.stdout:1372 write 0x4fe4b24 thru 0x4fee082 (0x955f bytes) 2024-09-21T22:16:02.364 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:02.364 INFO:teuthology.orchestra.run.smithi134.stdout:1377 write 0x78426a thru 0x786377 (0x210e bytes) 2024-09-21T22:16:02.365 INFO:teuthology.orchestra.run.smithi134.stdout:1378 write 0xc062a0b thru 0xc06f7e9 (0xcddf bytes) 2024-09-21T22:16:02.368 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1433 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 2916352~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822864318000001, 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019321876000000002, 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1433 2024-09-21T22:16:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543849+0000", 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543850+0000", 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9999999999999998e-07 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543852+0000", 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3080000000000002e-06 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543859+0000", 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6030000000000001e-06 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543865+0000", 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.173e-06 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.562995+0000", 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019130261999999999 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563071+0000", 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6055000000000003e-05 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563171+0000", 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9975000000000004e-05 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1434 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 2981888~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822841526000001, 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019712555, 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1434 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543872+0000", 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543873+0000", 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.39e-07 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543876+0000", 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1520000000000001e-06 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543882+0000", 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9290000000000003e-06 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543887+0000", 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.118e-06 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563381+0000", 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019494177000000001 2024-09-21T22:16:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563476+0000", 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5427999999999995e-05 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563585+0000", 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108312 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1435 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3047424~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822820365999998, 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019941364999999999, 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1435 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543893+0000", 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543894+0000", 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543896+0000", 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543948+0000", 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2201999999999999e-05 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544048+0000", 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9625999999999998e-05 2024-09-21T22:16:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563634+0000", 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019586076000000001 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563723+0000", 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8473999999999994e-05 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563835+0000", 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011205900000000001 2024-09-21T22:16:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1436 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3112960~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822653461000002, 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019987041000000001, 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1436 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544060+0000", 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544061+0000", 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544064+0000", 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4489999999999999e-06 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544072+0000", 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.311e-06 2024-09-21T22:16:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544077+0000", 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563868+0000", 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019791362999999999 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.563944+0000", 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6064999999999998e-05 2024-09-21T22:16:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564047+0000", 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010273299999999999 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1437 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3178496~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822628969, 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020126950000000001, 2024-09-21T22:16:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1437 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544085+0000", 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.27e-07 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544087+0000", 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2079999999999999e-06 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544093+0000", 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.874e-06 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544098+0000", 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6650000000000002e-06 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564082+0000", 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019984483000000001 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564150+0000", 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7430999999999999e-05 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1861999999999998e-05 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1438 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3244032~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:16:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822605681999999, 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020359434999999999, 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1438 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:16:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544108+0000", 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544111+0000", 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:16:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544117+0000", 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544122+0000", 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7060000000000003e-06 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564258+0000", 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020136582 2024-09-21T22:16:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564347+0000", 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9288000000000003e-05 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564467+0000", 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000119948 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1439 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3309568~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822585135000001, 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020562668999999999, 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1439 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544129+0000", 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5300000000000004e-07 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544131+0000", 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544137+0000", 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9519999999999999e-06 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544142+0000", 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7550000000000002e-06 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564501+0000", 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020358883000000001 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564581+0000", 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0351000000000004e-05 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564691+0000", 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110195 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1440 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3375104~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822563244000001, 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020796948999999999, 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1440 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544150+0000", 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544151+0000", 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.82e-07 2024-09-21T22:16:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544153+0000", 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.869e-06 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544159+0000", 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5769999999999999e-06 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544199+0000", 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9601999999999998e-05 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564737+0000", 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020537581999999999 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564838+0000", 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101467 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564947+0000", 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010937 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1441 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3440640~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822497301999999, 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020999262000000001, 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1441 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544216+0000", 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544217+0000", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5700000000000001e-07 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544222+0000", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3599999999999998e-06 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544232+0000", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0233e-05 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544239+0000", 2024-09-21T22:16:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0079999999999996e-06 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564996+0000", 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020757512999999998 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565085+0000", 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8566000000000006e-05 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565216+0000", 2024-09-21T22:16:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013072499999999999 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1442 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3506176~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822463672000001, 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021211990999999999, 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1442 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544250+0000", 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544251+0000", 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.99e-07 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544253+0000", 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5909999999999998e-06 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544260+0000", 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544265+0000", 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1850000000000003e-06 2024-09-21T22:16:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565255+0000", 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020989622999999999 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565344+0000", 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9011999999999994e-05 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565462+0000", 2024-09-21T22:16:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000118273 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1443 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3571712~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822441656999999, 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021376223, 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1443 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544272+0000", 2024-09-21T22:16:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0399999999999996e-07 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544275+0000", 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3080000000000002e-06 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544281+0000", 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1460000000000001e-06 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544286+0000", 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6e-06 2024-09-21T22:16:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565493+0000", 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021207777000000001 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565565+0000", 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1815000000000003e-05 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565648+0000", 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3072999999999996e-05 2024-09-21T22:16:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1444 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3637248~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822421645999999, 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021549170999999999, 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1444 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544292+0000", 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544295+0000", 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1430000000000001e-06 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544301+0000", 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2079999999999997e-06 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544306+0000", 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565677+0000", 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021371547000000001 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565749+0000", 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1886999999999998e-05 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565841+0000", 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1978999999999995e-05 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1445 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3702784~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822400793, 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021733944000000002, 2024-09-21T22:16:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1445 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544313+0000", 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2399999999999998e-07 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544315+0000", 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9659999999999999e-06 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544322+0000", 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4999999999999996e-06 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544327+0000", 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6999999999999999e-06 2024-09-21T22:16:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565870+0000", 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021543715000000001 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565944+0000", 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3851999999999997e-05 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566047+0000", 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000102687 2024-09-21T22:16:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1446 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3768320~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822380803000001, 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021911746999999999, 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1446 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544333+0000", 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1300000000000001e-07 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544337+0000", 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6069999999999999e-06 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544343+0000", 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9580000000000004e-06 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544348+0000", 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7450000000000003e-06 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566076+0000", 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021728313999999999 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566150+0000", 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4344000000000005e-05 2024-09-21T22:16:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566245+0000", 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4365999999999997e-05 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1447 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3833856~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.82235987, 2024-09-21T22:16:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022083714000000001, 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1447 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544354+0000", 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8500000000000002e-07 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544356+0000", 2024-09-21T22:16:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544362+0000", 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9610000000000002e-06 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544367+0000", 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5569999999999997e-06 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566274+0000", 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021907115000000001 2024-09-21T22:16:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566345+0000", 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1316000000000006e-05 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566437+0000", 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2151000000000006e-05 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1448 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3899392~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822340694000001, 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022306970999999998, 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1448 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544373+0000", 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3799999999999998e-07 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544375+0000", 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9609999999999999e-06 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544382+0000", 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1589999999999998e-06 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544387+0000", 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566493+0000", 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022106832 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566569+0000", 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5507999999999996e-05 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566680+0000", 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111055 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1449 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 3964928~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822320938000001, 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022531059999999999, 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1449 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544393+0000", 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:16:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544399+0000", 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8379999999999998e-06 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544405+0000", 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4400000000000002e-06 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544411+0000", 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0510000000000002e-06 2024-09-21T22:16:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566730+0000", 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022318521000000001 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566818+0000", 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8342000000000002e-05 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566924+0000", 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010549500000000001 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1450 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4030464~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822295491999999, 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022739365000000001, 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1450 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544418+0000", 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544419+0000", 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9999999999999997e-07 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544421+0000", 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2850000000000001e-06 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544428+0000", 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.849e-06 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544433+0000", 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.566967+0000", 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022534667000000001 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567064+0000", 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6525000000000002e-05 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567158+0000", 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3738000000000003e-05 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1451 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4096000~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822274880999998, 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022898399, 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1451 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544439+0000", 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544441+0000", 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0499999999999999e-06 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544452+0000", 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.113e-05 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544458+0000", 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9610000000000002e-06 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567187+0000", 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022728190999999998 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567254+0000", 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7662000000000004e-05 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567337+0000", 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2976e-05 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1452 3.16 3:6cd495c8:::rbd_data.11856a5cf33b.0000000000000018:3 [read 4161536~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.822246477, 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.024156477999999999, 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1452 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544467+0000", 2024-09-21T22:16:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544468+0000", 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544470+0000", 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7499999999999999e-06 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544478+0000", 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2969999999999998e-06 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.544483+0000", 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8099999999999997e-06 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567626+0000", 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023143009999999999 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.567708+0000", 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2111e-05 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:02.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.568624+0000", 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00091596899999999998 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:02.454 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:02.455 INFO:teuthology.orchestra.run.smithi134.stdout:1379 trunc from 0xebc88c2 to 0x855845 2024-09-21T22:16:02.455 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:02.456 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:02.456 INFO:teuthology.orchestra.run.smithi134.stdout:1380 writesame 0xb5a1a4 thru 0xb5f93c data_size 0x4b(0x5799 bytes) 2024-09-21T22:16:02.456 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:02.457 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:02.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:02.457 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:02.454+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:02.458 INFO:teuthology.orchestra.run.smithi134.stdout:1381 write 0x807960d thru 0x8081560 (0x7f54 bytes) 2024-09-21T22:16:02.458 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:02.458 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:02.459 INFO:teuthology.orchestra.run.smithi134.stdout:1382 writesame 0x575245d thru 0x5752ffb data_size 0x19(0xb9f bytes) 2024-09-21T22:16:02.459 INFO:teuthology.orchestra.run.smithi134.stdout:1384 read 0x779bb75 thru 0x779e6b0 (0x2b3c bytes) 2024-09-21T22:16:02.459 INFO:teuthology.orchestra.run.smithi134.stdout:1386 write 0x57d7908 thru 0x57e262a (0xad23 bytes) 2024-09-21T22:16:02.459 INFO:teuthology.orchestra.run.smithi134.stdout:1387 trunc from 0x8081561 to 0xae1baa4 2024-09-21T22:16:02.459 INFO:teuthology.orchestra.run.smithi134.stdout:1388 write 0xac12708 thru 0xac1c000 (0x98f9 bytes) 2024-09-21T22:16:02.459 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:02.459 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:02.460 INFO:teuthology.orchestra.run.smithi134.stdout:1389 writesame 0x90d04ca thru 0x90d47dc data_size 0x7(0x4313 bytes) 2024-09-21T22:16:02.460 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:02.460 INFO:teuthology.orchestra.run.smithi134.stdout:1392 write 0xe823ff0 thru 0xe833ce3 (0xfcf4 bytes) 2024-09-21T22:16:02.463 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:02.463 INFO:teuthology.orchestra.run.smithi134.stdout:1394 read 0x6402c thru 0x68247 (0x421c bytes) 2024-09-21T22:16:02.464 INFO:teuthology.orchestra.run.smithi134.stdout:1396 punch from 0xb64b566 to 0xb650eb2, (0x594c bytes) 2024-09-21T22:16:02.464 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:02.464 INFO:teuthology.orchestra.run.smithi134.stdout:1399 read 0x332d49f thru 0x332edbd (0x191f bytes) 2024-09-21T22:16:02.464 INFO:teuthology.orchestra.run.smithi134.stdout:1400 read 0x64314ae thru 0x643f0b7 (0xdc0a bytes) 2024-09-21T22:16:02.465 INFO:teuthology.orchestra.run.smithi134.stdout:1401 punch from 0xcf0dbaa to 0xcf17b4b, (0x9fa1 bytes) 2024-09-21T22:16:02.465 INFO:teuthology.orchestra.run.smithi134.stdout:1403 write 0x6f136d1 thru 0x6f1e857 (0xb187 bytes) 2024-09-21T22:16:02.465 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:02.465 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:02.467 INFO:teuthology.orchestra.run.smithi134.stdout:1404 write 0x1e10cfe thru 0x1e166ee (0x59f1 bytes) 2024-09-21T22:16:02.469 INFO:teuthology.orchestra.run.smithi134.stdout:1405 write 0x87633bf thru 0x87647f8 (0x143a bytes) 2024-09-21T22:16:02.470 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:02.470 INFO:teuthology.orchestra.run.smithi134.stdout:1407 writesame 0x65942a6 thru 0x659daef data_size 0x65(0x984a bytes) 2024-09-21T22:16:02.473 INFO:teuthology.orchestra.run.smithi134.stdout:1408 write 0xdd7d8e7 thru 0xdd807f6 (0x2f10 bytes) 2024-09-21T22:16:02.476 INFO:teuthology.orchestra.run.smithi134.stdout:1410 clone 6 order 19 su 16384 sc 5 2024-09-21T22:16:02.483 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:02.483 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:02.500 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:02.516 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:02.516 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:02.556 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:02.555+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:02.601 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:02.601 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:02.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:02.695 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:02.694+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:02.755 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:02.756 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:02.758 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:02.757+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:02.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:02.859 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:02.858+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:02.907 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:02.907 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:02.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:02.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:02.959+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:03.060 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:03.059+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:03.060 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.060 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:03.160 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:03.159+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:03.213 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.213 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:03.263 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:03.262+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:03.363 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:03.362+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:03.366 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.366 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:03.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:03.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:03.463+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:03.494 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.494 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:03.529 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.530 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:16:03.580 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:03.579+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:03.634 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.634 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:03.665 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:03.664+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:03.748 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.748 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:03.766 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:03.765+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:03.862 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:03.863 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:03.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:03.866+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:03.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:03.920 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:16:03.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:16:03.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:16:03.968 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:03.968+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:04.026 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:04.027 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:04.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:04.069 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:04.068+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:04.170 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:04.169+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:04.183 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:04.183 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:04.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:04.271 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:04.271+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:04.335 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:04.335 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:04.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:04.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:04.387+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:04.447 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:04.447 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:04.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:04.473 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:04.473+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:04.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:04.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:04.582+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:04.601 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:04.601 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:04.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:04.662 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:04.662 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:04.675 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:04.674+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:04.678 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:04.679 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:04.694 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:04.694 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:04.710 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:04.710 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:04.726 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:04.727 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:04.727 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:04.727 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:04.727 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:04.727 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:04.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:04.743 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:04.743 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:04.759 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:04.780 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:04.779+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:04.840 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:04.841 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:04.841 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:04.841 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:04.841 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:04.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:04.891 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:04.890+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:04.935 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:16:04.936 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:16:04.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:16:04.977 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:04.977+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:04.989 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:04.990 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:05.019 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:05.019 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:05.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:05.019 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:05.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1594 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1343488~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452927000999999, 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097734940000000006, 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1594 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564067+0000", 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564069+0000", 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564080+0000", 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1171e-05 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564083+0000", 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573614+0000", 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095306309999999995 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573740+0000", 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000125549 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573840+0000", 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100825 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.023 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1595 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1409024~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452905032, 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0099579890000000004, 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1595 2024-09-21T22:16:05.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564089+0000", 2024-09-21T22:16:05.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564092+0000", 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3319999999999999e-06 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564098+0000", 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1079999999999998e-06 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564102+0000", 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573875+0000", 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097733290000000007 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.573950+0000", 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4399000000000004e-05 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574047+0000", 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7082000000000003e-05 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1596 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1474560~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452886384999999, 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010121099, 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.028 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1596 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564107+0000", 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564108+0000", 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.41e-07 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564110+0000", 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0810000000000001e-06 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564116+0000", 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0689999999999998e-06 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564122+0000", 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574087+0000", 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0099650099999999998 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574163+0000", 2024-09-21T22:16:05.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6147000000000001e-05 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574229+0000", 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5718999999999999e-05 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1597 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1540096~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452852486000001, 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010324866, 2024-09-21T22:16:05.032 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1597 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564141+0000", 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564142+0000", 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6000000000000004e-07 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564144+0000", 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2029999999999999e-06 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564151+0000", 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3489999999999997e-06 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564156+0000", 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1399999999999999e-06 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574271+0000", 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010115017 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574355+0000", 2024-09-21T22:16:05.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4820000000000004e-05 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574466+0000", 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110777 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1598 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452831456999998, 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010531304999999999, 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.036 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1598 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564163+0000", 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4799999999999999e-07 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564165+0000", 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564171+0000", 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564176+0000", 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574511+0000", 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010335075000000001 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574600+0000", 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9220000000000003e-05 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574694+0000", 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3848e-05 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1599 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1671168~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452812387000002, 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010750302, 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1599 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564182+0000", 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564184+0000", 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9539999999999998e-06 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564190+0000", 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.494e-06 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564195+0000", 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999999e-06 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574732+0000", 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010537556999999999 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574816+0000", 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4146000000000004e-05 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574932+0000", 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011539099999999999 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.044 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452791950000002, 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:16:05.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452749945000001, 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:16:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452652483000001, 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.057 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452597427000001, 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.058 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452555421, 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.062 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:05.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:16:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:16:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452494822999999, 2024-09-21T22:16:05.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:05.070 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.452472629999999, 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:16:05.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 21.451567823000001, 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:16:05.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:16:05.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.496133091000001, 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.492993849000001, 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:16:05.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:16:05.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2737 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:05.088 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.789963370999999, 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010753749, 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2737 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:05.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0999999999999997e-07 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227036+0000", 2024-09-21T22:16:05.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227046+0000", 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227051+0000", 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000004e-06 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227099+0000", 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7920000000000002e-05 2024-09-21T22:16:05.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227152+0000", 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2753000000000001e-05 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.228909+0000", 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017568519999999999 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237712+0000", 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088031670000000006 2024-09-21T22:16:05.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237722+0000", 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0478e-05 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237750+0000", 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7885000000000002e-05 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237784+0000", 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4186000000000001e-05 2024-09-21T22:16:05.093 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.3999802240000001, 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:16:05.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:16:05.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:16:05.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:16:05.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8743 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.427334+0000", 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.5896601859999997, 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0098254859999999996, 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8743 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427334+0000", 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427334+0000", 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427335+0000", 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7499999999999998e-07 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427340+0000", 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1959999999999999e-06 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427353+0000", 2024-09-21T22:16:05.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2736e-05 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427361+0000", 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427406+0000", 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5385e-05 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.427463+0000", 2024-09-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6824999999999999e-05 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.428998+0000", 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015344250000000001 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437004+0000", 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0080057610000000001 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437047+0000", 2024-09-21T22:16:05.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3887999999999997e-05 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437107+0000", 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0028000000000002e-05 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.437159+0000", 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1758000000000001e-05 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.104 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4441149319999997, 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:05.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:16:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:16:05.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.109 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.110 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.110 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.110 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.110 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:05.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:05.112 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:05.110+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:05.211 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:05.211+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:05.296 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14790 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.285174+0000", 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0040477170000000002, 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040754240000000002, 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14790 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285174+0000", 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285174+0000", 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285174+0000", 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:16:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285176+0000", 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285178+0000", 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8480000000000001e-06 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285181+0000", 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6699999999999998e-06 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14822 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286206+0000", 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0030156940000000002, 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031088729999999998, 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14822 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286206+0000", 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286206+0000", 2024-09-21T22:16:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286207+0000", 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286212+0000", 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4380000000000003e-06 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286218+0000", 2024-09-21T22:16:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286223+0000", 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9130000000000002e-06 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14855 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286747+0000", 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0024752979999999999, 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025994630000000002, 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14855 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286747+0000", 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286747+0000", 2024-09-21T22:16:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286747+0000", 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286748+0000", 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3060000000000001e-06 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286751+0000", 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.914e-06 2024-09-21T22:16:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286755+0000", 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0099999999999997e-06 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14888 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287843+0000", 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001378755, 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0015305099999999999, 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14888 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287843+0000", 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287843+0000", 2024-09-21T22:16:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287843+0000", 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287845+0000", 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287851+0000", 2024-09-21T22:16:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8549999999999998e-06 2024-09-21T22:16:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287856+0000", 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.617e-06 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14791 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.285185+0000", 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0040368399999999999, 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042291660000000003, 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14791 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285185+0000", 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285185+0000", 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285185+0000", 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285186+0000", 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.13e-06 2024-09-21T22:16:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285189+0000", 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8990000000000001e-06 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.285192+0000", 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.548e-06 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14823 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286229+0000", 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0029929980000000002, 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0032149129999999998, 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14823 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286229+0000", 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286229+0000", 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286229+0000", 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8299999999999997e-07 2024-09-21T22:16:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286231+0000", 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286239+0000", 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3830000000000003e-06 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286243+0000", 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7700000000000001e-06 2024-09-21T22:16:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14856 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286759+0000", 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0024633530000000002, 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027177669999999998, 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14856 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286759+0000", 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286759+0000", 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286759+0000", 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0899999999999997e-07 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286760+0000", 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.206e-06 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286764+0000", 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7740000000000002e-06 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286766+0000", 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6299999999999998e-06 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14889 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287863+0000", 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001359173, 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0016665479999999999, 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14889 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287863+0000", 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287863+0000", 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287863+0000", 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.96e-07 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287865+0000", 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8780000000000001e-06 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287870+0000", 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:16:05.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287875+0000", 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.814e-06 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14825 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286250+0000", 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0029723570000000001, 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033085359999999999, 2024-09-21T22:16:05.323 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14825 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286250+0000", 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286250+0000", 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286250+0000", 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7e-07 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286252+0000", 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9089999999999998e-06 2024-09-21T22:16:05.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286258+0000", 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8850000000000004e-06 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286262+0000", 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4349999999999999e-06 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.326 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14857 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286770+0000", 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0024522390000000002, 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0028295239999999999, 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14857 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286770+0000", 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286770+0000", 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286770+0000", 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286771+0000", 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1570000000000001e-06 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286774+0000", 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.881e-06 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286776+0000", 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5069999999999999e-06 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14890 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287881+0000", 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001340613, 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001754673, 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14890 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.330 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287881+0000", 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287881+0000", 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287882+0000", 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:16:05.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287884+0000", 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9309999999999998e-06 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287889+0000", 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9109999999999998e-06 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287894+0000", 2024-09-21T22:16:05.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4290000000000003e-06 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14826 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286268+0000", 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0029537890000000001, 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034020209999999999, 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14826 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286268+0000", 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286268+0000", 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286269+0000", 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0900000000000002e-07 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286270+0000", 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9319999999999999e-06 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286276+0000", 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7080000000000002e-06 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286282+0000", 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3460000000000001e-06 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14858 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286780+0000", 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002442329, 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002917518, 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14858 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286780+0000", 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286780+0000", 2024-09-21T22:16:05.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286780+0000", 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286781+0000", 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1689999999999999e-06 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286784+0000", 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8380000000000002e-06 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286786+0000", 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.481e-06 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14891 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.339 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287912+0000", 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001310301, 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001823543, 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14891 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287912+0000", 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287912+0000", 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287912+0000", 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2399999999999998e-07 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287914+0000", 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287921+0000", 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2280000000000003e-06 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287926+0000", 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9309999999999999e-06 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.342 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14827 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286288+0000", 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002934187, 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003492003, 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14827 2024-09-21T22:16:05.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286288+0000", 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286288+0000", 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286288+0000", 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286290+0000", 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9520000000000001e-06 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286296+0000", 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7610000000000004e-06 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286300+0000", 2024-09-21T22:16:05.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.639e-06 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14859 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286790+0000", 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0024322079999999999, 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003019103, 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14859 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286790+0000", 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286790+0000", 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286790+0000", 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286794+0000", 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3760000000000001e-06 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286798+0000", 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6799999999999999e-06 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286801+0000", 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5440000000000001e-06 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14892 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287932+0000", 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001289856, 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0019038150000000001, 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.349 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14892 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287932+0000", 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287932+0000", 2024-09-21T22:16:05.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287933+0000", 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287935+0000", 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0279999999999999e-06 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287940+0000", 2024-09-21T22:16:05.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6790000000000002e-06 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287944+0000", 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.216e-06 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14828 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286306+0000", 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002916128, 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035724810000000002, 2024-09-21T22:16:05.352 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14828 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286306+0000", 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286306+0000", 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286306+0000", 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286308+0000", 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0059999999999999e-06 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286314+0000", 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6439999999999997e-06 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286318+0000", 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14860 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286804+0000", 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0024180690000000001, 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031136369999999998, 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14860 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286804+0000", 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286804+0000", 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286804+0000", 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2999999999999999e-07 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286805+0000", 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1489999999999999e-06 2024-09-21T22:16:05.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286808+0000", 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9129999999999999e-06 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286811+0000", 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.157e-06 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14893 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.358 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287950+0000", 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001271641, 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002011844, 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14893 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287950+0000", 2024-09-21T22:16:05.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287950+0000", 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287951+0000", 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287953+0000", 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:16:05.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287958+0000", 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2870000000000004e-06 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287963+0000", 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7500000000000003e-06 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.361 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14829 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286337+0000", 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002884705, 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036532460000000002, 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14829 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286337+0000", 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286337+0000", 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286338+0000", 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3399999999999999e-07 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286340+0000", 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2330000000000001e-06 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286346+0000", 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1619999999999996e-06 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286351+0000", 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7049999999999998e-06 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14861 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286831+0000", 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002390718, 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031928120000000002, 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14861 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.365 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286831+0000", 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286831+0000", 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286832+0000", 2024-09-21T22:16:05.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4300000000000003e-07 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286834+0000", 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0980000000000001e-06 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286840+0000", 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8660000000000002e-06 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286845+0000", 2024-09-21T22:16:05.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8520000000000003e-06 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14894 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287968+0000", 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0012534250000000001, 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002102638, 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14894 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287968+0000", 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287968+0000", 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287969+0000", 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287971+0000", 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9630000000000001e-06 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287977+0000", 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5039999999999999e-06 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287982+0000", 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14830 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286357+0000", 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0028644600000000001, 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514279999999998, 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.371 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14830 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286357+0000", 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286357+0000", 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286358+0000", 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286360+0000", 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0530000000000001e-06 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286365+0000", 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3149999999999999e-06 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286370+0000", 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6480000000000002e-06 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14862 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286851+0000", 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002370769, 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003294328, 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14862 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286851+0000", 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286851+0000", 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286851+0000", 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286853+0000", 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286859+0000", 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8730000000000004e-06 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286864+0000", 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5159999999999996e-06 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14895 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287989+0000", 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0012328249999999999, 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0021833949999999999, 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14895 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.378 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287989+0000", 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287989+0000", 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287989+0000", 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:16:05.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287996+0000", 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9840000000000004e-06 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288003+0000", 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6889999999999998e-06 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288008+0000", 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7539999999999997e-06 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14831 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286376+0000", 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0028458120000000001, 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003834854, 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14831 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286376+0000", 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286376+0000", 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286376+0000", 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286378+0000", 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286382+0000", 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5920000000000001e-06 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286384+0000", 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14863 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286870+0000", 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0023523889999999999, 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033732689999999999, 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14863 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286870+0000", 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286870+0000", 2024-09-21T22:16:05.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286870+0000", 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3399999999999999e-07 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286872+0000", 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.826e-06 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286878+0000", 2024-09-21T22:16:05.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8170000000000004e-06 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286884+0000", 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.127e-06 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14896 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288015+0000", 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0012070780000000001, 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002255777, 2024-09-21T22:16:05.387 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14896 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288015+0000", 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288015+0000", 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288015+0000", 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0200000000000003e-07 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288017+0000", 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2069999999999998e-06 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288023+0000", 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288027+0000", 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-06 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14832 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286388+0000", 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0028342319999999999, 2024-09-21T22:16:05.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039096399999999998, 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14832 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286388+0000", 2024-09-21T22:16:05.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286388+0000", 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286388+0000", 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.35e-07 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286389+0000", 2024-09-21T22:16:05.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1570000000000001e-06 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286392+0000", 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.01e-06 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286395+0000", 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6879999999999999e-06 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14864 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287054+0000", 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.00216753, 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0032704689999999998, 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14864 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287054+0000", 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287054+0000", 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287055+0000", 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6199999999999998e-07 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287058+0000", 2024-09-21T22:16:05.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.089e-06 2024-09-21T22:16:05.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287064+0000", 2024-09-21T22:16:05.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287069+0000", 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7149999999999997e-06 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14897 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288034+0000", 2024-09-21T22:16:05.398 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0011875659999999999, 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023220469999999998, 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14897 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288034+0000", 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288034+0000", 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288035+0000", 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8299999999999997e-07 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288037+0000", 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1900000000000002e-06 2024-09-21T22:16:05.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288043+0000", 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3419999999999996e-06 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288048+0000", 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9119999999999997e-06 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14833 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.401 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286398+0000", 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0028240610000000001, 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039861369999999998, 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14833 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286398+0000", 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286398+0000", 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286398+0000", 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286399+0000", 2024-09-21T22:16:05.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1829999999999999e-06 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286403+0000", 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.861e-06 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286406+0000", 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.509e-06 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14865 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287078+0000", 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002144384, 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033331039999999999, 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14865 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287078+0000", 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287078+0000", 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287078+0000", 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:16:05.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287079+0000", 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287083+0000", 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7079999999999999e-06 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287086+0000", 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9560000000000002e-06 2024-09-21T22:16:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14834 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286409+0000", 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0028131779999999999, 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0040714510000000002, 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14834 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286409+0000", 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286409+0000", 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286409+0000", 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.11e-07 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286410+0000", 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2249999999999999e-06 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286413+0000", 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286416+0000", 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6680000000000001e-06 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14866 3.1d 3.23eacbfd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287090+0000", 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0021320940000000002, 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034454400000000001, 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14866 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287090+0000", 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287090+0000", 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287090+0000", 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4900000000000002e-07 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287091+0000", 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4300000000000001e-06 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287095+0000", 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287098+0000", 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.414 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14898 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288055+0000", 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0011669810000000001, 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0025493619999999999, 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14898 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288055+0000", 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288055+0000", 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288055+0000", 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4999999999999998e-07 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288057+0000", 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9910000000000001e-06 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288063+0000", 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4110000000000004e-06 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288067+0000", 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.34e-06 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14835 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286419+0000", 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0028030120000000001, 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042390350000000004, 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14835 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.418 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286419+0000", 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286419+0000", 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286419+0000", 2024-09-21T22:16:05.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286424+0000", 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286428+0000", 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6500000000000002e-06 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286431+0000", 2024-09-21T22:16:05.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.537e-06 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14868 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287535+0000", 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0016868499999999999, 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003169392, 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.421 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14868 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287535+0000", 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287535+0000", 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287536+0000", 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3099999999999996e-07 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287540+0000", 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1489999999999996e-06 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287549+0000", 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4689999999999997e-06 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287555+0000", 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6139999999999997e-06 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14899 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288072+0000", 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.00114953, 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002666407, 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14899 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288072+0000", 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288072+0000", 2024-09-21T22:16:05.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288073+0000", 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288075+0000", 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288080+0000", 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6380000000000001e-06 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288085+0000", 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4279999999999998e-06 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14836 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286434+0000", 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0027874570000000001, 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043381640000000003, 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14836 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286434+0000", 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286434+0000", 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286435+0000", 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286436+0000", 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3459999999999999e-06 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286439+0000", 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0800000000000002e-06 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286442+0000", 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5840000000000002e-06 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14869 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287566+0000", 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001656184, 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0032348939999999999, 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14869 2024-09-21T22:16:05.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287566+0000", 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287566+0000", 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287566+0000", 2024-09-21T22:16:05.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3399999999999999e-07 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287569+0000", 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.435e-06 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287575+0000", 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0929999999999999e-06 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287581+0000", 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8200000000000002e-06 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14900 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288091+0000", 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001130818, 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002736315, 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.434 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14900 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288091+0000", 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288091+0000", 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288091+0000", 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288094+0000", 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2249999999999999e-06 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288100+0000", 2024-09-21T22:16:05.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0700000000000003e-06 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288103+0000", 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9720000000000001e-06 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14837 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286445+0000", 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002777168, 2024-09-21T22:16:05.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044096339999999999, 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14837 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286445+0000", 2024-09-21T22:16:05.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286445+0000", 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286445+0000", 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286454+0000", 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0850000000000003e-06 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286459+0000", 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286462+0000", 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8439999999999998e-06 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14870 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287588+0000", 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001633612, 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0033009609999999998, 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.441 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14870 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287588+0000", 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287588+0000", 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287589+0000", 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5000000000000003e-07 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287591+0000", 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2639999999999998e-06 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287597+0000", 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0759999999999999e-06 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287602+0000", 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8219999999999997e-06 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14901 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288107+0000", 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001115244, 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0028101340000000002, 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14901 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288107+0000", 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288107+0000", 2024-09-21T22:16:05.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288107+0000", 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7099999999999998e-07 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288108+0000", 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.319e-06 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288112+0000", 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.856e-06 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288115+0000", 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14838 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286466+0000", 2024-09-21T22:16:05.447 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0027559709999999999, 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044818979999999998, 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14838 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286466+0000", 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286466+0000", 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286466+0000", 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5699999999999999e-07 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286468+0000", 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.367e-06 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286471+0000", 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8070000000000001e-06 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286474+0000", 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6120000000000001e-06 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.450 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14871 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287608+0000", 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0016135679999999999, 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00342955, 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14871 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287608+0000", 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287608+0000", 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287609+0000", 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.03e-07 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287611+0000", 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9410000000000001e-06 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287616+0000", 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287621+0000", 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.498e-06 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.453 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14902 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288118+0000", 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0011034409999999999, 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002972485, 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.454 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14902 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288118+0000", 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288118+0000", 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288119+0000", 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288120+0000", 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288123+0000", 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9610000000000001e-06 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288125+0000", 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5509999999999998e-06 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14839 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286477+0000", 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0027444819999999999, 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046664009999999997, 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14839 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286477+0000", 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286477+0000", 2024-09-21T22:16:05.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286478+0000", 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286479+0000", 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2440000000000001e-06 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286482+0000", 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.061e-06 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286485+0000", 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14872 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287631+0000", 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0015911650000000001, 2024-09-21T22:16:05.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0035644700000000001, 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14872 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287631+0000", 2024-09-21T22:16:05.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287631+0000", 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287631+0000", 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.39e-07 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287634+0000", 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3769999999999999e-06 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287640+0000", 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2999999999999998e-06 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287645+0000", 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6630000000000001e-06 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14903 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288129+0000", 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0010929049999999999, 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031148289999999999, 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14903 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.464 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288129+0000", 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288129+0000", 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288129+0000", 2024-09-21T22:16:05.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1299999999999999e-07 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288130+0000", 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288133+0000", 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8890000000000002e-06 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288136+0000", 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5790000000000002e-06 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14840 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286488+0000", 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0027341420000000002, 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048105040000000002, 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14840 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286488+0000", 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286488+0000", 2024-09-21T22:16:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286488+0000", 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286491+0000", 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0620000000000001e-06 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286494+0000", 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0060000000000001e-06 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286498+0000", 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.924e-06 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14873 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.470 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287652+0000", 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001569576, 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036958020000000002, 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14873 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287652+0000", 2024-09-21T22:16:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287652+0000", 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287653+0000", 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0200000000000003e-07 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287655+0000", 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3520000000000001e-06 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287661+0000", 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.536e-06 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287665+0000", 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.473 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14904 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288139+0000", 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0010829730000000001, 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0032619490000000001, 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14904 2024-09-21T22:16:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288139+0000", 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288139+0000", 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288139+0000", 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.22e-07 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288140+0000", 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.049e-06 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288143+0000", 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2310000000000001e-06 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288149+0000", 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1279999999999999e-06 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14841 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286504+0000", 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0027180490000000002, 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0049574220000000004, 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14841 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286504+0000", 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286504+0000", 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286504+0000", 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8500000000000002e-07 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286506+0000", 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.863e-06 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286512+0000", 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:16:05.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286516+0000", 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5820000000000003e-06 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14874 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287671+0000", 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0015505199999999999, 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0038441090000000001, 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.480 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14874 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287671+0000", 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287671+0000", 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287672+0000", 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287674+0000", 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.029e-06 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287679+0000", 2024-09-21T22:16:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5350000000000004e-06 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287684+0000", 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.177e-06 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14905 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288165+0000", 2024-09-21T22:16:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0010568540000000001, 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0034021120000000001, 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14905 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288165+0000", 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288165+0000", 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288166+0000", 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288169+0000", 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.083e-06 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288175+0000", 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8549999999999998e-06 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288180+0000", 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14842 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286522+0000", 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0026998899999999999, 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050929469999999996, 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14842 2024-09-21T22:16:05.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286522+0000", 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286522+0000", 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286522+0000", 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.65e-07 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286524+0000", 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.81e-06 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286530+0000", 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4219999999999999e-06 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286534+0000", 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.369e-06 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14875 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287688+0000", 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001534304, 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00397548, 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.490 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14875 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287688+0000", 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287688+0000", 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287688+0000", 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4999999999999999e-07 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287689+0000", 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3340000000000001e-06 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287693+0000", 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3270000000000001e-06 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287695+0000", 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5399999999999998e-06 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.493 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14907 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288700+0000", 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.00052153900000000001, 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030159340000000001, 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14907 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.494 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288700+0000", 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288700+0000", 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288701+0000", 2024-09-21T22:16:05.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9500000000000002e-07 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288705+0000", 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0339999999999998e-06 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288712+0000", 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3799999999999996e-06 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288736+0000", 2024-09-21T22:16:05.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4006999999999999e-05 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14843 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286539+0000", 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.002682425, 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0052306289999999997, 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14843 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286539+0000", 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286539+0000", 2024-09-21T22:16:05.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286540+0000", 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286542+0000", 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.79e-06 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286547+0000", 2024-09-21T22:16:05.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8000000000000004e-06 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286552+0000", 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3819999999999997e-06 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14876 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287698+0000", 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0015235699999999999, 2024-09-21T22:16:05.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0041231699999999998, 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14876 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287698+0000", 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287698+0000", 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287699+0000", 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287700+0000", 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.243e-06 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287703+0000", 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0419999999999998e-06 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287706+0000", 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.565e-06 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14908 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.503 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288747+0000", 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.00047495099999999999, 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031224400000000002, 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14908 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288747+0000", 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288747+0000", 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288747+0000", 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288749+0000", 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.835e-06 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288754+0000", 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.87e-06 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288757+0000", 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.506 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14844 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286559+0000", 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0026626060000000001, 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0053626810000000002, 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14844 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286559+0000", 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286559+0000", 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286560+0000", 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4300000000000003e-07 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286562+0000", 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9400000000000001e-06 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286568+0000", 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.392e-06 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286573+0000", 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7720000000000002e-06 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.509 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14877 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287709+0000", 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0015133639999999999, 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0042670649999999996, 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.510 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14877 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287709+0000", 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287709+0000", 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287709+0000", 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1100000000000002e-07 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287710+0000", 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287713+0000", 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.021e-06 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287716+0000", 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.548e-06 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14909 3.1d 3.23eacbfd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.288762+0000", 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.00046026200000000002, 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0032667769999999998, 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.513 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14909 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288762+0000", 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288762+0000", 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288762+0000", 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.28e-07 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288763+0000", 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3090000000000001e-06 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288766+0000", 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.179e-06 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.288769+0000", 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7219999999999999e-06 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14845 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286580+0000", 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0026423649999999998, 2024-09-21T22:16:05.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0055013989999999997, 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14845 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286580+0000", 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286580+0000", 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286580+0000", 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.84e-07 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286582+0000", 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9980000000000002e-06 2024-09-21T22:16:05.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286588+0000", 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8429999999999998e-06 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286593+0000", 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7589999999999997e-06 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14878 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.519 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287719+0000", 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0015029710000000001, 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.004409858, 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14878 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287719+0000", 2024-09-21T22:16:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287719+0000", 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287719+0000", 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287720+0000", 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.094e-06 2024-09-21T22:16:05.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287723+0000", 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9179999999999998e-06 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287726+0000", 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4679999999999999e-06 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.522 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14846 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286599+0000", 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.00262335, 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00560102, 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14846 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286599+0000", 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286599+0000", 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286599+0000", 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286601+0000", 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9319999999999999e-06 2024-09-21T22:16:05.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286607+0000", 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8250000000000001e-06 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286612+0000", 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9740000000000001e-06 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14879 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287729+0000", 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001492862, 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0045230720000000004, 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14879 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.526 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287729+0000", 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287729+0000", 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287729+0000", 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.36e-07 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287730+0000", 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1379999999999999e-06 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287733+0000", 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.881e-06 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287736+0000", 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5100000000000001e-06 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14847 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286617+0000", 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0026047729999999999, 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056885449999999997, 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14847 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286617+0000", 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286617+0000", 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286618+0000", 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9200000000000001e-07 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286623+0000", 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6300000000000003e-06 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286629+0000", 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.925e-06 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286634+0000", 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6110000000000004e-06 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.531 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14880 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287740+0000", 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0014821369999999999, 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046189380000000004, 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14880 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287740+0000", 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287740+0000", 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287740+0000", 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287741+0000", 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.048e-06 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287745+0000", 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287748+0000", 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.548e-06 2024-09-21T22:16:05.534 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14848 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286640+0000", 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0025819319999999999, 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0057712889999999998, 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14848 2024-09-21T22:16:05.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286640+0000", 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286640+0000", 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286640+0000", 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8800000000000003e-07 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286642+0000", 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9089999999999998e-06 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286649+0000", 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0439999999999998e-06 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286654+0000", 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8289999999999998e-06 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14881 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287751+0000", 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001471055, 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.004716296, 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.538 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14881 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287751+0000", 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287751+0000", 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287751+0000", 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1e-07 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287752+0000", 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1009999999999999e-06 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287755+0000", 2024-09-21T22:16:05.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9519999999999999e-06 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287758+0000", 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4980000000000001e-06 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14849 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286660+0000", 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0025618479999999998, 2024-09-21T22:16:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0058600859999999996, 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14849 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286660+0000", 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286660+0000", 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286661+0000", 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286663+0000", 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:05.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286669+0000", 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1739999999999997e-06 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286673+0000", 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6539999999999998e-06 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.544 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14882 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287761+0000", 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0014613370000000001, 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048137859999999996, 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14882 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287761+0000", 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287761+0000", 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287761+0000", 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287762+0000", 2024-09-21T22:16:05.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.139e-06 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287765+0000", 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2219999999999998e-06 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287768+0000", 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.508e-06 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14850 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286679+0000", 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0025425619999999999, 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059444060000000002, 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14850 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286679+0000", 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286679+0000", 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286680+0000", 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286682+0000", 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1150000000000001e-06 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286688+0000", 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6829999999999996e-06 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286692+0000", 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8770000000000001e-06 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.550 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14883 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287771+0000", 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001451047, 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0049048779999999997, 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14883 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287771+0000", 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287771+0000", 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287771+0000", 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287775+0000", 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4109999999999998e-06 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287779+0000", 2024-09-21T22:16:05.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1020000000000001e-06 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287781+0000", 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6280000000000001e-06 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14851 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286698+0000", 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0025235420000000001, 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006029965, 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.554 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14851 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286698+0000", 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286698+0000", 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286699+0000", 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286701+0000", 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5189999999999999e-06 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286707+0000", 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6180000000000003e-06 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286711+0000", 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2849999999999996e-06 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14884 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287785+0000", 2024-09-21T22:16:05.557 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001437364, 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0049948950000000001, 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14884 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287785+0000", 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287785+0000", 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287785+0000", 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287786+0000", 2024-09-21T22:16:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.206e-06 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287789+0000", 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9639999999999999e-06 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287792+0000", 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4849999999999999e-06 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14852 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286715+0000", 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0025064760000000001, 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0061165710000000003, 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14852 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286715+0000", 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286715+0000", 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286716+0000", 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286717+0000", 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2580000000000001e-06 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286720+0000", 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1920000000000001e-06 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286723+0000", 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8279999999999999e-06 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14885 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287796+0000", 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001426252, 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.005087182, 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14885 2024-09-21T22:16:05.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287796+0000", 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287796+0000", 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287796+0000", 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287797+0000", 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3209999999999999e-06 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287800+0000", 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287803+0000", 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5569999999999998e-06 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14853 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286726+0000", 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0024955820000000001, 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0062097849999999998, 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.567 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14853 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286726+0000", 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286726+0000", 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286727+0000", 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0400000000000002e-07 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286728+0000", 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.26e-06 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286731+0000", 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9720000000000001e-06 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286733+0000", 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5519999999999999e-06 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14886 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287807+0000", 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0014150790000000001, 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0051831710000000003, 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.570 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14886 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287807+0000", 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287807+0000", 2024-09-21T22:16:05.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287807+0000", 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0299999999999999e-07 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287809+0000", 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7600000000000001e-06 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287814+0000", 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0000000000000004e-06 2024-09-21T22:16:05.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287819+0000", 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6410000000000001e-06 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14854 3.16 3.640af756 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.286737+0000", 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0024853969999999999, 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.006306397, 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.573 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14854 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286737+0000", 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286737+0000", 2024-09-21T22:16:05.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286737+0000", 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286738+0000", 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1680000000000001e-06 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286741+0000", 2024-09-21T22:16:05.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.286743+0000", 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4830000000000002e-06 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:14887 3.5 3.a71a2ce5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.287824+0000", 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001397494, 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0052712380000000001, 2024-09-21T22:16:05.576 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 14887 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287824+0000", 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287824+0000", 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287825+0000", 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.75e-07 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287827+0000", 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8950000000000001e-06 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287832+0000", 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.429e-06 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.287837+0000", 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7520000000000004e-06 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: ], 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 87 2024-09-21T22:16:05.579 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:05.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:05.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:05.580+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:05.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:05.681+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:05.726 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:05.726 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:05.726 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:05.726 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:05.726 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:05.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:05.782 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:05.782+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12142 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1802240~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88996352000000001, 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030639835000000001, 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12142 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.05e-07 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947122+0000", 2024-09-21T22:16:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.091e-06 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947125+0000", 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.96e-06 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947128+0000", 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977404+0000", 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030275976 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977491+0000", 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7390000000000002e-05 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977761+0000", 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026966300000000001 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12165 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1064960~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88989183900000002, 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032863673000000003, 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12165 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1600000000000001e-07 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947196+0000", 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9040000000000001e-06 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947208+0000", 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1744e-05 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947214+0000", 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5779999999999998e-06 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977797+0000", 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030583744999999999 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977874+0000", 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6417999999999999e-05 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980057+0000", 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002182668 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12166 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1146880~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88985754900000003, 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033274597000000003, 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12166 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947228+0000", 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9299999999999998e-07 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947233+0000", 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3700000000000003e-06 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947240+0000", 2024-09-21T22:16:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.849e-06 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947245+0000", 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0669999999999999e-06 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980090+0000", 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032845234000000001 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980172+0000", 2024-09-21T22:16:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2191e-05 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980502+0000", 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032939299999999998 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12167 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1228800~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88982319600000004, 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035568130000000003, 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12167 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947262+0000", 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7899999999999998e-07 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947264+0000", 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1969999999999999e-06 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947270+0000", 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2440000000000001e-06 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947274+0000", 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6460000000000001e-06 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980550+0000", 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033275603000000001 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980646+0000", 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6144999999999995e-05 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982830+0000", 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002183716 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12168 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1359872~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88980351800000002, 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038517607000000002, 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12168 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947282+0000", 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947284+0000", 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0090000000000002e-06 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947289+0000", 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947301+0000", 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1661999999999999e-05 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982948+0000", 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035647146999999997 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.983078+0000", 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012943199999999999 2024-09-21T22:16:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985799+0000", 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002721106 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12169 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1441792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88977659899999995, 2024-09-21T22:16:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039735563000000002, 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12169 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947309+0000", 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947318+0000", 2024-09-21T22:16:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4159999999999993e-06 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947326+0000", 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7989999999999994e-06 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947332+0000", 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3080000000000004e-06 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985831+0000", 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038498917000000001 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985917+0000", 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6178000000000001e-05 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987044+0000", 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011264859999999999 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88974496800000002, 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:16:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88972479699999996, 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88970585099999999, 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:16:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88968648800000005, 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:16:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88965384000000003, 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:16:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88960267299999995, 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:16:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88957600100000001, 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:16:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88955120200000004, 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88952025400000001, 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88949603600000005, 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:16:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:16:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88947168399999998, 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:16:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.913 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88944744099999995, 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:05.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:16:05.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:16:05.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88941770600000003, 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.88938223599999999, 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.922 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:05.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:05.925 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:05.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:05.927 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:05.926+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:16:05.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:16:06.028 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:06.027+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:06.072 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:06.072 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:06.072 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:06.072 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:06.081 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:06.095 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-21T22:16:06.165 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:06.165+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:06.228 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:06.229 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:06.229 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:06.228+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:06.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:06.330 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:06.329+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:06.365 INFO:teuthology.orchestra.run.smithi134.stdout:1411 write 0x774149c thru 0x774ac39 (0x979e bytes) 2024-09-21T22:16:06.373 INFO:teuthology.orchestra.run.smithi134.stdout:1412 write 0x4b30887 thru 0x4b388c6 (0x8040 bytes) 2024-09-21T22:16:06.375 INFO:teuthology.orchestra.run.smithi134.stdout:1413 write 0x5ff8238 thru 0x600098c (0x8755 bytes) 2024-09-21T22:16:06.377 INFO:teuthology.orchestra.run.smithi134.stdout:1414 read 0x2cc3685 thru 0x2ccfb20 (0xc49c bytes) 2024-09-21T22:16:06.377 INFO:teuthology.orchestra.run.smithi134.stdout:1415 writesame 0xc2be4a3 thru 0xc2c31be data_size 0x23(0x4d1c bytes) 2024-09-21T22:16:06.381 INFO:teuthology.orchestra.run.smithi134.stdout:1418 writesame 0x893e292 thru 0x8943b3e data_size 0x3(0x58ad bytes) 2024-09-21T22:16:06.386 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.253795650000001, 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:06.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:16:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:16:06.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:16:06.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.224735829, 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.393 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 10.024522083000001, 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:16:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:06.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:06.404 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.8732832669999997, 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:16:06.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.470340964, 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:16:06.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:16:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:16:06.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.4702781089999997, 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.417 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:16:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:16:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:16:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:16:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15913 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99678869199999998, 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011391615000000001, 2024-09-21T22:16:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15913 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.16e-07 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387910+0000", 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8899999999999998e-07 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387914+0000", 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1559999999999999e-06 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387920+0000", 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399193+0000", 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011272262 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399239+0000", 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149000000000001e-05 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399301+0000", 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2042e-05 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99677413100000001, 2024-09-21T22:16:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99675187700000001, 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:16:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99672746300000004, 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:16:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:16:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99669799800000003, 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:16:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99667085399999999, 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:16:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:16:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:16:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:16:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:16:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.996651752, 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:16:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:16:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99662759999999995, 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99660382199999997, 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:16:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:16:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99658484700000005, 2024-09-21T22:16:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:16:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99656609699999998, 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:16:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99653401399999997, 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:16:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:16:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:16:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.996521027, 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:16:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.99651077799999999, 2024-09-21T22:16:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:16:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:16:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.485 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout:1419 trunc from 0xe833ce4 to 0x1c40390 2024-09-21T22:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout:1420 punch from 0x10ab423 to 0x10b35ad, (0x818a bytes) 2024-09-21T22:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout:1422 write 0x7deca12 thru 0x7df4468 (0x7a57 bytes) 2024-09-21T22:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout:1423 read 0x75b44f7 thru 0x75ba860 (0x636a bytes) 2024-09-21T22:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout:1424 write 0x78b419f thru 0x78c34ae (0xf310 bytes) 2024-09-21T22:16:06.488 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:06.485+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:06.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout:1425 write 0xed41004 thru 0xed47817 (0x6814 bytes) 2024-09-21T22:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout:1427 write 0x2cf5795 thru 0x2d053f1 (0xfc5d bytes) 2024-09-21T22:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout:1428 punch from 0x61d793f to 0x61db5c8, (0x3c89 bytes) 2024-09-21T22:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout:1430 write 0x4383987 thru 0x43846e5 (0xd5f bytes) 2024-09-21T22:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout:1433 write 0xaae3482 thru 0xaaf2dda (0xf959 bytes) 2024-09-21T22:16:06.543 INFO:teuthology.orchestra.run.smithi134.stdout:1434 trunc from 0xed47818 to 0x210914d 2024-09-21T22:16:06.556 INFO:teuthology.orchestra.run.smithi134.stdout:1435 read 0x888b22 thru 0x88ddc2 (0x52a1 bytes) 2024-09-21T22:16:06.556 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.557 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.573 INFO:teuthology.orchestra.run.smithi134.stdout:1440 writesame 0xb720c88 thru 0xb72d8d7 data_size 0x38(0xcc50 bytes) 2024-09-21T22:16:06.573 INFO:teuthology.orchestra.run.smithi134.stdout:1443 write 0x7de3e62 thru 0x7dee8b0 (0xaa4f bytes) 2024-09-21T22:16:06.583 INFO:teuthology.orchestra.run.smithi134.stdout:1444 read 0xaec598a thru 0xaed2d4b (0xd3c2 bytes) 2024-09-21T22:16:06.583 INFO:teuthology.orchestra.run.smithi134.stdout:1445 write 0x77b883f thru 0x77bb215 (0x29d7 bytes) 2024-09-21T22:16:06.587 INFO:teuthology.orchestra.run.smithi134.stdout:1446 write 0xb6fe4c3 thru 0xb70bb11 (0xd64f bytes) 2024-09-21T22:16:06.587 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:06.586+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:06.598 INFO:teuthology.orchestra.run.smithi134.stdout:1447 write 0x9027c07 thru 0x90377c1 (0xfbbb bytes) 2024-09-21T22:16:06.598 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:06.598 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:06.599 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:06.599 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:06.608 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:06.609 INFO:teuthology.orchestra.run.smithi134.stdout:1448 writesame 0x7942d2a thru 0x794381f data_size 0x17(0xaf6 bytes) 2024-09-21T22:16:06.611 INFO:teuthology.orchestra.run.smithi134.stdout:1449 read 0x1401ff4 thru 0x1407699 (0x56a6 bytes) 2024-09-21T22:16:06.618 INFO:teuthology.orchestra.run.smithi134.stdout:1450 write 0xbc51343 thru 0xbc584a8 (0x7166 bytes) 2024-09-21T22:16:06.624 INFO:teuthology.orchestra.run.smithi134.stdout:1452 punch from 0x97f63d to 0x98cd10, (0xd6d3 bytes) 2024-09-21T22:16:06.624 INFO:teuthology.orchestra.run.smithi134.stdout:1453 punch from 0x2b05a21 to 0x2b1389b, (0xde7a bytes) 2024-09-21T22:16:06.624 INFO:teuthology.orchestra.run.smithi134.stdout:1454 read 0x397d211 thru 0x397eb9c (0x198c bytes) 2024-09-21T22:16:06.626 INFO:teuthology.orchestra.run.smithi134.stdout:1456 trunc from 0xbc584a9 to 0xa413431 2024-09-21T22:16:06.639 INFO:teuthology.orchestra.run.smithi134.stdout:1458 write 0x76d14f8 thru 0x76de179 (0xcc82 bytes) 2024-09-21T22:16:06.645 INFO:teuthology.orchestra.run.smithi134.stdout:1459 read 0x52bf443 thru 0x52c3349 (0x3f07 bytes) 2024-09-21T22:16:06.645 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.645 INFO:teuthology.orchestra.run.smithi134.stdout:1463 punch from 0x3f5ad74 to 0x3f5f95a, (0x4be6 bytes) 2024-09-21T22:16:06.645 INFO:teuthology.orchestra.run.smithi134.stdout:1464 write 0x3971c8 thru 0x39dfc7 (0x6e00 bytes) 2024-09-21T22:16:06.647 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:1468 writesame 0xd483a6a thru 0xd4898d1 data_size 0x4c(0x5e68 bytes) 2024-09-21T22:16:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:1470 punch from 0x940881b to 0x941786a, (0xf04f bytes) 2024-09-21T22:16:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:1475 punch from 0xd2b9c0d to 0xd2c90b8, (0xf4ab bytes) 2024-09-21T22:16:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:1477 writesame 0xaf5a318 thru 0xaf67fc0 data_size 0x1(0xdca9 bytes) 2024-09-21T22:16:06.669 INFO:teuthology.orchestra.run.smithi134.stdout:1478 read 0x7691e66 thru 0x7694163 (0x22fe bytes) 2024-09-21T22:16:06.670 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.670 INFO:teuthology.orchestra.run.smithi134.stdout:1482 punch from 0xb839074 to 0xb848a8d, (0xfa19 bytes) 2024-09-21T22:16:06.670 INFO:teuthology.orchestra.run.smithi134.stdout:1484 writesame 0x61bf5c1 thru 0x61c8e3b data_size 0x25(0x987b bytes) 2024-09-21T22:16:06.676 INFO:teuthology.orchestra.run.smithi134.stdout:1485 writesame 0x3630c32 thru 0x363eb77 data_size 0x1(0xdf46 bytes) 2024-09-21T22:16:06.688 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:06.687+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:06.700 INFO:teuthology.orchestra.run.smithi134.stdout:1486 write 0xde3cf67 thru 0xde486fc (0xb796 bytes) 2024-09-21T22:16:06.705 INFO:teuthology.orchestra.run.smithi134.stdout:1492 write 0xca6fc00 thru 0xca708e6 (0xce7 bytes) 2024-09-21T22:16:06.709 INFO:teuthology.orchestra.run.smithi134.stdout:1494 read 0x12d350 thru 0x134305 (0x6fb6 bytes) 2024-09-21T22:16:06.710 INFO:teuthology.orchestra.run.smithi134.stdout:1495 read 0x9c18a4b thru 0x9c1ff30 (0x74e6 bytes) 2024-09-21T22:16:06.710 INFO:teuthology.orchestra.run.smithi134.stdout:1496 read 0xd74d0f9 thru 0xd7519b7 (0x48bf bytes) 2024-09-21T22:16:06.720 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:06.720 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:06.725 INFO:teuthology.orchestra.run.smithi134.stdout:1497 trunc from 0xde486fd to 0xe879eb 2024-09-21T22:16:06.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:06.750 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.750 INFO:teuthology.orchestra.run.smithi134.stdout:1499 read 0xc54bef thru 0xc60392 (0xb7a4 bytes) 2024-09-21T22:16:06.750 INFO:teuthology.orchestra.run.smithi134.stdout:1501 read 0xe10903 thru 0xe1ab47 (0xa245 bytes) 2024-09-21T22:16:06.750 INFO:teuthology.orchestra.run.smithi134.stdout:1502 punch from 0x759bd7 to 0x75c5c3, (0x29ec bytes) 2024-09-21T22:16:06.750 INFO:teuthology.orchestra.run.smithi134.stdout:1504 read 0xc4e30 thru 0xc8e68 (0x4039 bytes) 2024-09-21T22:16:06.750 INFO:teuthology.orchestra.run.smithi134.stdout:1505 read 0x79dfb7 thru 0x7a97aa (0xb7f4 bytes) 2024-09-21T22:16:06.751 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.759 INFO:teuthology.orchestra.run.smithi134.stdout:1507 write 0x3182796 thru 0x3188cd1 (0x653c bytes) 2024-09-21T22:16:06.767 INFO:teuthology.orchestra.run.smithi134.stdout:1510 read 0x13a7b5a thru 0x13b3c85 (0xc12c bytes) 2024-09-21T22:16:06.767 INFO:teuthology.orchestra.run.smithi134.stdout:1512 read 0xed3768 thru 0xedbcfb (0x8594 bytes) 2024-09-21T22:16:06.767 INFO:teuthology.orchestra.run.smithi134.stdout:1513 punch from 0x3062cbd to 0x30711c5, (0xe508 bytes) 2024-09-21T22:16:06.777 INFO:teuthology.orchestra.run.smithi134.stdout:1514 writesame 0x5660b78 thru 0x56610c3 data_size 0x6(0x54c bytes) 2024-09-21T22:16:06.777 INFO:teuthology.orchestra.run.smithi134.stdout:1516 writesame 0x55b0161 thru 0x55b1e80 data_size 0x10(0x1d20 bytes) 2024-09-21T22:16:06.779 INFO:teuthology.orchestra.run.smithi134.stdout:1517 write 0x1ccb49d thru 0x1cd6a47 (0xb5ab bytes) 2024-09-21T22:16:06.789 INFO:teuthology.orchestra.run.smithi134.stdout:1518 write 0x263239 thru 0x2669ff (0x37c7 bytes) 2024-09-21T22:16:06.789 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:06.789+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:06.790 INFO:teuthology.orchestra.run.smithi134.stdout:1519 read 0x56e1e7 thru 0x56ff73 (0x1d8d bytes) 2024-09-21T22:16:06.791 INFO:teuthology.orchestra.run.smithi134.stdout:1520 punch from 0xce3d78 to 0xcef18a, (0xb412 bytes) 2024-09-21T22:16:06.791 INFO:teuthology.orchestra.run.smithi134.stdout:1521 write 0x48c1b59 thru 0x48c828a (0x6732 bytes) 2024-09-21T22:16:06.809 INFO:teuthology.orchestra.run.smithi134.stdout:1523 write 0xa6f1bd4 thru 0xa6f694e (0x4d7b bytes) 2024-09-21T22:16:06.815 INFO:teuthology.orchestra.run.smithi134.stdout:1524 write 0x3f982fc thru 0x3fa5fec (0xdcf1 bytes) 2024-09-21T22:16:06.827 INFO:teuthology.orchestra.run.smithi134.stdout:1525 writesame 0x9ee2d65 thru 0x9ee8e18 data_size 0x6(0x60b4 bytes) 2024-09-21T22:16:06.837 INFO:teuthology.orchestra.run.smithi134.stdout:1526 write 0xa501477 thru 0xa50847e (0x7008 bytes) 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1018 3.15 3:ae013215:::rbd_data.1185ff358907.0000000000000002:head [write 0~1016375 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.331062965000001, 2024-09-21T22:16:06.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019909570000000001, 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1018 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0399999999999996e-07 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509915+0000", 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018678049999999999 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509926+0000", 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0729e-05 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509937+0000", 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1447999999999999e-05 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522027+0000", 2024-09-21T22:16:06.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012089379000000001 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522161+0000", 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134525 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527828+0000", 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056671430000000004 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527880+0000", 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1329000000000003e-05 2024-09-21T22:16:06.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527956+0000", 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6607999999999996e-05 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1139 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.313201253999999, 2024-09-21T22:16:06.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017975142999999999, 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1139 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525911+0000", 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525917+0000", 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8599999999999998e-06 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525921+0000", 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540743+0000", 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014821166 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540833+0000", 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0853000000000006e-05 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543884+0000", 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030503219999999998 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12418 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997085+0000", 2024-09-21T22:16:06.850 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.8420246850000002, 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017384954000000001, 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12418 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997085+0000", 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997085+0000", 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997086+0000", 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997088+0000", 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1560000000000002e-06 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997093+0000", 2024-09-21T22:16:06.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8940000000000001e-06 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997095+0000", 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7669999999999999e-06 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014188+0000", 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017092294000000001 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014233+0000", 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5151999999999997e-05 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014470+0000", 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023725100000000001 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12419 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2375680~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.842010994, 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017663772000000001, 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.856 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12419 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997100+0000", 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.238e-06 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997103+0000", 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0089999999999999e-06 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997106+0000", 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4789999999999999e-06 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014499+0000", 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017392764000000002 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014543+0000", 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4947000000000002e-05 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014763+0000", 2024-09-21T22:16:06.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000219127 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12420 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2457600~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.842000987, 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017934450000000001, 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.861 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12420 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997110+0000", 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0389999999999999e-06 2024-09-21T22:16:06.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997113+0000", 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1250000000000001e-06 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997116+0000", 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.481e-06 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014801+0000", 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017685482999999998 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014850+0000", 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9107999999999998e-05 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015043+0000", 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000192991 2024-09-21T22:16:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12421 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2539520~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.8419912489999999, 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018190212000000001, 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12421 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997120+0000", 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0160000000000001e-06 2024-09-21T22:16:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997124+0000", 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0300000000000004e-06 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997128+0000", 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8689999999999997e-06 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015060+0000", 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017932303 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015104+0000", 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3766000000000001e-05 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015309+0000", 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00020502399999999999 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12440 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2686976~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.84195522, 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562981999999999, 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12440 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997157+0000", 2024-09-21T22:16:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7600000000000001e-06 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997161+0000", 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6630000000000001e-06 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997165+0000", 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3270000000000001e-06 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015348+0000", 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018183263000000002 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015444+0000", 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5798999999999995e-05 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015718+0000", 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027377 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12441 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2768896~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.8419400339999998, 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018855137000000001, 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12441 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0600000000000001e-07 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997172+0000", 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.708e-06 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997177+0000", 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4729999999999999e-06 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997180+0000", 2024-09-21T22:16:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015743+0000", 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562498 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015791+0000", 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8294000000000002e-05 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016025+0000", 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000234109 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12442 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2850816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.841926242, 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019142308, 2024-09-21T22:16:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12442 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997185+0000", 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.195e-06 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997188+0000", 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2600000000000001e-06 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997192+0000", 2024-09-21T22:16:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.968e-06 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016060+0000", 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018867816999999999 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016112+0000", 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1518999999999999e-05 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016326+0000", 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00021432800000000001 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12450 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2621440~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.8418482379999999, 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019490774999999998, 2024-09-21T22:16:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12450 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2799999999999995e-07 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997266+0000", 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4429999999999999e-06 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997275+0000", 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5750000000000007e-06 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997281+0000", 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.003e-06 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016367+0000", 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019085536 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016467+0000", 2024-09-21T22:16:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9747000000000006e-05 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016752+0000", 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028574299999999998 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.891 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12451 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.841818637, 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019832520999999999, 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12451 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997292+0000", 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.13e-07 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997294+0000", 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2740000000000002e-06 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997307+0000", 2024-09-21T22:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3281e-05 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997313+0000", 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9909999999999999e-06 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016783+0000", 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019469455 2024-09-21T22:16:06.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016832+0000", 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9261999999999997e-05 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017124+0000", 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00029164499999999999 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.896 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12452 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.841788864, 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020179939000000001, 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12452 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.63e-07 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997324+0000", 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2819999999999999e-06 2024-09-21T22:16:06.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997335+0000", 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1497e-05 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997341+0000", 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5740000000000003e-06 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017162+0000", 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019821709 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017214+0000", 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1542000000000002e-05 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017501+0000", 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028687199999999997 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12453 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.841761365, 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020570432, 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12453 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997349+0000", 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997351+0000", 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0650000000000001e-06 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997357+0000", 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3010000000000003e-06 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997366+0000", 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3979999999999999e-06 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017547+0000", 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020181706000000001 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017640+0000", 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2868000000000006e-05 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017919+0000", 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027868400000000002 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12461 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.84173345, 2024-09-21T22:16:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020883003000000001, 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12461 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997377+0000", 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9699999999999996e-07 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997379+0000", 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997386+0000", 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9190000000000002e-06 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997391+0000", 2024-09-21T22:16:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7230000000000004e-06 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017963+0000", 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020572277 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018055+0000", 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1842000000000006e-05 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018259+0000", 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000204386 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12462 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.8417121999999999, 2024-09-21T22:16:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021171724999999999, 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12462 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8900000000000001e-07 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997399+0000", 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.432e-06 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997404+0000", 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8740000000000003e-06 2024-09-21T22:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997407+0000", 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8040000000000002e-06 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018290+0000", 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020882670999999998 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018347+0000", 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6972000000000003e-05 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018569+0000", 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000222683 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12463 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.8416995090000001, 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02155197, 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12463 2024-09-21T22:16:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997411+0000", 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997412+0000", 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.127e-06 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997415+0000", 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.174e-06 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997417+0000", 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018613+0000", 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021195611999999999 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018698+0000", 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5158e-05 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018962+0000", 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000264071 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12473 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2654208~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.8412325040000002, 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02139957, 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12473 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997878+0000", 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997882+0000", 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.048e-06 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997894+0000", 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1839e-05 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997905+0000", 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1015e-05 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018998+0000", 2024-09-21T22:16:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02109248 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019046+0000", 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8093000000000002e-05 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019277+0000", 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023115200000000001 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12474 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2736128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.841186368, 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021670372, 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12474 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997924+0000", 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6499999999999999e-07 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997927+0000", 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.644e-06 2024-09-21T22:16:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997935+0000", 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.49e-06 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997940+0000", 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0860000000000001e-06 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019314+0000", 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021373601999999998 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019360+0000", 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6260000000000001e-05 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019594+0000", 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000233725 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12475 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2818048~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.841160811, 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022017721000000001, 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12475 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997951+0000", 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997959+0000", 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2620000000000001e-06 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019633+0000", 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021669000000000001 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019700+0000", 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7769999999999997e-05 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019967+0000", 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000266223 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12481 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.837929741, 2024-09-21T22:16:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018906626999999999, 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12481 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001181+0000", 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1999999999999998e-07 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001185+0000", 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1570000000000002e-06 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001195+0000", 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0121e-05 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001202+0000", 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.041e-06 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019994+0000", 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018791233000000001 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020036+0000", 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2567000000000001e-05 2024-09-21T22:16:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020087+0000", 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0587999999999997e-05 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:06.943 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:06.946 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:06.946 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:06.944+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1528 punch from 0x79182c7 to 0x7927d57, (0xfa90 bytes) 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1529 trunc from 0xa6f694f to 0x219c500 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1530 trunc from 0x219c500 to 0x4373c5d 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1531 writesame 0x23b3c1 thru 0x23bac7 data_size 0x1(0x707 bytes) 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1532 punch from 0x3aadd1d to 0x3ab3efb, (0x61de bytes) 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1533 read 0x2d36152 thru 0x2d373d7 (0x1286 bytes) 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1534 write 0x600182d thru 0x6002e28 (0x15fc bytes) 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1535 trunc from 0x6002e29 to 0xa62f8c8 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1537 read 0x6ecdc91 thru 0x6edb3a5 (0xd715 bytes) 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1538 trunc from 0xa62f8c8 to 0x9f1cbb0 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1539 writesame 0xc869a2c thru 0xc87881b data_size 0xbc(0xedf0 bytes) 2024-09-21T22:16:06.948 INFO:teuthology.orchestra.run.smithi134.stdout:1541 read 0x18f6ac2 thru 0x18ff837 (0x8d76 bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1543 punch from 0x15e014f to 0x15e2860, (0x2711 bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1544 read 0x1107308 thru 0x111177a (0xa473 bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1545 write 0x913473e thru 0x913ddba (0x967d bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1548 punch from 0x5fd0a42 to 0x5fdcc6b, (0xc229 bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1549 read 0x656f869 thru 0x6575abf (0x6257 bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1550 write 0x653088a thru 0x65398f8 (0x906f bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1551 write 0x317c376 thru 0x3189084 (0xcd0f bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1553 writesame 0x682ce6e thru 0x682fe7b data_size 0x1(0x300e bytes) 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:1558 write 0x1812787 thru 0x1820b54 (0xe3ce bytes) 2024-09-21T22:16:06.950 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:16:06.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:16:06.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:16:06.963 INFO:teuthology.orchestra.run.smithi134.stdout:1560 trunc from 0xc87881c to 0x799b143 2024-09-21T22:16:06.975 INFO:teuthology.orchestra.run.smithi134.stdout:1561 read 0x1ba4476 thru 0x1ba9379 (0x4f04 bytes) 2024-09-21T22:16:06.984 INFO:teuthology.orchestra.run.smithi134.stdout:1562 write 0x8300fa3 thru 0x830e3ba (0xd418 bytes) 2024-09-21T22:16:06.993 INFO:teuthology.orchestra.run.smithi134.stdout:1563 read 0x21a26ab thru 0x21a3abe (0x1414 bytes) 2024-09-21T22:16:06.993 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:06.998 INFO:teuthology.orchestra.run.smithi134.stdout:1565 trunc from 0x830e3bb to 0x419dcab 2024-09-21T22:16:07.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:07.027 INFO:teuthology.orchestra.run.smithi134.stdout:1566 write 0x7a71e7c thru 0x7a7d7ff (0xb984 bytes) 2024-09-21T22:16:07.045 INFO:teuthology.orchestra.run.smithi134.stdout:1567 trunc from 0x7a7d800 to 0x51ceab4 2024-09-21T22:16:07.046 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:07.045+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:07.071 INFO:teuthology.orchestra.run.smithi134.stdout:1569 trunc from 0x51ceab4 to 0xc9b7e0b 2024-09-21T22:16:07.080 INFO:teuthology.orchestra.run.smithi134.stdout:1570 write 0xb3563f thru 0xb4243b (0xcdfd bytes) 2024-09-21T22:16:07.083 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17332 3.b 3:d7df6876:::rbd_object_map.1185fc79843:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-21T22:16:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:07.080420+0000", 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002274664, 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023006509999999999, 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17332 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080420+0000", 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080420+0000", 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080422+0000", 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3420000000000002e-06 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080431+0000", 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9190000000000005e-06 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080453+0000", 2024-09-21T22:16:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1763000000000002e-05 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080462+0000", 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2180000000000005e-06 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080528+0000", 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6445999999999994e-05 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080641+0000", 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112623 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.081093+0000", 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045224499999999999 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17333 3.b 3:d7df6876:::rbd_object_map.1185fc79843:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:07.080499+0000", 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0021952859999999999, 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022767550000000001, 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17333 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080499+0000", 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080499+0000", 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080500+0000", 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080512+0000", 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2160999999999999e-05 2024-09-21T22:16:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080520+0000", 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2679999999999994e-06 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080526+0000", 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9909999999999999e-06 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.081607+0000", 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010808529999999999 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.081695+0000", 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8059999999999994e-05 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082160+0000", 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046526100000000002 2024-09-21T22:16:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17334 3.b 3:d7df6876:::rbd_object_map.1185fc79843:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:07.080536+0000", 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0021581460000000001, 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002280125, 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17334 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080536+0000", 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080536+0000", 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080537+0000", 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.46e-07 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080540+0000", 2024-09-21T22:16:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4630000000000001e-06 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080546+0000", 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1519999999999997e-06 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080551+0000", 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7609999999999998e-06 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082553+0000", 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002001985 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082640+0000", 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6799999999999996e-05 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17335 3.b 3.6e16fbeb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:07.080558+0000", 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0021363210000000001, 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002293088, 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17335 2024-09-21T22:16:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080558+0000", 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080558+0000", 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080559+0000", 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080561+0000", 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6120000000000001e-06 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080568+0000", 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9190000000000002e-06 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.080573+0000", 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:17332 3.b e52/45)", 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:07.082303+0000", 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00039180399999999999, 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057618700000000003, 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082303+0000", 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082303+0000", 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082304+0000", 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4200000000000004e-07 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082308+0000", 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5090000000000004e-06 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082319+0000", 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1283e-05 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:07.082326+0000", 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9999999999999999e-06 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-09-21T22:16:07.106 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:07.106 INFO:teuthology.orchestra.run.smithi134.stdout:1571 write 0x2e86809 thru 0x2e93fc6 (0xd7be bytes) 2024-09-21T22:16:07.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:07.109 INFO:teuthology.orchestra.run.smithi134.stdout:1574 write 0xda9e37b thru 0xdaabe4f (0xdad5 bytes) 2024-09-21T22:16:07.120 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:07.120 INFO:teuthology.orchestra.run.smithi134.stdout:1576 read 0x74dcc09 thru 0x74e8048 (0xb440 bytes) 2024-09-21T22:16:07.120 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:07.120 INFO:teuthology.orchestra.run.smithi134.stdout:1578 read 0x585b494 thru 0x5866fa8 (0xbb15 bytes) 2024-09-21T22:16:07.134 INFO:teuthology.orchestra.run.smithi134.stdout:1579 trunc from 0xdaabe50 to 0x3e3a98e 2024-09-21T22:16:07.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:07.146+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:07.167 INFO:teuthology.orchestra.run.smithi134.stdout:1580 write 0xd26f920 thru 0xd27d1f6 (0xd8d7 bytes) 2024-09-21T22:16:07.179 INFO:teuthology.orchestra.run.smithi134.stdout:1583 write 0x1cd75bd thru 0x1ce131e (0x9d62 bytes) 2024-09-21T22:16:07.179 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:07.180 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:07.187 INFO:teuthology.orchestra.run.smithi134.stdout:1584 read 0x5ac12e0 thru 0x5ace79b (0xd4bc bytes) 2024-09-21T22:16:07.187 INFO:teuthology.orchestra.run.smithi134.stdout:1585 writesame 0x99354f6 thru 0x993794f data_size 0x2f(0x245a bytes) 2024-09-21T22:16:07.191 INFO:teuthology.orchestra.run.smithi134.stdout:1586 read 0x31d27d6 thru 0x31ddd8a (0xb5b5 bytes) 2024-09-21T22:16:07.191 INFO:teuthology.orchestra.run.smithi134.stdout:1587 read 0xcdcedc thru 0xce6bfd (0x9d22 bytes) 2024-09-21T22:16:07.201 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:07.202 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:07.207 INFO:teuthology.orchestra.run.smithi134.stdout:1588 trunc from 0xd27d1f7 to 0x25baaa2 2024-09-21T22:16:07.224 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:07.224 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:07.225 INFO:teuthology.orchestra.run.smithi134.stdout:1589 read 0x233cf63 thru 0x233e269 (0x1307 bytes) 2024-09-21T22:16:07.242 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:07.242 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:07.249 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:07.247+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:07.250 INFO:teuthology.orchestra.run.smithi134.stdout:1590 write 0xe8ed8ab thru 0xe8fa72a (0xce80 bytes) 2024-09-21T22:16:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:1591 read 0x52f38f4 thru 0x52fa111 (0x681e bytes) 2024-09-21T22:16:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:1592 write 0xa4bc980 thru 0xa4c62bd (0x993e bytes) 2024-09-21T22:16:07.264 INFO:teuthology.orchestra.run.smithi134.stdout:1593 punch from 0x1af08d4 to 0x1af09fb, (0x127 bytes) 2024-09-21T22:16:07.264 INFO:teuthology.orchestra.run.smithi134.stdout:1594 write 0x26fd05b thru 0x2708d7b (0xbd21 bytes) 2024-09-21T22:16:07.265 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:07.265 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:07.273 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:1596 punch from 0x36f6006 to 0x3701ff1, (0xbfeb bytes) 2024-09-21T22:16:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:1597 punch from 0xc061947 to 0xc06722e, (0x58e7 bytes) 2024-09-21T22:16:07.284 INFO:teuthology.orchestra.run.smithi134.stdout:1598 trunc from 0xe8fa72b to 0x6d834fb 2024-09-21T22:16:07.291 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:07.291 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:07.292 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:07.292 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:07.295 INFO:teuthology.orchestra.run.smithi134.stdout:1599 punch from 0x4cb1931 to 0x4cb4917, (0x2fe6 bytes) 2024-09-21T22:16:07.295 INFO:teuthology.orchestra.run.smithi134.stdout:1600 writesame 0x628cc4d thru 0x6294da0 data_size 0x7c(0x8154 bytes) 2024-09-21T22:16:07.303 INFO:teuthology.orchestra.run.smithi134.stdout:1601 trunc from 0x6d834fb to 0x5a86a95 2024-09-21T22:16:07.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:07.315 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:07.315 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:07.316 INFO:teuthology.orchestra.run.smithi134.stdout:1603 write 0x4d88db7 thru 0x4d8938c (0x5d6 bytes) 2024-09-21T22:16:07.319 INFO:teuthology.orchestra.run.smithi134.stdout:1604 read 0x9c6af thru 0xa5664 (0x8fb6 bytes) 2024-09-21T22:16:07.323 INFO:teuthology.orchestra.run.smithi134.stdout:1605 writesame 0x2a2e9d4 thru 0x2a30dfe data_size 0x1(0x242b bytes) 2024-09-21T22:16:07.331 INFO:teuthology.orchestra.run.smithi134.stdout:1606 punch from 0x37f438f to 0x37fed10, (0xa981 bytes) 2024-09-21T22:16:07.331 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:07.335 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:07.335 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:07.345 INFO:teuthology.orchestra.run.smithi134.stdout:1608 writesame 0xbb7cea6 thru 0xbb7ee48 data_size 0xd(0x1fa3 bytes) 2024-09-21T22:16:07.345 INFO:teuthology.orchestra.run.smithi134.stdout:1609 write 0x182237d thru 0x1829bbd (0x7841 bytes) 2024-09-21T22:16:07.351 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:07.349+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:07.359 INFO:teuthology.orchestra.run.smithi134.stdout:1610 writesame 0xe543317 thru 0xe54e602 data_size 0x21(0xb2ec bytes) 2024-09-21T22:16:07.360 INFO:teuthology.orchestra.run.smithi134.stdout:1611 write 0xa73e8e1 thru 0xa74c070 (0xd790 bytes) 2024-09-21T22:16:07.368 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:07.369 INFO:teuthology.orchestra.run.smithi134.stdout:1613 write 0x21cc476 thru 0x21d539e (0x8f29 bytes) 2024-09-21T22:16:07.374 INFO:teuthology.orchestra.run.smithi134.stdout:1614 read 0xd86fc40 thru 0xd874ad3 (0x4e94 bytes) 2024-09-21T22:16:07.374 INFO:teuthology.orchestra.run.smithi134.stdout:1615 writesame 0x161fd1a thru 0x1620152 data_size 0x1(0x439 bytes) 2024-09-21T22:16:07.380 INFO:teuthology.orchestra.run.smithi134.stdout:1616 write 0x723de9a thru 0x724595a (0x7ac1 bytes) 2024-09-21T22:16:07.388 INFO:teuthology.orchestra.run.smithi134.stdout:1617 write 0x1ed9be thru 0x1ef2f3 (0x1936 bytes) 2024-09-21T22:16:07.390 INFO:teuthology.orchestra.run.smithi134.stdout:1618 read 0x8944124 thru 0x894af1e (0x6dfb bytes) 2024-09-21T22:16:07.390 INFO:teuthology.orchestra.run.smithi134.stdout:1619 write 0xcf4444d thru 0xcf4afb8 (0x6b6c bytes) 2024-09-21T22:16:07.394 INFO:teuthology.orchestra.run.smithi134.stdout:1620 punch from 0x494e2f2 to 0x495628e, (0x7f9c bytes) 2024-09-21T22:16:07.394 INFO:teuthology.orchestra.run.smithi134.stdout:1621 clone 7 order 23 su 131072 sc 13 2024-09-21T22:16:07.440 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:07.440 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:07.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:07.452 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:07.451+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:07.552 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:07.551+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:07.592 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:07.592 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:07.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:07.653 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:07.652+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:07.703 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:07.703 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:07.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:07.754 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:07.753+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:07.813 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:07.813 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:07.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:07.866 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:07.865+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:07.924 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:07.925 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:07.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:07.955 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:16:07.956 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:16:07.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:07.954+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:07.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:16:08.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:08.057+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:08.066 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:08.066 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:08.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:08.160 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:08.159+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:08.222 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:08.222 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:08.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:08.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:08.271+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:08.358 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:08.358+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:08.374 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:08.374 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:08.382 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:08.460 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:08.459+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:08.486 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:08.486 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:08.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:08.561 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:08.560+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:08.640 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:08.640 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:08.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:08.694 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:08.693+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:08.761 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:08.762 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:08.762 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:08.762+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:08.770 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:08.864 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:08.863+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:08.914 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:08.914 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:08.923 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:08.958 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:16:08.966 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:08.965+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:08.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T22:16:09.066 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:09.065+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:09.119 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:09.119 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:09.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:09.167 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:09.166+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:09.268 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:09.267+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:09.304 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:09.305 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:09.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:09.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:09.368 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:09.367+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:09.418 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:09.418 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:09.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:09.470 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:09.469+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:09.471 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:09.472 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:09.488 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:09.488 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:09.504 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:09.505 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:09.519 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:09.520 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:09.536 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:09.536 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:09.552 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:09.552 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:09.568 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:09.568 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:09.570 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:09.569+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12142 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1802240~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6251567290000004, 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030639835000000001, 2024-09-21T22:16:09.574 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12142 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.05e-07 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947122+0000", 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.091e-06 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947125+0000", 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.96e-06 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947128+0000", 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977404+0000", 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030275976 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977491+0000", 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7390000000000002e-05 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977761+0000", 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026966300000000001 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.578 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12165 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1064960~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6250850479999999, 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032863673000000003, 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.579 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12165 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1600000000000001e-07 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947196+0000", 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9040000000000001e-06 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947208+0000", 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1744e-05 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947214+0000", 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5779999999999998e-06 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977797+0000", 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030583744999999999 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977874+0000", 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6417999999999999e-05 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980057+0000", 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002182668 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12166 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1146880~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6250507580000004, 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033274597000000003, 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.583 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12166 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947228+0000", 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9299999999999998e-07 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947233+0000", 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3700000000000003e-06 2024-09-21T22:16:09.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947240+0000", 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.849e-06 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947245+0000", 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0669999999999999e-06 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980090+0000", 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032845234000000001 2024-09-21T22:16:09.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980172+0000", 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2191e-05 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980502+0000", 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032939299999999998 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12167 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1228800~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.587 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6250164050000002, 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035568130000000003, 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12167 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947262+0000", 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7899999999999998e-07 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947264+0000", 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1969999999999999e-06 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947270+0000", 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2440000000000001e-06 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947274+0000", 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6460000000000001e-06 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980550+0000", 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033275603000000001 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980646+0000", 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6144999999999995e-05 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982830+0000", 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002183716 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.591 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12168 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1359872~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6249967270000001, 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038517607000000002, 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.592 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12168 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947282+0000", 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947284+0000", 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0090000000000002e-06 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947289+0000", 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947301+0000", 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1661999999999999e-05 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982948+0000", 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035647146999999997 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.983078+0000", 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012943199999999999 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985799+0000", 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002721106 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12169 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1441792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.596 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6249698080000003, 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039735563000000002, 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12169 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:09.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947309+0000", 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947318+0000", 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4159999999999993e-06 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947326+0000", 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7989999999999994e-06 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947332+0000", 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3080000000000004e-06 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985831+0000", 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038498917000000001 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985917+0000", 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6178000000000001e-05 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987044+0000", 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011264859999999999 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6249381769999998, 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:16:09.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6249180059999997, 2024-09-21T22:16:09.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6248990599999997, 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.610 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:16:09.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.614 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6248796969999999, 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:16:09.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6248470489999995, 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.619 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:16:09.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6247958819999999, 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.624 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:09.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6247692100000002, 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.628 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:16:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:16:09.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.624744411, 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:16:09.632 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:16:09.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:16:09.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.636 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.624713463, 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6246892449999999, 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.644 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6246648930000003, 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:16:09.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:16:09.648 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6246406499999999, 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.649 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:16:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6246109149999999, 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.653 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:16:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.6245754449999996, 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:16:09.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:16:09.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:09.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:09.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:09.661 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:09.662 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:09.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:09.704 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:09.703+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:09.771 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:09.771+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:09.808 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:09.808 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:09.808 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:09.808 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:09.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:09.901 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:09.900+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:09.962 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T22:16:09.962 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:09.963 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:09.963 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:09.963 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:09.963 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:09.973 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:09.972+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:09.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:09.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:16:09.978 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:16:10.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:10.073+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:10.121 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:10.121 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:10.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:10.121 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:10.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.121 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 17.988384818, 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:16:10.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 17.959324997, 2024-09-21T22:16:10.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:16:10.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:16:10.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:16:10.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.132 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.759111251, 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.133 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:16:10.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:16:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:16:10.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.607872435000001, 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.139 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:16:10.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:10.144 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.2049301319999994, 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:10.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:16:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:16:10.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:16:10.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:16:10.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:10.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:10.151 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.204867277, 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:16:10.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:16:10.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:16:10.157 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15913 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7313778600000003, 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011391615000000001, 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.158 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15913 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.16e-07 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387910+0000", 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8899999999999998e-07 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387914+0000", 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1559999999999999e-06 2024-09-21T22:16:10.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387920+0000", 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399193+0000", 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011272262 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399239+0000", 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149000000000001e-05 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399301+0000", 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2042e-05 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7313632989999999, 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:16:10.162 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:16:10.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:16:10.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7313410449999997, 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.168 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:16:10.170 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7313166310000003, 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.171 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7312871659999995, 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.175 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:16:10.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:16:10.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7312600219999998, 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.180 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:16:10.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7312409200000003, 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7312167680000004, 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:16:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:16:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7311929900000003, 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7311740149999997, 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7311552649999999, 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:16:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7311231820000001, 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:16:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:16:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7311101950000003, 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:16:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:16:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:16:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.7310999459999996, 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.219 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:10.220 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-21T22:16:10.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:10.221 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:10.219+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:10.323 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:10.321+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:10.325 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:10.325 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:10.325 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:10.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:10.388 INFO:teuthology.orchestra.run.smithi134.stdout:1622 read 0xb567d7a thru 0xb56c503 (0x478a bytes) 2024-09-21T22:16:10.388 INFO:teuthology.orchestra.run.smithi134.stdout:1623 write 0xb9105a8 thru 0xb911844 (0x129d bytes) 2024-09-21T22:16:10.393 INFO:teuthology.orchestra.run.smithi134.stdout:1624 punch from 0x2536814 to 0x254119d, (0xa989 bytes) 2024-09-21T22:16:10.410 INFO:teuthology.orchestra.run.smithi134.stdout:1627 trunc from 0xe54e603 to 0x38eb79 2024-09-21T22:16:10.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:10.422+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:10.440 INFO:teuthology.orchestra.run.smithi134.stdout:1628 writesame 0x146b912 thru 0x146d86c data_size 0x1(0x1f5b bytes) 2024-09-21T22:16:10.443 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:10.443 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:10.450 INFO:teuthology.orchestra.run.smithi134.stdout:1629 write 0x3a43e63 thru 0x3a5147f (0xd61d bytes) 2024-09-21T22:16:10.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:10.453 INFO:teuthology.orchestra.run.smithi134.stdout:1630 read 0x1ab92cc thru 0x1abd5a0 (0x42d5 bytes) 2024-09-21T22:16:10.453 INFO:teuthology.orchestra.run.smithi134.stdout:1631 punch from 0xf03029 to 0xf0f529, (0xc500 bytes) 2024-09-21T22:16:10.465 INFO:teuthology.orchestra.run.smithi134.stdout:1633 write 0x9675e99 thru 0x967f122 (0x928a bytes) 2024-09-21T22:16:10.468 INFO:teuthology.orchestra.run.smithi134.stdout:1634 read 0x5857585 thru 0x5864d01 (0xd77d bytes) 2024-09-21T22:16:10.469 INFO:teuthology.orchestra.run.smithi134.stdout:1635 punch from 0x5a7191c to 0x5a79ef0, (0x85d4 bytes) 2024-09-21T22:16:10.477 INFO:teuthology.orchestra.run.smithi134.stdout:1636 writesame 0xb1b2b97 thru 0xb1c02d9 data_size 0x75(0xd743 bytes) 2024-09-21T22:16:10.477 INFO:teuthology.orchestra.run.smithi134.stdout:1637 write 0x402ab86 thru 0x4038bfd (0xe078 bytes) 2024-09-21T22:16:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:1638 trunc from 0xb1c02da to 0xae97e13 2024-09-21T22:16:10.490 INFO:teuthology.orchestra.run.smithi134.stdout:1639 writesame 0xb262e03 thru 0xb271a9f data_size 0x3d(0xec9d bytes) 2024-09-21T22:16:10.490 INFO:teuthology.orchestra.run.smithi134.stdout:1641 write 0xadac793 thru 0xadb6a41 (0xa2af bytes) 2024-09-21T22:16:10.493 INFO:teuthology.orchestra.run.smithi134.stdout:1643 writesame 0x7723c8b thru 0x77270d0 data_size 0x1(0x3446 bytes) 2024-09-21T22:16:10.501 INFO:teuthology.orchestra.run.smithi134.stdout:1645 write 0x5718554 thru 0x571d765 (0x5212 bytes) 2024-09-21T22:16:10.502 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.503 INFO:teuthology.orchestra.run.smithi134.stdout:1647 write 0x423ce34 thru 0x423ce4c (0x19 bytes) 2024-09-21T22:16:10.504 INFO:teuthology.orchestra.run.smithi134.stdout:1648 punch from 0x393e451 to 0x3945c9e, (0x784d bytes) 2024-09-21T22:16:10.504 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.504 INFO:teuthology.orchestra.run.smithi134.stdout:1651 write 0x11cf5b0 thru 0x11d4a7d (0x54ce bytes) 2024-09-21T22:16:10.505 INFO:teuthology.orchestra.run.smithi134.stdout:1653 read 0xa050a13 thru 0xa05f262 (0xe850 bytes) 2024-09-21T22:16:10.505 INFO:teuthology.orchestra.run.smithi134.stdout:1654 read 0x4ab7f84 thru 0x4abdf90 (0x600d bytes) 2024-09-21T22:16:10.506 INFO:teuthology.orchestra.run.smithi134.stdout:1655 read 0xb1b176d thru 0xb1b74cb (0x5d5f bytes) 2024-09-21T22:16:10.506 INFO:teuthology.orchestra.run.smithi134.stdout:1658 write 0x2edba58 thru 0x2ee0e3b (0x53e4 bytes) 2024-09-21T22:16:10.511 INFO:teuthology.orchestra.run.smithi134.stdout:1659 trunc from 0xb271aa0 to 0x85b23a6 2024-09-21T22:16:10.524 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:10.523+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:10.529 INFO:teuthology.orchestra.run.smithi134.stdout:1660 writesame 0xb133b0e thru 0xb135b2b data_size 0x1(0x201e bytes) 2024-09-21T22:16:10.529 INFO:teuthology.orchestra.run.smithi134.stdout:1661 write 0x434f010 thru 0x43554a3 (0x6494 bytes) 2024-09-21T22:16:10.530 INFO:teuthology.orchestra.run.smithi134.stdout:1662 write 0x7c7e98e thru 0x7c8289b (0x3f0e bytes) 2024-09-21T22:16:10.542 INFO:teuthology.orchestra.run.smithi134.stdout:1663 write 0xc3b1492 thru 0xc3b60b3 (0x4c22 bytes) 2024-09-21T22:16:10.544 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.544 INFO:teuthology.orchestra.run.smithi134.stdout:1668 read 0x697b64 thru 0x6a20b0 (0xa54d bytes) 2024-09-21T22:16:10.545 INFO:teuthology.orchestra.run.smithi134.stdout:1669 read 0x5f4c545 thru 0x5f56c8b (0xa747 bytes) 2024-09-21T22:16:10.545 INFO:teuthology.orchestra.run.smithi134.stdout:1670 punch from 0x6fdee63 to 0x6fe13b2, (0x254f bytes) 2024-09-21T22:16:10.545 INFO:teuthology.orchestra.run.smithi134.stdout:1672 write 0x303df4c thru 0x3045501 (0x75b6 bytes) 2024-09-21T22:16:10.549 INFO:teuthology.orchestra.run.smithi134.stdout:1673 trunc from 0xc3b60b4 to 0xd5a4e83 2024-09-21T22:16:10.555 INFO:teuthology.orchestra.run.smithi134.stdout:1675 read 0x1e3b7d2 thru 0x1e3e48e (0x2cbd bytes) 2024-09-21T22:16:10.556 INFO:teuthology.orchestra.run.smithi134.stdout:1676 punch from 0x330c4c to 0x3356d3, (0x4a87 bytes) 2024-09-21T22:16:10.556 INFO:teuthology.orchestra.run.smithi134.stdout:1678 read 0xcd601d6 thru 0xcd69e0d (0x9c38 bytes) 2024-09-21T22:16:10.556 INFO:teuthology.orchestra.run.smithi134.stdout:1679 trunc from 0xd5a4e83 to 0xd36a761 2024-09-21T22:16:10.562 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.562 INFO:teuthology.orchestra.run.smithi134.stdout:1681 write 0xd30999e thru 0xd318b29 (0xf18c bytes) 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi134.stdout:1684 read 0x53035a9 thru 0x5309713 (0x616b bytes) 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi134.stdout:1685 punch from 0x5bb3068 to 0x5bb7e3c, (0x4dd4 bytes) 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi134.stdout:1686 writesame 0xae57d34 thru 0xae6687c data_size 0x1f(0xeb49 bytes) 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1018 3.15 3:ae013215:::rbd_data.1185ff358907.0000000000000002:head [write 0~1016375 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.056826652000002, 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019909570000000001, 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1018 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0399999999999996e-07 2024-09-21T22:16:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509915+0000", 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018678049999999999 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509926+0000", 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0729e-05 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509937+0000", 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1447999999999999e-05 2024-09-21T22:16:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522027+0000", 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012089379000000001 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522161+0000", 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134525 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527828+0000", 2024-09-21T22:16:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056671430000000004 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527880+0000", 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1329000000000003e-05 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527956+0000", 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6607999999999996e-05 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1139 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.038964941, 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017975142999999999, 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1139 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525911+0000", 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525917+0000", 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8599999999999998e-06 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525921+0000", 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540743+0000", 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014821166 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540833+0000", 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0853000000000006e-05 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543884+0000", 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030503219999999998 2024-09-21T22:16:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12418 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997085+0000", 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5677883719999999, 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017384954000000001, 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.577 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12418 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997085+0000", 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997085+0000", 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997086+0000", 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997088+0000", 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1560000000000002e-06 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997093+0000", 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8940000000000001e-06 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997095+0000", 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7669999999999999e-06 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014188+0000", 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017092294000000001 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014233+0000", 2024-09-21T22:16:10.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5151999999999997e-05 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014470+0000", 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023725100000000001 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12419 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2375680~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5677746809999995, 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017663772000000001, 2024-09-21T22:16:10.581 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12419 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997100+0000", 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.238e-06 2024-09-21T22:16:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997103+0000", 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0089999999999999e-06 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997106+0000", 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4789999999999999e-06 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014499+0000", 2024-09-21T22:16:10.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017392764000000002 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014543+0000", 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4947000000000002e-05 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014763+0000", 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000219127 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12420 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2457600~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5677646740000002, 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017934450000000001, 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12420 2024-09-21T22:16:10.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997110+0000", 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0389999999999999e-06 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997113+0000", 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1250000000000001e-06 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997116+0000", 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.481e-06 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014801+0000", 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017685482999999998 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014850+0000", 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9107999999999998e-05 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015043+0000", 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000192991 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12421 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2539520~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.567754936, 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018190212000000001, 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12421 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997120+0000", 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0160000000000001e-06 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997124+0000", 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0300000000000004e-06 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997128+0000", 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8689999999999997e-06 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015060+0000", 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017932303 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015104+0000", 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3766000000000001e-05 2024-09-21T22:16:10.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015309+0000", 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00020502399999999999 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12440 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2686976~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5677189069999997, 2024-09-21T22:16:10.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562981999999999, 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12440 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997157+0000", 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7600000000000001e-06 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997161+0000", 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6630000000000001e-06 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997165+0000", 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3270000000000001e-06 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015348+0000", 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018183263000000002 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015444+0000", 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5798999999999995e-05 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015718+0000", 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027377 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.598 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12441 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2768896~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.567703721, 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018855137000000001, 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12441 2024-09-21T22:16:10.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:10.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0600000000000001e-07 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997172+0000", 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.708e-06 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997177+0000", 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4729999999999999e-06 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997180+0000", 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015743+0000", 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562498 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015791+0000", 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8294000000000002e-05 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016025+0000", 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000234109 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12442 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2850816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5676899290000001, 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019142308, 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.603 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12442 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997185+0000", 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.195e-06 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997188+0000", 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2600000000000001e-06 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997192+0000", 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.968e-06 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016060+0000", 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018867816999999999 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016112+0000", 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1518999999999999e-05 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016326+0000", 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00021432800000000001 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12450 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2621440~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:10.607 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5676119249999996, 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019490774999999998, 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12450 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2799999999999995e-07 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997266+0000", 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4429999999999999e-06 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997275+0000", 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5750000000000007e-06 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997281+0000", 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.003e-06 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016367+0000", 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019085536 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016467+0000", 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9747000000000006e-05 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016752+0000", 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028574299999999998 2024-09-21T22:16:10.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12451 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.567582324, 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019832520999999999, 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.612 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12451 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997292+0000", 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.13e-07 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997294+0000", 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2740000000000002e-06 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997307+0000", 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3281e-05 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997313+0000", 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9909999999999999e-06 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016783+0000", 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019469455 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016832+0000", 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9261999999999997e-05 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017124+0000", 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00029164499999999999 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12452 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5675525510000003, 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020179939000000001, 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12452 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:10.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.63e-07 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997324+0000", 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2819999999999999e-06 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997335+0000", 2024-09-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1497e-05 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997341+0000", 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5740000000000003e-06 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017162+0000", 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019821709 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017214+0000", 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1542000000000002e-05 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017501+0000", 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028687199999999997 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12453 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5675250519999997, 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020570432, 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12453 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:10.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997349+0000", 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997351+0000", 2024-09-21T22:16:10.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0650000000000001e-06 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997357+0000", 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3010000000000003e-06 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997366+0000", 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3979999999999999e-06 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017547+0000", 2024-09-21T22:16:10.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020181706000000001 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017640+0000", 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2868000000000006e-05 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017919+0000", 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027868400000000002 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12461 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5674971370000002, 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020883003000000001, 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12461 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997377+0000", 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9699999999999996e-07 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997379+0000", 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997386+0000", 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9190000000000002e-06 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997391+0000", 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7230000000000004e-06 2024-09-21T22:16:10.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017963+0000", 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020572277 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018055+0000", 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1842000000000006e-05 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018259+0000", 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000204386 2024-09-21T22:16:10.628 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12462 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5674758869999996, 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021171724999999999, 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.629 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12462 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8900000000000001e-07 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997399+0000", 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.432e-06 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997404+0000", 2024-09-21T22:16:10.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8740000000000003e-06 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997407+0000", 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8040000000000002e-06 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018290+0000", 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020882670999999998 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018347+0000", 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6972000000000003e-05 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018569+0000", 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000222683 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12463 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5674631960000003, 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02155197, 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.633 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12463 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997411+0000", 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997412+0000", 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.127e-06 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997415+0000", 2024-09-21T22:16:10.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.174e-06 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997417+0000", 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018613+0000", 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021195611999999999 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018698+0000", 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5158e-05 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018962+0000", 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000264071 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12473 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2654208~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5669961910000003, 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02139957, 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.637 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12473 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997878+0000", 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997882+0000", 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.048e-06 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997894+0000", 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1839e-05 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997905+0000", 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1015e-05 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018998+0000", 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02109248 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019046+0000", 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8093000000000002e-05 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019277+0000", 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023115200000000001 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.641 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12474 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2736128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5669500549999995, 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021670372, 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12474 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997924+0000", 2024-09-21T22:16:10.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6499999999999999e-07 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997927+0000", 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.644e-06 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997935+0000", 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.49e-06 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997940+0000", 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0860000000000001e-06 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019314+0000", 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021373601999999998 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019360+0000", 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6260000000000001e-05 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019594+0000", 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000233725 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12475 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2818048~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5669244979999997, 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022017721000000001, 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.646 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12475 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997951+0000", 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997959+0000", 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2620000000000001e-06 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019633+0000", 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021669000000000001 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019700+0000", 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7769999999999997e-05 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019967+0000", 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000266223 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12481 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:10.650 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.5636934279999997, 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018906626999999999, 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12481 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:10.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001181+0000", 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1999999999999998e-07 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:10.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001185+0000", 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1570000000000002e-06 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001195+0000", 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0121e-05 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001202+0000", 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.041e-06 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:10.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019994+0000", 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018791233000000001 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020036+0000", 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2567000000000001e-05 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020087+0000", 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0587999999999997e-05 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.654 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.655 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:10.655 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:10.655 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:10.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:10.657 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:10.655+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1687 writesame 0xed6e08f thru 0xed6f21e data_size 0x8(0x1190 bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1688 punch from 0x9400658 to 0x94026ed, (0x2095 bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1690 punch from 0xb42dcd3 to 0xb43b25f, (0xd58c bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1691 write 0x9d2fde4 thru 0x9d35bbf (0x5ddc bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1693 punch from 0x24fdf83 to 0x24ffd52, (0x1dcf bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1696 read 0x6bc24a8 thru 0x6bcc49f (0x9ff8 bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1697 read 0x3f4f13c thru 0x3f54d02 (0x5bc7 bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1698 write 0x3243ece thru 0x324c811 (0x8944 bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1699 punch from 0x2455303 to 0x2462c7a, (0xd977 bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1700 trunc from 0xed6f21f to 0x3b7436d 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1702 read 0x17dc1 thru 0x26b87 (0xedc7 bytes) 2024-09-21T22:16:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:1703 trunc from 0x3b7436d to 0xd90e5c8 2024-09-21T22:16:10.660 INFO:teuthology.orchestra.run.smithi134.stdout:1704 write 0xebc108d thru 0xebc199d (0x911 bytes) 2024-09-21T22:16:10.660 INFO:teuthology.orchestra.run.smithi134.stdout:1705 write 0xc9e3725 thru 0xc9f035b (0xcc37 bytes) 2024-09-21T22:16:10.660 INFO:teuthology.orchestra.run.smithi134.stdout:1707 trunc from 0xebc199e to 0xba8e88b 2024-09-21T22:16:10.660 INFO:teuthology.orchestra.run.smithi134.stdout:1709 punch from 0x6e8762 to 0x6f3adb, (0xb379 bytes) 2024-09-21T22:16:10.660 INFO:teuthology.orchestra.run.smithi134.stdout:1710 read 0x360e2df thru 0x361964e (0xb370 bytes) 2024-09-21T22:16:10.664 INFO:teuthology.orchestra.run.smithi134.stdout:1711 writesame 0xe925cbd thru 0xe92c09a data_size 0x3(0x63de bytes) 2024-09-21T22:16:10.664 INFO:teuthology.orchestra.run.smithi134.stdout:1712 write 0x34c78b3 thru 0x34d17be (0x9f0c bytes) 2024-09-21T22:16:10.665 INFO:teuthology.orchestra.run.smithi134.stdout:1713 read 0x1d88f54 thru 0x1d947c3 (0xb870 bytes) 2024-09-21T22:16:10.666 INFO:teuthology.orchestra.run.smithi134.stdout:1714 write 0xcbfe901 thru 0xcc0e174 (0xf874 bytes) 2024-09-21T22:16:10.669 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.669 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.670 INFO:teuthology.orchestra.run.smithi134.stdout:1717 writesame 0x1a5bd23 thru 0x1a5eeb5 data_size 0x7(0x3193 bytes) 2024-09-21T22:16:10.671 INFO:teuthology.orchestra.run.smithi134.stdout:1721 punch from 0x7a30e69 to 0x7a3e63f, (0xd7d6 bytes) 2024-09-21T22:16:10.671 INFO:teuthology.orchestra.run.smithi134.stdout:1722 read 0x7c22cb0 thru 0x7c2a565 (0x78b6 bytes) 2024-09-21T22:16:10.671 INFO:teuthology.orchestra.run.smithi134.stdout:1723 read 0x103b8e7 thru 0x1044a7c (0x9196 bytes) 2024-09-21T22:16:10.672 INFO:teuthology.orchestra.run.smithi134.stdout:1728 write 0x9f79c5e thru 0x9f84156 (0xa4f9 bytes) 2024-09-21T22:16:10.676 INFO:teuthology.orchestra.run.smithi134.stdout:1730 write 0x932e5c4 thru 0x933d974 (0xf3b1 bytes) 2024-09-21T22:16:10.677 INFO:teuthology.orchestra.run.smithi134.stdout:1733 writesame 0xd30e8a9 thru 0xd30ed02 data_size 0x1(0x45a bytes) 2024-09-21T22:16:10.680 INFO:teuthology.orchestra.run.smithi134.stdout:1734 write 0x2fb77ae thru 0x2fbc65d (0x4eb0 bytes) 2024-09-21T22:16:10.681 INFO:teuthology.orchestra.run.smithi134.stdout:1735 read 0x6ec377a thru 0x6eccfda (0x9861 bytes) 2024-09-21T22:16:10.681 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.682 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.682 INFO:teuthology.orchestra.run.smithi134.stdout:1738 write 0x1a85c4c thru 0x1a9233e (0xc6f3 bytes) 2024-09-21T22:16:10.683 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.687 INFO:teuthology.orchestra.run.smithi134.stdout:1741 trunc from 0xe92c09b to 0xb24a68f 2024-09-21T22:16:10.700 INFO:teuthology.orchestra.run.smithi134.stdout:1742 write 0x9b83460 thru 0x9b84923 (0x14c4 bytes) 2024-09-21T22:16:10.703 INFO:teuthology.orchestra.run.smithi134.stdout:1743 writesame 0x3b5cbf4 thru 0x3b5d0e7 data_size 0x1(0x4f4 bytes) 2024-09-21T22:16:10.706 INFO:teuthology.orchestra.run.smithi134.stdout:1744 trunc from 0xb24a68f to 0xbc29a7b 2024-09-21T22:16:10.711 INFO:teuthology.orchestra.run.smithi134.stdout:1745 write 0x9ac3941 thru 0x9aca6b5 (0x6d75 bytes) 2024-09-21T22:16:10.712 INFO:teuthology.orchestra.run.smithi134.stdout:1747 read 0x8aab83b thru 0x8aaf20c (0x39d2 bytes) 2024-09-21T22:16:10.712 INFO:teuthology.orchestra.run.smithi134.stdout:1749 punch from 0x241f70 to 0x24fcef, (0xdd7f bytes) 2024-09-21T22:16:10.712 INFO:teuthology.orchestra.run.smithi134.stdout:1750 writesame 0x62ae788 thru 0x62bbcfc data_size 0x5(0xd575 bytes) 2024-09-21T22:16:10.720 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.720 INFO:teuthology.orchestra.run.smithi134.stdout:1752 writesame 0x9ef6e4 thru 0x9fdc1d data_size 0x4a(0xe53a bytes) 2024-09-21T22:16:10.721 INFO:teuthology.orchestra.run.smithi134.stdout:1753 punch from 0x7b743a2 to 0x7b83a14, (0xf672 bytes) 2024-09-21T22:16:10.721 INFO:teuthology.orchestra.run.smithi134.stdout:1755 punch from 0x1014f39 to 0x1020571, (0xb638 bytes) 2024-09-21T22:16:10.722 INFO:teuthology.orchestra.run.smithi134.stdout:1756 write 0x5005e28 thru 0x50122af (0xc488 bytes) 2024-09-21T22:16:10.723 INFO:teuthology.orchestra.run.smithi134.stdout:1757 read 0x103068f thru 0x10311d1 (0xb43 bytes) 2024-09-21T22:16:10.724 INFO:teuthology.orchestra.run.smithi134.stdout:1758 trunc from 0xbc29a7b to 0xc83aaee 2024-09-21T22:16:10.730 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.730 INFO:teuthology.orchestra.run.smithi134.stdout:1760 write 0x8673a55 thru 0x8680a5c (0xd008 bytes) 2024-09-21T22:16:10.735 INFO:teuthology.orchestra.run.smithi134.stdout:1761 read 0x508537e thru 0x50877b7 (0x243a bytes) 2024-09-21T22:16:10.735 INFO:teuthology.orchestra.run.smithi134.stdout:1762 write 0x974150b thru 0x9749eff (0x89f5 bytes) 2024-09-21T22:16:10.736 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.736 INFO:teuthology.orchestra.run.smithi134.stdout:1765 read 0x1d60fe7 thru 0x1d6760f (0x6629 bytes) 2024-09-21T22:16:10.736 INFO:teuthology.orchestra.run.smithi134.stdout:1767 write 0x3b0c52b thru 0x3b13fc9 (0x7a9f bytes) 2024-09-21T22:16:10.738 INFO:teuthology.orchestra.run.smithi134.stdout:1768 punch from 0xb90381f to 0xb9127e3, (0xefc4 bytes) 2024-09-21T22:16:10.738 INFO:teuthology.orchestra.run.smithi134.stdout:1769 write 0x8e9542e thru 0x8ea054a (0xb11d bytes) 2024-09-21T22:16:10.749 INFO:teuthology.orchestra.run.smithi134.stdout:1770 trunc from 0xc83aaee to 0x40075c5 2024-09-21T22:16:10.757 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:10.756+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:10.766 INFO:teuthology.orchestra.run.smithi134.stdout:1771 read 0x183486e thru 0x183625c (0x19ef bytes) 2024-09-21T22:16:10.766 INFO:teuthology.orchestra.run.smithi134.stdout:1772 read 0x3a4b53 thru 0x3b03a3 (0xb851 bytes) 2024-09-21T22:16:10.766 INFO:teuthology.orchestra.run.smithi134.stdout:1773 punch from 0x153dd1c to 0x15477c4, (0x9aa8 bytes) 2024-09-21T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stdout:1776 writesame 0xa0b42ad thru 0xa0b7cf4 data_size 0x14(0x3a48 bytes) 2024-09-21T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.781 INFO:teuthology.orchestra.run.smithi134.stdout:1778 read 0x683a94b thru 0x68448c9 (0x9f7f bytes) 2024-09-21T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:10.785 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:10.787 INFO:teuthology.orchestra.run.smithi134.stdout:1779 write 0xb1535d7 thru 0xb16356c (0xff96 bytes) 2024-09-21T22:16:10.791 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:10.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:10.800 INFO:teuthology.orchestra.run.smithi134.stdout:1781 trunc from 0xb16356d to 0x42803fd 2024-09-21T22:16:10.827 INFO:teuthology.orchestra.run.smithi134.stdout:1782 write 0xb34c14c thru 0xb355091 (0x8f46 bytes) 2024-09-21T22:16:10.831 INFO:teuthology.orchestra.run.smithi134.stdout:1783 writesame 0x9450419 thru 0x94541c7 data_size 0x1(0x3daf bytes) 2024-09-21T22:16:10.840 INFO:teuthology.orchestra.run.smithi134.stdout:1784 write 0x782c78f thru 0x782d610 (0xe82 bytes) 2024-09-21T22:16:10.843 INFO:teuthology.orchestra.run.smithi134.stdout:1785 read 0x5d7daee thru 0x5d84983 (0x6e96 bytes) 2024-09-21T22:16:10.844 INFO:teuthology.orchestra.run.smithi134.stdout:1786 read 0x1b6e1c3 thru 0x1b77b56 (0x9994 bytes) 2024-09-21T22:16:10.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:10.856+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:1787 trunc from 0xb355092 to 0xf79c14 2024-09-21T22:16:10.881 INFO:teuthology.orchestra.run.smithi134.stdout:1790 write 0x34ef17a thru 0x34f7d3d (0x8bc4 bytes) 2024-09-21T22:16:10.882 INFO:teuthology.orchestra.run.smithi134.stdout:1791 punch from 0x21da8d8 to 0x21dc569, (0x1c91 bytes) 2024-09-21T22:16:10.882 INFO:teuthology.orchestra.run.smithi134.stdout:1792 read 0x1323f68 thru 0x13278a2 (0x393b bytes) 2024-09-21T22:16:10.883 INFO:teuthology.orchestra.run.smithi134.stdout:1793 read 0x8ef4e8 thru 0x8fa62a (0xb143 bytes) 2024-09-21T22:16:10.884 INFO:teuthology.orchestra.run.smithi134.stdout:1794 trunc from 0x34f7d3e to 0x3ecb02b 2024-09-21T22:16:10.889 INFO:teuthology.orchestra.run.smithi134.stdout:1795 clone 8 order 24 su 131072 sc 7 2024-09-21T22:16:10.923 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:10.923 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:10.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:10.966 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:16:10.967 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:10.965+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:16:10.984 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:16:10.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:16:11.060 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:11.059+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:11.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.16577346, 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:11.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:11.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.163151386999999, 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14146 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8777177609999995, 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015254134000000001, 2024-09-21T22:16:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14146 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198242+0000", 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8980000000000001e-06 2024-09-21T22:16:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198248+0000", 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6060000000000002e-06 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198252+0000", 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1389999999999997e-06 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213293+0000", 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015041077 2024-09-21T22:16:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213380+0000", 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6990999999999994e-05 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213494+0000", 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114071 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14147 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1867776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8777003260000003, 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015400951, 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14147 2024-09-21T22:16:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198260+0000", 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.576e-06 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198266+0000", 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198270+0000", 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.42e-06 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213525+0000", 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015254304 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213593+0000", 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8192e-05 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213658+0000", 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-05 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14148 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1949696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8776807120000001, 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015536743, 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14148 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198279+0000", 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198285+0000", 2024-09-21T22:16:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198290+0000", 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5759999999999999e-06 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213689+0000", 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015398719999999999 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213735+0000", 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6873999999999999e-05 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213813+0000", 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8047999999999995e-05 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14149 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2031616~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8776622920000001, 2024-09-21T22:16:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015749758999999999, 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14149 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198297+0000", 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198303+0000", 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198317+0000", 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-05 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213846+0000", 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015529685 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213929+0000", 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2341000000000003e-05 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214045+0000", 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116208 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.877633587, 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8776146929999999, 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8775915789999997, 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8769173920000002, 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14284 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3670016~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.856525381, 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015138125000000001, 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14284 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219434+0000", 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3769999999999999e-06 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219437+0000", 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.507e-06 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219440+0000", 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234370+0000", 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014930399 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234449+0000", 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8738000000000004e-05 2024-09-21T22:16:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234570+0000", 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121018 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14285 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3751936~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8565139180000001, 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015470901, 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14285 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219444+0000", 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3099999999999999e-07 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219445+0000", 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1349999999999999e-06 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219449+0000", 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9360000000000001e-06 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219453+0000", 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1629999999999998e-06 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234705+0000", 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015251740999999999 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234797+0000", 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2108000000000006e-05 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234914+0000", 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117587 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14286 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3833856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8564987820000001, 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015717103999999999, 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14286 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219461+0000", 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219467+0000", 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219471+0000", 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2640000000000002e-06 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234983+0000", 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015511680999999999 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235069+0000", 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5778000000000004e-05 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235176+0000", 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107092 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14287 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8564823969999997, 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015894090999999999, 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14287 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6800000000000002e-07 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219477+0000", 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.362e-06 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219480+0000", 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1700000000000001e-06 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219482+0000", 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.475e-06 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235247+0000", 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015765000000000001 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235298+0000", 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0577e-05 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235369+0000", 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1239e-05 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.856472138, 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8564570289999995, 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8564387350000002, 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8557819999999996, 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:15945 3.1e 3:7b0bb837:::rbd_data.11854f79dd7.000000000000001c:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.385532+0000", 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.6904249670000002, 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015061524999999999, 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 15945 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385532+0000", 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385532+0000", 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385533+0000", 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385534+0000", 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-06 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385537+0000", 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0690000000000002e-06 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385539+0000", 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4490000000000002e-06 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400369+0000", 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014829614 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400474+0000", 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104628 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400594+0000", 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120405 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:15946 3.1e 3:7b0bb837:::rbd_data.11854f79dd7.000000000000001c:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.6904153090000005, 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015259356999999999, 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 15946 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385543+0000", 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0330000000000001e-06 2024-09-21T22:16:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385546+0000", 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9670000000000001e-06 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385549+0000", 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5239999999999999e-06 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400633+0000", 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015084505 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400695+0000", 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1203000000000003e-05 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400801+0000", 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010691700000000001 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.163 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:11.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:11.165 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:11.164+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:11.265 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:11.265+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:11.271 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:11.271 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:11.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:11.314 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:11.315 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:16:11.327 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-21T22:16:11.180797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":366584445,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":24558,"num_read_kb":271227,"num_write":7123,"num_write_kb":243125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":19591155,"num_keys_recovered":32,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3939,"ondisk_log_size":3939,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":384968,"kb_used_data":130204,"kb_used_omap":15,"kb_used_meta":254576,"kb_avail":754589752,"statfs":{"total":773094113280,"available":772699906048,"internally_reserved":0,"allocated":133328896,"data_stored":129647270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":260686620},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124101785,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":8731,"num_read_kb":81894,"num_write":2177,"num_write_kb":62777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000785"},"pg_stats":[{"pgid":"3.1f","version":"54'265","reported_seq":880,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.126416+0000","last_change":"2024-09-21T22:16:05.938048+0000","last_active":"2024-09-21T22:16:09.126416+0000","last_peered":"2024-09-21T22:16:09.126416+0000","last_clean":"2024-09-21T22:16:09.126416+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:16:09.126416+0000","last_undegraded":"2024-09-21T22:16:09.126416+0000","last_fullsized":"2024-09-21T22:16:09.126416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:57.956255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012868389999999999,"stat_sum":{"num_bytes":16854714,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1502,"num_read_kb":9463,"num_write":532,"num_write_kb":10363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1e","version":"52'182","reported_seq":1448,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954342+0000","last_change":"2024-09-21T22:16:05.937873+0000","last_active":"2024-09-21T22:16:07.954342+0000","last_peered":"2024-09-21T22:16:07.954342+0000","last_clean":"2024-09-21T22:16:07.954342+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:16:07.954342+0000","last_undegraded":"2024-09-21T22:16:07.954342+0000","last_fullsized":"2024-09-21T22:16:07.954342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:50:47.369623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019603260000000001,"stat_sum":{"num_bytes":11037222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2204,"num_read_kb":12164,"num_write":215,"num_write_kb":5784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1d","version":"54'120","reported_seq":1270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.100696+0000","last_change":"2024-09-21T22:16:06.079518+0000","last_active":"2024-09-21T22:16:09.100696+0000","last_peered":"2024-09-21T22:16:09.100696+0000","last_clean":"2024-09-21T22:16:09.100696+0000","last_became_active":"2024-09-21T22:15:36.449655+0000","last_became_peered":"2024-09-21T22:15:36.449655+0000","last_unstale":"2024-09-21T22:16:09.100696+0000","last_undegraded":"2024-09-21T22:16:09.100696+0000","last_fullsized":"2024-09-21T22:16:09.100696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:17.835269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063684899999999999,"stat_sum":{"num_bytes":28843172,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1368,"num_read_kb":22593,"num_write":245,"num_write_kb":13820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1c","version":"53'90","reported_seq":559,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.219399+0000","last_change":"2024-09-21T22:16:06.079178+0000","last_active":"2024-09-21T22:16:09.219399+0000","last_peered":"2024-09-21T22:16:09.219399+0000","last_clean":"2024-09-21T22:16:09.219399+0000","last_became_active":"2024-09-21T22:15:36.449203+0000","last_became_peered":"2024-09-21T22:15:36.449203+0000","last_unstale":"2024-09-21T22:16:09.219399+0000","last_undegraded":"2024-09-21T22:16:09.219399+0000","last_fullsized":"2024-09-21T22:16:09.219399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:45:16.234698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041167100000000001,"stat_sum":{"num_bytes":6457402,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":368,"num_read_kb":6576,"num_write":197,"num_write_kb":11471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1b","version":"52'86","reported_seq":428,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.125235+0000","last_change":"2024-09-21T22:16:05.936945+0000","last_active":"2024-09-21T22:16:09.125235+0000","last_peered":"2024-09-21T22:16:09.125235+0000","last_clean":"2024-09-21T22:16:09.125235+0000","last_became_active":"2024-09-21T22:15:36.451889+0000","last_became_peered":"2024-09-21T22:15:36.451889+0000","last_unstale":"2024-09-21T22:16:09.125235+0000","last_undegraded":"2024-09-21T22:16:09.125235+0000","last_fullsized":"2024-09-21T22:16:09.125235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:05:19.624413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076333100000000001,"stat_sum":{"num_bytes":5229636,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":7166,"num_write":179,"num_write_kb":6745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1a","version":"54'39","reported_seq":517,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.286704+0000","last_change":"2024-09-21T22:16:05.935905+0000","last_active":"2024-09-21T22:16:09.286704+0000","last_peered":"2024-09-21T22:16:09.286704+0000","last_clean":"2024-09-21T22:16:09.286704+0000","last_became_active":"2024-09-21T22:15:36.445163+0000","last_became_peered":"2024-09-21T22:15:36.445163+0000","last_unstale":"2024-09-21T22:16:09.286704+0000","last_undegraded":"2024-09-21T22:16:09.286704+0000","last_fullsized":"2024-09-21T22:16:09.286704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:03:30.213441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037813899999999999,"stat_sum":{"num_bytes":7198808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":359,"num_read_kb":754,"num_write":75,"num_write_kb":4330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.19","version":"54'171","reported_seq":1126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.966497+0000","last_change":"2024-09-21T22:16:06.090252+0000","last_active":"2024-09-21T22:16:08.966497+0000","last_peered":"2024-09-21T22:16:08.966497+0000","last_clean":"2024-09-21T22:16:08.966497+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:16:08.966497+0000","last_undegraded":"2024-09-21T22:16:08.966497+0000","last_fullsized":"2024-09-21T22:16:08.966497+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:38:42.236273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079234699999999999,"stat_sum":{"num_bytes":16121856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1841,"num_read_kb":8398,"num_write":258,"num_write_kb":6934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.18","version":"52'101","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954069+0000","last_change":"2024-09-21T22:16:05.937467+0000","last_active":"2024-09-21T22:16:07.954069+0000","last_peered":"2024-09-21T22:16:07.954069+0000","last_clean":"2024-09-21T22:16:07.954069+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:16:07.954069+0000","last_undegraded":"2024-09-21T22:16:07.954069+0000","last_fullsized":"2024-09-21T22:16:07.954069+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:45:41.985671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018198000000000001,"stat_sum":{"num_bytes":3006478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":258,"num_read_kb":2805,"num_write":211,"num_write_kb":6227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.17","version":"52'90","reported_seq":900,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.120452+0000","last_change":"2024-09-21T22:16:05.937447+0000","last_active":"2024-09-21T22:16:09.120452+0000","last_peered":"2024-09-21T22:16:09.120452+0000","last_clean":"2024-09-21T22:16:09.120452+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:16:09.120452+0000","last_undegraded":"2024-09-21T22:16:09.120452+0000","last_fullsized":"2024-09-21T22:16:09.120452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:53:30.733752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000791996,"stat_sum":{"num_bytes":7024128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1040,"num_read_kb":6920,"num_write":189,"num_write_kb":9347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.16","version":"54'69","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.099860+0000","last_change":"2024-09-21T22:16:06.079452+0000","last_active":"2024-09-21T22:16:09.099860+0000","last_peered":"2024-09-21T22:16:09.099860+0000","last_clean":"2024-09-21T22:16:09.099860+0000","last_became_active":"2024-09-21T22:15:36.451714+0000","last_became_peered":"2024-09-21T22:15:36.451714+0000","last_unstale":"2024-09-21T22:16:09.099860+0000","last_undegraded":"2024-09-21T22:16:09.099860+0000","last_fullsized":"2024-09-21T22:16:09.099860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:09.674705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000640768,"stat_sum":{"num_bytes":19451605,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":11081,"num_write":148,"num_write_kb":4964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.15","version":"54'178","reported_seq":858,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.086076+0000","last_change":"2024-09-21T22:16:05.943656+0000","last_active":"2024-09-21T22:16:09.086076+0000","last_peered":"2024-09-21T22:16:09.086076+0000","last_clean":"2024-09-21T22:16:09.086076+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:16:09.086076+0000","last_undegraded":"2024-09-21T22:16:09.086076+0000","last_fullsized":"2024-09-21T22:16:09.086076+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:56.165188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086763499999999996,"stat_sum":{"num_bytes":20405501,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1079,"num_read_kb":16324,"num_write":345,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.14","version":"54'84","reported_seq":568,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.220445+0000","last_change":"2024-09-21T22:16:05.936184+0000","last_active":"2024-09-21T22:16:09.220445+0000","last_peered":"2024-09-21T22:16:09.220445+0000","last_clean":"2024-09-21T22:16:09.220445+0000","last_became_active":"2024-09-21T22:15:36.448788+0000","last_became_peered":"2024-09-21T22:15:36.448788+0000","last_unstale":"2024-09-21T22:16:09.220445+0000","last_undegraded":"2024-09-21T22:16:09.220445+0000","last_fullsized":"2024-09-21T22:16:09.220445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:19:49.183337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049629600000000002,"stat_sum":{"num_bytes":12682163,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":370,"num_read_kb":6230,"num_write":157,"num_write_kb":7191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.958293+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:16:08.958293+0000","last_peered":"2024-09-21T22:16:08.958293+0000","last_clean":"2024-09-21T22:16:08.958293+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:16:08.958293+0000","last_undegraded":"2024-09-21T22:16:08.958293+0000","last_fullsized":"2024-09-21T22:16:08.958293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"54'59","reported_seq":568,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.223947+0000","last_change":"2024-09-21T22:16:05.937306+0000","last_active":"2024-09-21T22:16:09.223947+0000","last_peered":"2024-09-21T22:16:09.223947+0000","last_clean":"2024-09-21T22:16:09.223947+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:16:09.223947+0000","last_undegraded":"2024-09-21T22:16:09.223947+0000","last_fullsized":"2024-09-21T22:16:09.223947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:17.580410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070147999999999999,"stat_sum":{"num_bytes":20971633,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":390,"num_read_kb":13727,"num_write":138,"num_write_kb":10437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.966515+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:16:08.966515+0000","last_peered":"2024-09-21T22:16:08.966515+0000","last_clean":"2024-09-21T22:16:08.966515+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:16:08.966515+0000","last_undegraded":"2024-09-21T22:16:08.966515+0000","last_fullsized":"2024-09-21T22:16:08.966515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'56","reported_seq":558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954254+0000","last_change":"2024-09-21T22:16:05.937400+0000","last_active":"2024-09-21T22:16:07.954254+0000","last_peered":"2024-09-21T22:16:07.954254+0000","last_clean":"2024-09-21T22:16:07.954254+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:16:07.954254+0000","last_undegraded":"2024-09-21T22:16:07.954254+0000","last_fullsized":"2024-09-21T22:16:07.954254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:22:33.278586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001750913,"stat_sum":{"num_bytes":7113715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":7755,"num_write":114,"num_write_kb":4633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.962024+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:16:08.962024+0000","last_peered":"2024-09-21T22:16:08.962024+0000","last_clean":"2024-09-21T22:16:08.962024+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:16:08.962024+0000","last_undegraded":"2024-09-21T22:16:08.962024+0000","last_fullsized":"2024-09-21T22:16:08.962024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"53'74","reported_seq":608,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.104518+0000","last_change":"2024-09-21T22:16:06.090287+0000","last_active":"2024-09-21T22:16:09.104518+0000","last_peered":"2024-09-21T22:16:09.104518+0000","last_clean":"2024-09-21T22:16:09.104518+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:16:09.104518+0000","last_undegraded":"2024-09-21T22:16:09.104518+0000","last_fullsized":"2024-09-21T22:16:09.104518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:00.892266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057354699999999999,"stat_sum":{"num_bytes":11033826,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":417,"num_read_kb":12892,"num_write":130,"num_write_kb":9274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.966569+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:16:08.966569+0000","last_peered":"2024-09-21T22:16:08.966569+0000","last_clean":"2024-09-21T22:16:08.966569+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:16:08.966569+0000","last_undegraded":"2024-09-21T22:16:08.966569+0000","last_fullsized":"2024-09-21T22:16:08.966569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'91","reported_seq":1232,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.218953+0000","last_change":"2024-09-21T22:16:06.079671+0000","last_active":"2024-09-21T22:16:09.218953+0000","last_peered":"2024-09-21T22:16:09.218953+0000","last_clean":"2024-09-21T22:16:09.218953+0000","last_became_active":"2024-09-21T22:16:00.921655+0000","last_became_peered":"2024-09-21T22:16:00.921655+0000","last_unstale":"2024-09-21T22:16:09.218953+0000","last_undegraded":"2024-09-21T22:16:09.218953+0000","last_fullsized":"2024-09-21T22:16:09.218953+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:17:34.645748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062171000000000004,"stat_sum":{"num_bytes":16517271,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":995,"num_read_kb":15352,"num_write":206,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.3","version":"52'83","reported_seq":456,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.102337+0000","last_change":"2024-09-21T22:16:05.935944+0000","last_active":"2024-09-21T22:16:09.102337+0000","last_peered":"2024-09-21T22:16:09.102337+0000","last_clean":"2024-09-21T22:16:09.102337+0000","last_became_active":"2024-09-21T22:15:36.447748+0000","last_became_peered":"2024-09-21T22:15:36.447748+0000","last_unstale":"2024-09-21T22:16:09.102337+0000","last_undegraded":"2024-09-21T22:16:09.102337+0000","last_fullsized":"2024-09-21T22:16:09.102337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:06.799883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026304399999999998,"stat_sum":{"num_bytes":6498980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":386,"num_read_kb":7679,"num_write":137,"num_write_kb":7791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.956828+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:16:08.956828+0000","last_peered":"2024-09-21T22:16:08.956828+0000","last_clean":"2024-09-21T22:16:08.956828+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:16:08.956828+0000","last_undegraded":"2024-09-21T22:16:08.956828+0000","last_fullsized":"2024-09-21T22:16:08.956828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"54'257","reported_seq":750,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.221637+0000","last_change":"2024-09-21T22:16:06.090005+0000","last_active":"2024-09-21T22:16:09.221637+0000","last_peered":"2024-09-21T22:16:09.221637+0000","last_clean":"2024-09-21T22:16:09.221637+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:16:09.221637+0000","last_undegraded":"2024-09-21T22:16:09.221637+0000","last_fullsized":"2024-09-21T22:16:09.221637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:15.137111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037465600000000001,"stat_sum":{"num_bytes":13850510,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1297,"num_read_kb":15158,"num_write":428,"num_write_kb":11578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.035296+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:16:09.035296+0000","last_peered":"2024-09-21T22:16:09.035296+0000","last_clean":"2024-09-21T22:16:09.035296+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:16:09.035296+0000","last_undegraded":"2024-09-21T22:16:09.035296+0000","last_fullsized":"2024-09-21T22:16:09.035296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'80","reported_seq":424,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.221552+0000","last_change":"2024-09-21T22:16:05.936947+0000","last_active":"2024-09-21T22:16:09.221552+0000","last_peered":"2024-09-21T22:16:09.221552+0000","last_clean":"2024-09-21T22:16:09.221552+0000","last_became_active":"2024-09-21T22:15:36.451816+0000","last_became_peered":"2024-09-21T22:15:36.451816+0000","last_unstale":"2024-09-21T22:16:09.221552+0000","last_undegraded":"2024-09-21T22:16:09.221552+0000","last_fullsized":"2024-09-21T22:16:09.221552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:21:08.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089867199999999999,"stat_sum":{"num_bytes":4670338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":5924,"num_write":163,"num_write_kb":7558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.961692+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:16:08.961692+0000","last_peered":"2024-09-21T22:16:08.961692+0000","last_clean":"2024-09-21T22:16:08.961692+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:16:08.961692+0000","last_undegraded":"2024-09-21T22:16:08.961692+0000","last_fullsized":"2024-09-21T22:16:08.961692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"52'77","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954098+0000","last_change":"2024-09-21T22:16:05.937092+0000","last_active":"2024-09-21T22:16:07.954098+0000","last_peered":"2024-09-21T22:16:07.954098+0000","last_clean":"2024-09-21T22:16:07.954098+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:16:07.954098+0000","last_undegraded":"2024-09-21T22:16:07.954098+0000","last_fullsized":"2024-09-21T22:16:07.954098+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:49:30.088856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014421950000000001,"stat_sum":{"num_bytes":9120931,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":124,"num_read_kb":4086,"num_write":146,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.956791+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:16:08.956791+0000","last_peered":"2024-09-21T22:16:08.956791+0000","last_clean":"2024-09-21T22:16:08.956791+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:16:08.956791+0000","last_undegraded":"2024-09-21T22:16:08.956791+0000","last_fullsized":"2024-09-21T22:16:08.956791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.961725+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:16:08.961725+0000","last_peered":"2024-09-21T22:16:08.961725+0000","last_clean":"2024-09-21T22:16:08.961725+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:16:08.961725+0000","last_undegraded":"2024-09-21T22:16:08.961725+0000","last_fullsized":"2024-09-21T22:16:08.961725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"52'155","reported_seq":443,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954088+0000","last_change":"2024-09-21T22:16:05.937760+0000","last_active":"2024-09-21T22:16:07.954088+0000","last_peered":"2024-09-21T22:16:07.954088+0000","last_clean":"2024-09-21T22:16:07.954088+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:16:07.954088+0000","last_undegraded":"2024-09-21T22:16:07.954088+0000","last_fullsized":"2024-09-21T22:16:07.954088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:40:48.417552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002104294,"stat_sum":{"num_bytes":6414424,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":4113,"num_write":260,"num_write_kb":6716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.9","version":"54'102","reported_seq":790,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.960171+0000","last_change":"2024-09-21T22:16:05.936175+0000","last_active":"2024-09-21T22:16:08.960171+0000","last_peered":"2024-09-21T22:16:08.960171+0000","last_clean":"2024-09-21T22:16:08.960171+0000","last_became_active":"2024-09-21T22:15:36.554061+0000","last_became_peered":"2024-09-21T22:15:36.554061+0000","last_unstale":"2024-09-21T22:16:08.960171+0000","last_undegraded":"2024-09-21T22:16:08.960171+0000","last_fullsized":"2024-09-21T22:16:08.960171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:43:07.810366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046970099999999999,"stat_sum":{"num_bytes":14773774,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1109,"num_read_kb":8276,"num_write":199,"num_write_kb":8044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.a","version":"54'48","reported_seq":374,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.298926+0000","last_change":"2024-09-21T22:16:06.073587+0000","last_active":"2024-09-21T22:16:09.298926+0000","last_peered":"2024-09-21T22:16:09.298926+0000","last_clean":"2024-09-21T22:16:09.298926+0000","last_became_active":"2024-09-21T22:15:36.449394+0000","last_became_peered":"2024-09-21T22:15:36.449394+0000","last_unstale":"2024-09-21T22:16:09.298926+0000","last_undegraded":"2024-09-21T22:16:09.298926+0000","last_fullsized":"2024-09-21T22:16:09.298926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:55:06.615448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335268,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":284,"num_read_kb":2255,"num_write":79,"num_write_kb":2943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.b","version":"53'301","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.004300+0000","last_change":"2024-09-21T22:16:05.937117+0000","last_active":"2024-09-21T22:16:08.004300+0000","last_peered":"2024-09-21T22:16:08.004300+0000","last_clean":"2024-09-21T22:16:08.004300+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:16:08.004300+0000","last_undegraded":"2024-09-21T22:16:08.004300+0000","last_fullsized":"2024-09-21T22:16:08.004300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:57:01.721276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015004580000000001,"stat_sum":{"num_bytes":4004109,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1365,"num_read_kb":4792,"num_write":529,"num_write_kb":5630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.c","version":"52'20","reported_seq":313,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.078790+0000","last_change":"2024-09-21T22:16:06.079170+0000","last_active":"2024-09-21T22:16:09.078790+0000","last_peered":"2024-09-21T22:16:09.078790+0000","last_clean":"2024-09-21T22:16:09.078790+0000","last_became_active":"2024-09-21T22:16:00.921657+0000","last_became_peered":"2024-09-21T22:16:00.921657+0000","last_unstale":"2024-09-21T22:16:09.078790+0000","last_undegraded":"2024-09-21T22:16:09.078790+0000","last_fullsized":"2024-09-21T22:16:09.078790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:54.262073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040598000000000001,"stat_sum":{"num_bytes":4111397,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":4057,"num_write":21,"num_write_kb":1717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.d","version":"54'118","reported_seq":464,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.112849+0000","last_change":"2024-09-21T22:16:05.943477+0000","last_active":"2024-09-21T22:16:09.112849+0000","last_peered":"2024-09-21T22:16:09.112849+0000","last_clean":"2024-09-21T22:16:09.112849+0000","last_became_active":"2024-09-21T22:15:36.450576+0000","last_became_peered":"2024-09-21T22:15:36.450576+0000","last_unstale":"2024-09-21T22:16:09.112849+0000","last_undegraded":"2024-09-21T22:16:09.112849+0000","last_fullsized":"2024-09-21T22:16:09.112849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:41:40.085268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070278699999999996,"stat_sum":{"num_bytes":14614528,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":7271,"num_write":230,"num_write_kb":7263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.e","version":"54'48","reported_seq":285,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.111234+0000","last_change":"2024-09-21T22:16:05.943196+0000","last_active":"2024-09-21T22:16:09.111234+0000","last_peered":"2024-09-21T22:16:09.111234+0000","last_clean":"2024-09-21T22:16:09.111234+0000","last_became_active":"2024-09-21T22:15:36.452314+0000","last_became_peered":"2024-09-21T22:15:36.452314+0000","last_unstale":"2024-09-21T22:16:09.111234+0000","last_undegraded":"2024-09-21T22:16:09.111234+0000","last_fullsized":"2024-09-21T22:16:09.111234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:33:38.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060244499999999996,"stat_sum":{"num_bytes":10272730,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":2363,"num_write":122,"num_write_kb":4622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.f","version":"54'104","reported_seq":450,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.299541+0000","last_change":"2024-09-21T22:16:05.943257+0000","last_active":"2024-09-21T22:16:09.299541+0000","last_peered":"2024-09-21T22:16:09.299541+0000","last_clean":"2024-09-21T22:16:09.299541+0000","last_became_active":"2024-09-21T22:15:36.452701+0000","last_became_peered":"2024-09-21T22:15:36.452701+0000","last_unstale":"2024-09-21T22:16:09.299541+0000","last_undegraded":"2024-09-21T22:16:09.299541+0000","last_fullsized":"2024-09-21T22:16:09.299541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:57:33.477527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062509999999999996,"stat_sum":{"num_bytes":13577521,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":361,"num_read_kb":6679,"num_write":209,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.10","version":"52'67","reported_seq":580,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.218861+0000","last_change":"2024-09-21T22:16:06.073573+0000","last_active":"2024-09-21T22:16:09.218861+0000","last_peered":"2024-09-21T22:16:09.218861+0000","last_clean":"2024-09-21T22:16:09.218861+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:16:09.218861+0000","last_undegraded":"2024-09-21T22:16:09.218861+0000","last_fullsized":"2024-09-21T22:16:09.218861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:28:47.469717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032577799999999998,"stat_sum":{"num_bytes":10377952,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":398,"num_read_kb":9397,"num_write":112,"num_write_kb":3421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.11","version":"52'49","reported_seq":604,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.111054+0000","last_change":"2024-09-21T22:16:05.942920+0000","last_active":"2024-09-21T22:16:09.111054+0000","last_peered":"2024-09-21T22:16:09.111054+0000","last_clean":"2024-09-21T22:16:09.111054+0000","last_became_active":"2024-09-21T22:15:36.451421+0000","last_became_peered":"2024-09-21T22:15:36.451421+0000","last_unstale":"2024-09-21T22:16:09.111054+0000","last_undegraded":"2024-09-21T22:16:09.111054+0000","last_fullsized":"2024-09-21T22:16:09.111054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:49:02.370643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039418299999999999,"stat_sum":{"num_bytes":9045077,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":436,"num_read_kb":7098,"num_write":72,"num_write_kb":7189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.12","version":"54'204","reported_seq":755,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.240440+0000","last_change":"2024-09-21T22:16:05.937684+0000","last_active":"2024-09-21T22:16:09.240440+0000","last_peered":"2024-09-21T22:16:09.240440+0000","last_clean":"2024-09-21T22:16:09.240440+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:16:09.240440+0000","last_undegraded":"2024-09-21T22:16:09.240440+0000","last_fullsized":"2024-09-21T22:16:09.240440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:44:52.220235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085345199999999999,"stat_sum":{"num_bytes":17553859,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1229,"num_read_kb":3138,"num_write":334,"num_write_kb":8748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.13","version":"52'351","reported_seq":996,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.220124+0000","last_change":"2024-09-21T22:16:05.943006+0000","last_active":"2024-09-21T22:16:09.220124+0000","last_peered":"2024-09-21T22:16:09.220124+0000","last_clean":"2024-09-21T22:16:09.220124+0000","last_became_active":"2024-09-21T22:15:36.450372+0000","last_became_peered":"2024-09-21T22:15:36.450372+0000","last_unstale":"2024-09-21T22:16:09.220124+0000","last_undegraded":"2024-09-21T22:16:09.220124+0000","last_fullsized":"2024-09-21T22:16:09.220124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:56:44.892652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046043499999999998,"stat_sum":{"num_bytes":15061646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2109,"num_read_kb":18641,"num_write":582,"num_write_kb":5881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":365994058,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":24442,"num_read_kb":271127,"num_write":6962,"num_write_kb":240707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":19591155,"num_keys_recovered":32,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":152059904,"data_stored":151095393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3819,"ondisk_log_size":3819,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48444,"kb_used_data":17256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323396,"statfs":{"total":96636764160,"available":96587157504,"internally_reserved":0,"allocated":17670144,"data_stored":17202924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":1226045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47452,"kb_used_data":16260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324388,"statfs":{"total":96636764160,"available":96588173312,"internally_reserved":0,"allocated":16650240,"data_stored":16153219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60080,"kb_used_data":24732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311760,"statfs":{"total":96636764160,"available":96575242240,"internally_reserved":0,"allocated":25325568,"data_stored":24836764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528323,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41452,"kb_used_data":13336,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94330388,"statfs":{"total":96636764160,"available":96594317312,"internally_reserved":0,"allocated":13656064,"data_stored":13122295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":28765874},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44396,"kb_used_data":13200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327444,"statfs":{"total":96636764160,"available":96591302656,"internally_reserved":0,"allocated":13516800,"data_stored":13121076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58160,"kb_used_data":26968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94313680,"statfs":{"total":96636764160,"available":96577208320,"internally_reserved":0,"allocated":27615232,"data_stored":27168397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52220,"kb_used_data":16876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319620,"statfs":{"total":96636764160,"available":96583290880,"internally_reserved":0,"allocated":17281024,"data_stored":16816550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23801856,"data_stored":23669758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26988544,"data_stored":26891538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12894208,"data_stored":12844236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13045760,"data_stored":12851682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31174656,"data_stored":31022285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17729925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":991232,"data_stored":949205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25276416,"data_stored":25136764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:16:11.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:16:11.366 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:11.365+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:11.386 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:11.386 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:11.387 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:11.387 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:11.387 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:11.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:11.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:11.478+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12194 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1327104~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5943725390000001, 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024432683, 2024-09-21T22:16:11.544 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12194 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947443+0000", 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.102e-06 2024-09-21T22:16:11.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947446+0000", 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0359999999999998e-06 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947449+0000", 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.357e-06 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971629+0000", 2024-09-21T22:16:11.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024180103000000001 2024-09-21T22:16:11.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971669+0000", 2024-09-21T22:16:11.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0457999999999998e-05 2024-09-21T22:16:11.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971875+0000", 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020541299999999999 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12195 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1409024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5943600560000002, 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024694972999999999, 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12195 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947455+0000", 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.16e-07 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947456+0000", 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1650000000000001e-06 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947460+0000", 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1250000000000003e-06 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947464+0000", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971900+0000", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024436198999999999 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971941+0000", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0914999999999997e-05 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972149+0000", 2024-09-21T22:16:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000208581 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12196 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1490944~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.594345144, 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024916424999999999, 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12196 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947470+0000", 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947472+0000", 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.894e-06 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947479+0000", 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.182e-06 2024-09-21T22:16:11.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4669999999999998e-06 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972175+0000", 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024691870000000001 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972216+0000", 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0747000000000001e-05 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972386+0000", 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169875 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12219 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 835584~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.59429789, 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025132278000000001, 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12219 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947525+0000", 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2549999999999997e-06 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947535+0000", 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5400000000000001e-06 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947547+0000", 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1721e-05 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972410+0000", 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024863703000000001 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972450+0000", 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9440999999999997e-05 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972649+0000", 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000199044 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12220 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 917504~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5942346299999999, 2024-09-21T22:16:11.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025318852999999999, 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12220 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0447e-05 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947600+0000", 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3649999999999993e-06 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8660000000000002e-06 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972675+0000", 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025069168999999999 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972719+0000", 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3757999999999997e-05 2024-09-21T22:16:11.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972899+0000", 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017969899999999999 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12221 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 999424~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5941985580000004, 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025531113000000001, 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.566 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12221 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:11.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947619+0000", 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947629+0000", 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0325e-05 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947634+0000", 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1760000000000001e-06 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972923+0000", 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025289282999999999 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972964+0000", 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0225000000000002e-05 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973147+0000", 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183365 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12222 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1048576~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5941732909999997, 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02581663, 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12222 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:11.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947642+0000", 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947649+0000", 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999999e-06 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947659+0000", 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0023e-05 2024-09-21T22:16:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947664+0000", 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2399999999999998e-06 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973181+0000", 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025516975000000001 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973232+0000", 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1538e-05 2024-09-21T22:16:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973458+0000", 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225405 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12223 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1130496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5941433140000001, 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026051338, 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12223 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947672+0000", 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947674+0000", 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1880000000000001e-06 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947680+0000", 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2149999999999998e-06 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947689+0000", 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6889999999999993e-06 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973492+0000", 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025803362 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973543+0000", 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378000000000002e-05 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973723+0000", 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017904499999999999 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12224 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1212416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.594117894, 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026304080000000001, 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12224 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6899999999999998e-07 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947699+0000", 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947710+0000", 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5210000000000004e-06 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973748+0000", 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026037801999999999 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973795+0000", 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6866999999999997e-05 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974001+0000", 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020599600000000001 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12225 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1294336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5940981519999999, 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026580894000000001, 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12225 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947717+0000", 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947719+0000", 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.885e-06 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947724+0000", 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7180000000000001e-06 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947729+0000", 2024-09-21T22:16:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974025+0000", 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026295888999999999 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974066+0000", 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1458999999999997e-05 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974297+0000", 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023100900000000001 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12226 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1343488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5940800399999997, 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026843615000000001, 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12226 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947735+0000", 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947737+0000", 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.812e-06 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947744+0000", 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9500000000000004e-06 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947748+0000", 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974323+0000", 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026574644000000001 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974385+0000", 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2318999999999997e-05 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974578+0000", 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192864 2024-09-21T22:16:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12227 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1425408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.594060195, 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027110875999999999, 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12227 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947755+0000", 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947757+0000", 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0099999999999998e-06 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947766+0000", 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4089999999999992e-06 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947792+0000", 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6367999999999999e-05 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974604+0000", 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026811181 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974646+0000", 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2694000000000002e-05 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974865+0000", 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021881900000000001 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12228 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1507328~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5940159109999996, 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027303377, 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12228 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7700000000000001e-07 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947800+0000", 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6220000000000001e-06 2024-09-21T22:16:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947813+0000", 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2833999999999999e-05 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947816+0000", 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1030000000000002e-06 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974890+0000", 2024-09-21T22:16:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027073904999999999 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974931+0000", 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0194000000000002e-05 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975102+0000", 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171442 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12229 3.1f 3:f99fee0f:::rbd_object_map.1185fc79843.000000000000000e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5907008759999997, 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026242102, 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12229 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951121+0000", 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0559999999999999e-06 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951129+0000", 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951137+0000", 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4600000000000003e-06 2024-09-21T22:16:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951143+0000", 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9989999999999997e-06 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975127+0000", 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023983563999999999 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975176+0000", 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9753000000000003e-05 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975510+0000", 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033344700000000001 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977251+0000", 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017413859999999999 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977283+0000", 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2261000000000002e-05 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977317+0000", 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3463999999999997e-05 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977356+0000", 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8859000000000002e-05 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12465 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5441931669999995, 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024627518000000001, 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12465 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997622+0000", 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5600000000000002e-07 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997624+0000", 2024-09-21T22:16:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997630+0000", 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.392e-06 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997634+0000", 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3810000000000001e-06 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021905+0000", 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024270242000000001 2024-09-21T22:16:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021988+0000", 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3836000000000002e-05 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022249+0000", 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026042300000000002 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12466 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5441753460000003, 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025061416, 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12466 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.53e-07 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997641+0000", 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6700000000000001e-06 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997647+0000", 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.942e-06 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997652+0000", 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7639999999999996e-06 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022294+0000", 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024641880000000001 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022385+0000", 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1324999999999997e-05 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022701+0000", 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031558200000000002 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12467 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5441547120000001, 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02537503, 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12467 2024-09-21T22:16:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-07 2024-09-21T22:16:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997662+0000", 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9039999999999999e-06 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997668+0000", 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997673+0000", 2024-09-21T22:16:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022728+0000", 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025054937999999999 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022814+0000", 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6520000000000005e-05 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023035+0000", 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022056699999999999 2024-09-21T22:16:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12476 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5438980319999995, 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025528713000000001, 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12476 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997917+0000", 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9199999999999999e-07 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997922+0000", 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6589999999999998e-06 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997934+0000", 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.224e-05 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997941+0000", 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8669999999999996e-06 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023079+0000", 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025137836 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023169+0000", 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0457999999999993e-05 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023445+0000", 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027576100000000002 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12477 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5438510430000001, 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025850773000000001, 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12477 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2099999999999996e-07 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997967+0000", 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1089999999999998e-06 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997976+0000", 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.524e-06 2024-09-21T22:16:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997979+0000", 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7589999999999999e-06 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023470+0000", 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025490777999999999 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023552+0000", 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1893999999999999e-05 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023814+0000", 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262088 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12478 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5438277419999995, 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026321787999999999, 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12478 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8799999999999998e-07 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997992+0000", 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.045e-06 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997996+0000", 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3939999999999998e-06 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997999+0000", 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.937e-06 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023857+0000", 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025858069000000001 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023951+0000", 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3226999999999994e-05 2024-09-21T22:16:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.024309+0000", 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035782799999999998 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:11.629 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:11.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:11.631 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:11.630+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:16:11.663 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-21T22:16:11.180797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":366584445,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":24558,"num_read_kb":271227,"num_write":7123,"num_write_kb":243125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":19591155,"num_keys_recovered":32,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3939,"ondisk_log_size":3939,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":384968,"kb_used_data":130204,"kb_used_omap":15,"kb_used_meta":254576,"kb_avail":754589752,"statfs":{"total":773094113280,"available":772699906048,"internally_reserved":0,"allocated":133328896,"data_stored":129647270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":260686620},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124101785,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":8731,"num_read_kb":81894,"num_write":2177,"num_write_kb":62777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000785"},"pg_stats":[{"pgid":"3.1f","version":"54'265","reported_seq":880,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.126416+0000","last_change":"2024-09-21T22:16:05.938048+0000","last_active":"2024-09-21T22:16:09.126416+0000","last_peered":"2024-09-21T22:16:09.126416+0000","last_clean":"2024-09-21T22:16:09.126416+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:16:09.126416+0000","last_undegraded":"2024-09-21T22:16:09.126416+0000","last_fullsized":"2024-09-21T22:16:09.126416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:57.956255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012868389999999999,"stat_sum":{"num_bytes":16854714,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1502,"num_read_kb":9463,"num_write":532,"num_write_kb":10363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1e","version":"52'182","reported_seq":1448,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954342+0000","last_change":"2024-09-21T22:16:05.937873+0000","last_active":"2024-09-21T22:16:07.954342+0000","last_peered":"2024-09-21T22:16:07.954342+0000","last_clean":"2024-09-21T22:16:07.954342+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:16:07.954342+0000","last_undegraded":"2024-09-21T22:16:07.954342+0000","last_fullsized":"2024-09-21T22:16:07.954342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:50:47.369623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019603260000000001,"stat_sum":{"num_bytes":11037222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2204,"num_read_kb":12164,"num_write":215,"num_write_kb":5784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1d","version":"54'120","reported_seq":1270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.100696+0000","last_change":"2024-09-21T22:16:06.079518+0000","last_active":"2024-09-21T22:16:09.100696+0000","last_peered":"2024-09-21T22:16:09.100696+0000","last_clean":"2024-09-21T22:16:09.100696+0000","last_became_active":"2024-09-21T22:15:36.449655+0000","last_became_peered":"2024-09-21T22:15:36.449655+0000","last_unstale":"2024-09-21T22:16:09.100696+0000","last_undegraded":"2024-09-21T22:16:09.100696+0000","last_fullsized":"2024-09-21T22:16:09.100696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:17.835269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063684899999999999,"stat_sum":{"num_bytes":28843172,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1368,"num_read_kb":22593,"num_write":245,"num_write_kb":13820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1c","version":"53'90","reported_seq":559,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.219399+0000","last_change":"2024-09-21T22:16:06.079178+0000","last_active":"2024-09-21T22:16:09.219399+0000","last_peered":"2024-09-21T22:16:09.219399+0000","last_clean":"2024-09-21T22:16:09.219399+0000","last_became_active":"2024-09-21T22:15:36.449203+0000","last_became_peered":"2024-09-21T22:15:36.449203+0000","last_unstale":"2024-09-21T22:16:09.219399+0000","last_undegraded":"2024-09-21T22:16:09.219399+0000","last_fullsized":"2024-09-21T22:16:09.219399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:45:16.234698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041167100000000001,"stat_sum":{"num_bytes":6457402,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":368,"num_read_kb":6576,"num_write":197,"num_write_kb":11471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1b","version":"52'86","reported_seq":428,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.125235+0000","last_change":"2024-09-21T22:16:05.936945+0000","last_active":"2024-09-21T22:16:09.125235+0000","last_peered":"2024-09-21T22:16:09.125235+0000","last_clean":"2024-09-21T22:16:09.125235+0000","last_became_active":"2024-09-21T22:15:36.451889+0000","last_became_peered":"2024-09-21T22:15:36.451889+0000","last_unstale":"2024-09-21T22:16:09.125235+0000","last_undegraded":"2024-09-21T22:16:09.125235+0000","last_fullsized":"2024-09-21T22:16:09.125235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:05:19.624413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076333100000000001,"stat_sum":{"num_bytes":5229636,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":7166,"num_write":179,"num_write_kb":6745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.1a","version":"54'39","reported_seq":517,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.286704+0000","last_change":"2024-09-21T22:16:05.935905+0000","last_active":"2024-09-21T22:16:09.286704+0000","last_peered":"2024-09-21T22:16:09.286704+0000","last_clean":"2024-09-21T22:16:09.286704+0000","last_became_active":"2024-09-21T22:15:36.445163+0000","last_became_peered":"2024-09-21T22:15:36.445163+0000","last_unstale":"2024-09-21T22:16:09.286704+0000","last_undegraded":"2024-09-21T22:16:09.286704+0000","last_fullsized":"2024-09-21T22:16:09.286704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:03:30.213441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037813899999999999,"stat_sum":{"num_bytes":7198808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":359,"num_read_kb":754,"num_write":75,"num_write_kb":4330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.19","version":"54'171","reported_seq":1126,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.966497+0000","last_change":"2024-09-21T22:16:06.090252+0000","last_active":"2024-09-21T22:16:08.966497+0000","last_peered":"2024-09-21T22:16:08.966497+0000","last_clean":"2024-09-21T22:16:08.966497+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:16:08.966497+0000","last_undegraded":"2024-09-21T22:16:08.966497+0000","last_fullsized":"2024-09-21T22:16:08.966497+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:38:42.236273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079234699999999999,"stat_sum":{"num_bytes":16121856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1841,"num_read_kb":8398,"num_write":258,"num_write_kb":6934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.18","version":"52'101","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954069+0000","last_change":"2024-09-21T22:16:05.937467+0000","last_active":"2024-09-21T22:16:07.954069+0000","last_peered":"2024-09-21T22:16:07.954069+0000","last_clean":"2024-09-21T22:16:07.954069+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:16:07.954069+0000","last_undegraded":"2024-09-21T22:16:07.954069+0000","last_fullsized":"2024-09-21T22:16:07.954069+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:45:41.985671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018198000000000001,"stat_sum":{"num_bytes":3006478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":258,"num_read_kb":2805,"num_write":211,"num_write_kb":6227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.17","version":"52'90","reported_seq":900,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.120452+0000","last_change":"2024-09-21T22:16:05.937447+0000","last_active":"2024-09-21T22:16:09.120452+0000","last_peered":"2024-09-21T22:16:09.120452+0000","last_clean":"2024-09-21T22:16:09.120452+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:16:09.120452+0000","last_undegraded":"2024-09-21T22:16:09.120452+0000","last_fullsized":"2024-09-21T22:16:09.120452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:53:30.733752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000791996,"stat_sum":{"num_bytes":7024128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1040,"num_read_kb":6920,"num_write":189,"num_write_kb":9347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.16","version":"54'69","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.099860+0000","last_change":"2024-09-21T22:16:06.079452+0000","last_active":"2024-09-21T22:16:09.099860+0000","last_peered":"2024-09-21T22:16:09.099860+0000","last_clean":"2024-09-21T22:16:09.099860+0000","last_became_active":"2024-09-21T22:15:36.451714+0000","last_became_peered":"2024-09-21T22:15:36.451714+0000","last_unstale":"2024-09-21T22:16:09.099860+0000","last_undegraded":"2024-09-21T22:16:09.099860+0000","last_fullsized":"2024-09-21T22:16:09.099860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:09.674705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000640768,"stat_sum":{"num_bytes":19451605,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":11081,"num_write":148,"num_write_kb":4964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.15","version":"54'178","reported_seq":858,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.086076+0000","last_change":"2024-09-21T22:16:05.943656+0000","last_active":"2024-09-21T22:16:09.086076+0000","last_peered":"2024-09-21T22:16:09.086076+0000","last_clean":"2024-09-21T22:16:09.086076+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:16:09.086076+0000","last_undegraded":"2024-09-21T22:16:09.086076+0000","last_fullsized":"2024-09-21T22:16:09.086076+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:56.165188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086763499999999996,"stat_sum":{"num_bytes":20405501,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1079,"num_read_kb":16324,"num_write":345,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.14","version":"54'84","reported_seq":568,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.220445+0000","last_change":"2024-09-21T22:16:05.936184+0000","last_active":"2024-09-21T22:16:09.220445+0000","last_peered":"2024-09-21T22:16:09.220445+0000","last_clean":"2024-09-21T22:16:09.220445+0000","last_became_active":"2024-09-21T22:15:36.448788+0000","last_became_peered":"2024-09-21T22:15:36.448788+0000","last_unstale":"2024-09-21T22:16:09.220445+0000","last_undegraded":"2024-09-21T22:16:09.220445+0000","last_fullsized":"2024-09-21T22:16:09.220445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:19:49.183337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049629600000000002,"stat_sum":{"num_bytes":12682163,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":370,"num_read_kb":6230,"num_write":157,"num_write_kb":7191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.958293+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:16:08.958293+0000","last_peered":"2024-09-21T22:16:08.958293+0000","last_clean":"2024-09-21T22:16:08.958293+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:16:08.958293+0000","last_undegraded":"2024-09-21T22:16:08.958293+0000","last_fullsized":"2024-09-21T22:16:08.958293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"54'59","reported_seq":568,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.223947+0000","last_change":"2024-09-21T22:16:05.937306+0000","last_active":"2024-09-21T22:16:09.223947+0000","last_peered":"2024-09-21T22:16:09.223947+0000","last_clean":"2024-09-21T22:16:09.223947+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:16:09.223947+0000","last_undegraded":"2024-09-21T22:16:09.223947+0000","last_fullsized":"2024-09-21T22:16:09.223947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:17.580410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070147999999999999,"stat_sum":{"num_bytes":20971633,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":390,"num_read_kb":13727,"num_write":138,"num_write_kb":10437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.966515+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:16:08.966515+0000","last_peered":"2024-09-21T22:16:08.966515+0000","last_clean":"2024-09-21T22:16:08.966515+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:16:08.966515+0000","last_undegraded":"2024-09-21T22:16:08.966515+0000","last_fullsized":"2024-09-21T22:16:08.966515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'56","reported_seq":558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954254+0000","last_change":"2024-09-21T22:16:05.937400+0000","last_active":"2024-09-21T22:16:07.954254+0000","last_peered":"2024-09-21T22:16:07.954254+0000","last_clean":"2024-09-21T22:16:07.954254+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:16:07.954254+0000","last_undegraded":"2024-09-21T22:16:07.954254+0000","last_fullsized":"2024-09-21T22:16:07.954254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:22:33.278586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001750913,"stat_sum":{"num_bytes":7113715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":7755,"num_write":114,"num_write_kb":4633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.962024+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:16:08.962024+0000","last_peered":"2024-09-21T22:16:08.962024+0000","last_clean":"2024-09-21T22:16:08.962024+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:16:08.962024+0000","last_undegraded":"2024-09-21T22:16:08.962024+0000","last_fullsized":"2024-09-21T22:16:08.962024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"53'74","reported_seq":608,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.104518+0000","last_change":"2024-09-21T22:16:06.090287+0000","last_active":"2024-09-21T22:16:09.104518+0000","last_peered":"2024-09-21T22:16:09.104518+0000","last_clean":"2024-09-21T22:16:09.104518+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:16:09.104518+0000","last_undegraded":"2024-09-21T22:16:09.104518+0000","last_fullsized":"2024-09-21T22:16:09.104518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:00.892266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057354699999999999,"stat_sum":{"num_bytes":11033826,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":417,"num_read_kb":12892,"num_write":130,"num_write_kb":9274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.966569+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:16:08.966569+0000","last_peered":"2024-09-21T22:16:08.966569+0000","last_clean":"2024-09-21T22:16:08.966569+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:16:08.966569+0000","last_undegraded":"2024-09-21T22:16:08.966569+0000","last_fullsized":"2024-09-21T22:16:08.966569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'91","reported_seq":1232,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.218953+0000","last_change":"2024-09-21T22:16:06.079671+0000","last_active":"2024-09-21T22:16:09.218953+0000","last_peered":"2024-09-21T22:16:09.218953+0000","last_clean":"2024-09-21T22:16:09.218953+0000","last_became_active":"2024-09-21T22:16:00.921655+0000","last_became_peered":"2024-09-21T22:16:00.921655+0000","last_unstale":"2024-09-21T22:16:09.218953+0000","last_undegraded":"2024-09-21T22:16:09.218953+0000","last_fullsized":"2024-09-21T22:16:09.218953+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:17:34.645748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062171000000000004,"stat_sum":{"num_bytes":16517271,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":995,"num_read_kb":15352,"num_write":206,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.3","version":"52'83","reported_seq":456,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.102337+0000","last_change":"2024-09-21T22:16:05.935944+0000","last_active":"2024-09-21T22:16:09.102337+0000","last_peered":"2024-09-21T22:16:09.102337+0000","last_clean":"2024-09-21T22:16:09.102337+0000","last_became_active":"2024-09-21T22:15:36.447748+0000","last_became_peered":"2024-09-21T22:15:36.447748+0000","last_unstale":"2024-09-21T22:16:09.102337+0000","last_undegraded":"2024-09-21T22:16:09.102337+0000","last_fullsized":"2024-09-21T22:16:09.102337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:06.799883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026304399999999998,"stat_sum":{"num_bytes":6498980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":386,"num_read_kb":7679,"num_write":137,"num_write_kb":7791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.956828+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:16:08.956828+0000","last_peered":"2024-09-21T22:16:08.956828+0000","last_clean":"2024-09-21T22:16:08.956828+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:16:08.956828+0000","last_undegraded":"2024-09-21T22:16:08.956828+0000","last_fullsized":"2024-09-21T22:16:08.956828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"54'257","reported_seq":750,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.221637+0000","last_change":"2024-09-21T22:16:06.090005+0000","last_active":"2024-09-21T22:16:09.221637+0000","last_peered":"2024-09-21T22:16:09.221637+0000","last_clean":"2024-09-21T22:16:09.221637+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:16:09.221637+0000","last_undegraded":"2024-09-21T22:16:09.221637+0000","last_fullsized":"2024-09-21T22:16:09.221637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:15.137111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037465600000000001,"stat_sum":{"num_bytes":13850510,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1297,"num_read_kb":15158,"num_write":428,"num_write_kb":11578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.035296+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:16:09.035296+0000","last_peered":"2024-09-21T22:16:09.035296+0000","last_clean":"2024-09-21T22:16:09.035296+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:16:09.035296+0000","last_undegraded":"2024-09-21T22:16:09.035296+0000","last_fullsized":"2024-09-21T22:16:09.035296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'80","reported_seq":424,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.221552+0000","last_change":"2024-09-21T22:16:05.936947+0000","last_active":"2024-09-21T22:16:09.221552+0000","last_peered":"2024-09-21T22:16:09.221552+0000","last_clean":"2024-09-21T22:16:09.221552+0000","last_became_active":"2024-09-21T22:15:36.451816+0000","last_became_peered":"2024-09-21T22:15:36.451816+0000","last_unstale":"2024-09-21T22:16:09.221552+0000","last_undegraded":"2024-09-21T22:16:09.221552+0000","last_fullsized":"2024-09-21T22:16:09.221552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:21:08.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089867199999999999,"stat_sum":{"num_bytes":4670338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":5924,"num_write":163,"num_write_kb":7558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.961692+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:16:08.961692+0000","last_peered":"2024-09-21T22:16:08.961692+0000","last_clean":"2024-09-21T22:16:08.961692+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:16:08.961692+0000","last_undegraded":"2024-09-21T22:16:08.961692+0000","last_fullsized":"2024-09-21T22:16:08.961692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"52'77","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954098+0000","last_change":"2024-09-21T22:16:05.937092+0000","last_active":"2024-09-21T22:16:07.954098+0000","last_peered":"2024-09-21T22:16:07.954098+0000","last_clean":"2024-09-21T22:16:07.954098+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:16:07.954098+0000","last_undegraded":"2024-09-21T22:16:07.954098+0000","last_fullsized":"2024-09-21T22:16:07.954098+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:49:30.088856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014421950000000001,"stat_sum":{"num_bytes":9120931,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":124,"num_read_kb":4086,"num_write":146,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.956791+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:16:08.956791+0000","last_peered":"2024-09-21T22:16:08.956791+0000","last_clean":"2024-09-21T22:16:08.956791+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:16:08.956791+0000","last_undegraded":"2024-09-21T22:16:08.956791+0000","last_fullsized":"2024-09-21T22:16:08.956791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.961725+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:16:08.961725+0000","last_peered":"2024-09-21T22:16:08.961725+0000","last_clean":"2024-09-21T22:16:08.961725+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:16:08.961725+0000","last_undegraded":"2024-09-21T22:16:08.961725+0000","last_fullsized":"2024-09-21T22:16:08.961725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"52'155","reported_seq":443,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:07.954088+0000","last_change":"2024-09-21T22:16:05.937760+0000","last_active":"2024-09-21T22:16:07.954088+0000","last_peered":"2024-09-21T22:16:07.954088+0000","last_clean":"2024-09-21T22:16:07.954088+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:16:07.954088+0000","last_undegraded":"2024-09-21T22:16:07.954088+0000","last_fullsized":"2024-09-21T22:16:07.954088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:40:48.417552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002104294,"stat_sum":{"num_bytes":6414424,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":4113,"num_write":260,"num_write_kb":6716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.9","version":"54'102","reported_seq":790,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.960171+0000","last_change":"2024-09-21T22:16:05.936175+0000","last_active":"2024-09-21T22:16:08.960171+0000","last_peered":"2024-09-21T22:16:08.960171+0000","last_clean":"2024-09-21T22:16:08.960171+0000","last_became_active":"2024-09-21T22:15:36.554061+0000","last_became_peered":"2024-09-21T22:15:36.554061+0000","last_unstale":"2024-09-21T22:16:08.960171+0000","last_undegraded":"2024-09-21T22:16:08.960171+0000","last_fullsized":"2024-09-21T22:16:08.960171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:43:07.810366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046970099999999999,"stat_sum":{"num_bytes":14773774,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1109,"num_read_kb":8276,"num_write":199,"num_write_kb":8044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.a","version":"54'48","reported_seq":374,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.298926+0000","last_change":"2024-09-21T22:16:06.073587+0000","last_active":"2024-09-21T22:16:09.298926+0000","last_peered":"2024-09-21T22:16:09.298926+0000","last_clean":"2024-09-21T22:16:09.298926+0000","last_became_active":"2024-09-21T22:15:36.449394+0000","last_became_peered":"2024-09-21T22:15:36.449394+0000","last_unstale":"2024-09-21T22:16:09.298926+0000","last_undegraded":"2024-09-21T22:16:09.298926+0000","last_fullsized":"2024-09-21T22:16:09.298926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:55:06.615448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335268,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":284,"num_read_kb":2255,"num_write":79,"num_write_kb":2943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.b","version":"53'301","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T22:16:08.004300+0000","last_change":"2024-09-21T22:16:05.937117+0000","last_active":"2024-09-21T22:16:08.004300+0000","last_peered":"2024-09-21T22:16:08.004300+0000","last_clean":"2024-09-21T22:16:08.004300+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:16:08.004300+0000","last_undegraded":"2024-09-21T22:16:08.004300+0000","last_fullsized":"2024-09-21T22:16:08.004300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:57:01.721276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015004580000000001,"stat_sum":{"num_bytes":4004109,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1365,"num_read_kb":4792,"num_write":529,"num_write_kb":5630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.c","version":"52'20","reported_seq":313,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.078790+0000","last_change":"2024-09-21T22:16:06.079170+0000","last_active":"2024-09-21T22:16:09.078790+0000","last_peered":"2024-09-21T22:16:09.078790+0000","last_clean":"2024-09-21T22:16:09.078790+0000","last_became_active":"2024-09-21T22:16:00.921657+0000","last_became_peered":"2024-09-21T22:16:00.921657+0000","last_unstale":"2024-09-21T22:16:09.078790+0000","last_undegraded":"2024-09-21T22:16:09.078790+0000","last_fullsized":"2024-09-21T22:16:09.078790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:54.262073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040598000000000001,"stat_sum":{"num_bytes":4111397,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":4057,"num_write":21,"num_write_kb":1717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.d","version":"54'118","reported_seq":464,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.112849+0000","last_change":"2024-09-21T22:16:05.943477+0000","last_active":"2024-09-21T22:16:09.112849+0000","last_peered":"2024-09-21T22:16:09.112849+0000","last_clean":"2024-09-21T22:16:09.112849+0000","last_became_active":"2024-09-21T22:15:36.450576+0000","last_became_peered":"2024-09-21T22:15:36.450576+0000","last_unstale":"2024-09-21T22:16:09.112849+0000","last_undegraded":"2024-09-21T22:16:09.112849+0000","last_fullsized":"2024-09-21T22:16:09.112849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:41:40.085268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070278699999999996,"stat_sum":{"num_bytes":14614528,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":7271,"num_write":230,"num_write_kb":7263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.e","version":"54'48","reported_seq":285,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.111234+0000","last_change":"2024-09-21T22:16:05.943196+0000","last_active":"2024-09-21T22:16:09.111234+0000","last_peered":"2024-09-21T22:16:09.111234+0000","last_clean":"2024-09-21T22:16:09.111234+0000","last_became_active":"2024-09-21T22:15:36.452314+0000","last_became_peered":"2024-09-21T22:15:36.452314+0000","last_unstale":"2024-09-21T22:16:09.111234+0000","last_undegraded":"2024-09-21T22:16:09.111234+0000","last_fullsized":"2024-09-21T22:16:09.111234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:33:38.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060244499999999996,"stat_sum":{"num_bytes":10272730,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":2363,"num_write":122,"num_write_kb":4622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.f","version":"54'104","reported_seq":450,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.299541+0000","last_change":"2024-09-21T22:16:05.943257+0000","last_active":"2024-09-21T22:16:09.299541+0000","last_peered":"2024-09-21T22:16:09.299541+0000","last_clean":"2024-09-21T22:16:09.299541+0000","last_became_active":"2024-09-21T22:15:36.452701+0000","last_became_peered":"2024-09-21T22:15:36.452701+0000","last_unstale":"2024-09-21T22:16:09.299541+0000","last_undegraded":"2024-09-21T22:16:09.299541+0000","last_fullsized":"2024-09-21T22:16:09.299541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:57:33.477527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062509999999999996,"stat_sum":{"num_bytes":13577521,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":361,"num_read_kb":6679,"num_write":209,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.10","version":"52'67","reported_seq":580,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.218861+0000","last_change":"2024-09-21T22:16:06.073573+0000","last_active":"2024-09-21T22:16:09.218861+0000","last_peered":"2024-09-21T22:16:09.218861+0000","last_clean":"2024-09-21T22:16:09.218861+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:16:09.218861+0000","last_undegraded":"2024-09-21T22:16:09.218861+0000","last_fullsized":"2024-09-21T22:16:09.218861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:28:47.469717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032577799999999998,"stat_sum":{"num_bytes":10377952,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":398,"num_read_kb":9397,"num_write":112,"num_write_kb":3421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.11","version":"52'49","reported_seq":604,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.111054+0000","last_change":"2024-09-21T22:16:05.942920+0000","last_active":"2024-09-21T22:16:09.111054+0000","last_peered":"2024-09-21T22:16:09.111054+0000","last_clean":"2024-09-21T22:16:09.111054+0000","last_became_active":"2024-09-21T22:15:36.451421+0000","last_became_peered":"2024-09-21T22:15:36.451421+0000","last_unstale":"2024-09-21T22:16:09.111054+0000","last_undegraded":"2024-09-21T22:16:09.111054+0000","last_fullsized":"2024-09-21T22:16:09.111054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:49:02.370643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039418299999999999,"stat_sum":{"num_bytes":9045077,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":436,"num_read_kb":7098,"num_write":72,"num_write_kb":7189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.12","version":"54'204","reported_seq":755,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.240440+0000","last_change":"2024-09-21T22:16:05.937684+0000","last_active":"2024-09-21T22:16:09.240440+0000","last_peered":"2024-09-21T22:16:09.240440+0000","last_clean":"2024-09-21T22:16:09.240440+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:16:09.240440+0000","last_undegraded":"2024-09-21T22:16:09.240440+0000","last_fullsized":"2024-09-21T22:16:09.240440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:44:52.220235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085345199999999999,"stat_sum":{"num_bytes":17553859,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1229,"num_read_kb":3138,"num_write":334,"num_write_kb":8748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.13","version":"52'351","reported_seq":996,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T22:16:09.220124+0000","last_change":"2024-09-21T22:16:05.943006+0000","last_active":"2024-09-21T22:16:09.220124+0000","last_peered":"2024-09-21T22:16:09.220124+0000","last_clean":"2024-09-21T22:16:09.220124+0000","last_became_active":"2024-09-21T22:15:36.450372+0000","last_became_peered":"2024-09-21T22:15:36.450372+0000","last_unstale":"2024-09-21T22:16:09.220124+0000","last_undegraded":"2024-09-21T22:16:09.220124+0000","last_fullsized":"2024-09-21T22:16:09.220124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:56:44.892652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046043499999999998,"stat_sum":{"num_bytes":15061646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2109,"num_read_kb":18641,"num_write":582,"num_write_kb":5881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"},{"start":"8","length":"1"},{"start":"a","length":"1"},{"start":"c","length":"1"},{"start":"e","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":365994058,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":24442,"num_read_kb":271127,"num_write":6962,"num_write_kb":240707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":19591155,"num_keys_recovered":32,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":152059904,"data_stored":151095393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3819,"ondisk_log_size":3819,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48444,"kb_used_data":17256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323396,"statfs":{"total":96636764160,"available":96587157504,"internally_reserved":0,"allocated":17670144,"data_stored":17202924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":1226045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47452,"kb_used_data":16260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324388,"statfs":{"total":96636764160,"available":96588173312,"internally_reserved":0,"allocated":16650240,"data_stored":16153219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60080,"kb_used_data":24732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311760,"statfs":{"total":96636764160,"available":96575242240,"internally_reserved":0,"allocated":25325568,"data_stored":24836764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528323,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41452,"kb_used_data":13336,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94330388,"statfs":{"total":96636764160,"available":96594317312,"internally_reserved":0,"allocated":13656064,"data_stored":13122295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":28765874},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44396,"kb_used_data":13200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327444,"statfs":{"total":96636764160,"available":96591302656,"internally_reserved":0,"allocated":13516800,"data_stored":13121076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58160,"kb_used_data":26968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94313680,"statfs":{"total":96636764160,"available":96577208320,"internally_reserved":0,"allocated":27615232,"data_stored":27168397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52220,"kb_used_data":16876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319620,"statfs":{"total":96636764160,"available":96583290880,"internally_reserved":0,"allocated":17281024,"data_stored":16816550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23801856,"data_stored":23669758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26988544,"data_stored":26891538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12894208,"data_stored":12844236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13045760,"data_stored":12851682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31174656,"data_stored":31022285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17729925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":991232,"data_stored":949205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25276416,"data_stored":25136764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:16:11.666 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:16:11.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:16:11.666 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-21T22:16:11.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-21T22:16:11.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:11.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:11.746+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:11.758 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:11.759 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:11.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:11.832 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:11.832 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:11.832 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:11.831+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:11.844 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:11.844 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:11.844 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:11.845 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:11.847 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:11.848 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:11.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-21T22:16:11.851 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:11.851 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:11.867 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:11.867 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:11.888 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:11.914 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:11.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:11.930+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:11.936 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:11.936 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:11.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:11.956 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:11.956 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:11.976 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:11.976 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:12.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:12.016 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:12.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-21T22:16:12.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:12.055+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:12.065 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:12.065 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:12.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:12.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:12.157+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:12.191 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:12.191 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:12.191 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:12.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:12.194 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:12.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-21T22:16:12.221 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:12.221 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:12.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:12.236 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:12.234+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:12.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:12.334+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:12.354 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:12.357 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:12.357 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:12.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-21T22:16:12.376 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:12.376 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:12.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:12.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:12.468+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:12.509 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:12.509 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:12.509 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:12.509 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:12.509 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:12.510 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:12.510 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:12.510 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:12.510 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:12.510 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:12.510 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:12.510 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:12.512 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:12.513 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:12.513 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-21T22:16:12.532 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:12.532 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:12.542 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:12.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:12.539+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:12.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:12.636+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:12.658 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:12.658 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:12.663 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:12.665 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:12.665 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:12.665 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-21T22:16:12.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:12.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:12.747+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:12.771 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:12.771 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:12.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:12.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:12.840 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:12.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-21T22:16:12.841 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:12.838+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:12.885 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:12.885 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:12.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:12.941 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:12.939+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:12.945 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-21T22:16:12.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:16:13.005 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.005 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:no valid command found; 10 closest matches: 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:0 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:1 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:2 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:abort 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:assert 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:bench [] [] [] [] 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs files list 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:bluefs stats 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:bluestore allocator dump block 2024-09-21T22:16:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: invalid command 2024-09-21T22:16:13.042 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:13.040+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:13.042 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:16:13.043 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:16:13.121 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.121 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:13.143 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:13.141+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:13.223 INFO:teuthology.orchestra.run.smithi134.stdout:1796 read 0x139aa62 thru 0x139f425 (0x49c4 bytes) 2024-09-21T22:16:13.226 INFO:teuthology.orchestra.run.smithi134.stdout:1797 trunc from 0x3ecb02b to 0x6bde47b 2024-09-21T22:16:13.233 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.233 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.234 INFO:teuthology.orchestra.run.smithi134.stdout:1798 write 0x647b4f5 thru 0x64893bc (0xdec8 bytes) 2024-09-21T22:16:13.236 INFO:teuthology.orchestra.run.smithi134.stdout:1799 read 0x54f10bc thru 0x54f1395 (0x2da bytes) 2024-09-21T22:16:13.237 INFO:teuthology.orchestra.run.smithi134.stdout:1800 punch from 0x490ca44 to 0x4913a22, (0x6fde bytes) 2024-09-21T22:16:13.242 INFO:teuthology.orchestra.run.smithi134.stdout:1801 write 0x6ed7780 thru 0x6ee0562 (0x8de3 bytes) 2024-09-21T22:16:13.243 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:13.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:13.241+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:13.258 INFO:teuthology.orchestra.run.smithi134.stdout:1802 write 0xeaed595 thru 0xeaf6040 (0x8aac bytes) 2024-09-21T22:16:13.265 INFO:teuthology.orchestra.run.smithi134.stdout:1803 trunc from 0xeaf6041 to 0xb43e550 2024-09-21T22:16:13.274 INFO:teuthology.orchestra.run.smithi134.stdout:1804 write 0x3d48da4 thru 0x3d58adc (0xfd39 bytes) 2024-09-21T22:16:13.275 INFO:teuthology.orchestra.run.smithi134.stdout:1806 write 0x95e0833 thru 0x95ead16 (0xa4e4 bytes) 2024-09-21T22:16:13.278 INFO:teuthology.orchestra.run.smithi134.stdout:1807 write 0x382914b thru 0x3833b99 (0xaa4f bytes) 2024-09-21T22:16:13.279 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.292 INFO:teuthology.orchestra.run.smithi134.stdout:1809 trunc from 0xb43e550 to 0x563095 2024-09-21T22:16:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:1810 punch from 0x334c3 to 0x39952, (0x648f bytes) 2024-09-21T22:16:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.319 INFO:teuthology.orchestra.run.smithi134.stdout:1813 write 0x1bbab4d thru 0x1bc0d0f (0x61c3 bytes) 2024-09-21T22:16:13.320 INFO:teuthology.orchestra.run.smithi134.stdout:1815 read 0x278419 thru 0x287f5c (0xfb44 bytes) 2024-09-21T22:16:13.341 INFO:teuthology.orchestra.run.smithi134.stdout:1816 write 0xd28df6e thru 0xd29071a (0x27ad bytes) 2024-09-21T22:16:13.344 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:13.342+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:13.351 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.351 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.353 INFO:teuthology.orchestra.run.smithi134.stdout:1817 writesame 0xe39ca02 thru 0xe3a52dd data_size 0x26(0x88dc bytes) 2024-09-21T22:16:13.353 INFO:teuthology.orchestra.run.smithi134.stdout:1818 writesame 0x4a776f6 thru 0x4a7ca79 data_size 0xa(0x5384 bytes) 2024-09-21T22:16:13.356 INFO:teuthology.orchestra.run.smithi134.stdout:1819 read 0x98fb5ed thru 0x990886e (0xd282 bytes) 2024-09-21T22:16:13.356 INFO:teuthology.orchestra.run.smithi134.stdout:1821 write 0x798b87d thru 0x79961b1 (0xa935 bytes) 2024-09-21T22:16:13.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:13.372 INFO:teuthology.orchestra.run.smithi134.stdout:1824 trunc from 0xe3a52de to 0x35fc19d 2024-09-21T22:16:13.390 INFO:teuthology.orchestra.run.smithi134.stdout:1825 read 0x1e92914 thru 0x1e95935 (0x3022 bytes) 2024-09-21T22:16:13.399 INFO:teuthology.orchestra.run.smithi134.stdout:1826 writesame 0x46fa30f thru 0x47056fd data_size 0x1(0xb3ef bytes) 2024-09-21T22:16:13.400 INFO:teuthology.orchestra.run.smithi134.stdout:1827 writesame 0x38f59f5 thru 0x38fd8e1 data_size 0x1(0x7eed bytes) 2024-09-21T22:16:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:1828 read 0x15127d0 thru 0x1519ee4 (0x7715 bytes) 2024-09-21T22:16:13.418 INFO:teuthology.orchestra.run.smithi134.stdout:1830 writesame 0x728d46 thru 0x73303d data_size 0x1(0xa2f8 bytes) 2024-09-21T22:16:13.438 INFO:teuthology.orchestra.run.smithi134.stdout:1831 write 0x607d5c thru 0x60a62a (0x28cf bytes) 2024-09-21T22:16:13.445 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:13.443+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:13.445 INFO:teuthology.orchestra.run.smithi134.stdout:1832 trunc from 0x47056fe to 0x9217a3b 2024-09-21T22:16:13.452 INFO:teuthology.orchestra.run.smithi134.stdout:1834 read 0x11702ec thru 0x1171af0 (0x1805 bytes) 2024-09-21T22:16:13.455 INFO:teuthology.orchestra.run.smithi134.stdout:1836 trunc from 0x9217a3b to 0x6897ecb 2024-09-21T22:16:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:1837 punch from 0x4f59381 to 0x4f5a4ba, (0x1139 bytes) 2024-09-21T22:16:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:1838 trunc from 0x6897ecb to 0x3b6a797 2024-09-21T22:16:13.474 INFO:teuthology.orchestra.run.smithi134.stdout:1839 read 0x3514f11 thru 0x351c331 (0x7421 bytes) 2024-09-21T22:16:13.474 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.474 INFO:teuthology.orchestra.run.smithi134.stdout:1842 read 0x102489e thru 0x102db1d (0x9280 bytes) 2024-09-21T22:16:13.484 INFO:teuthology.orchestra.run.smithi134.stdout:1844 write 0x709280f thru 0x7093cad (0x149f bytes) 2024-09-21T22:16:13.486 INFO:teuthology.orchestra.run.smithi134.stdout:1845 writesame 0x27eae79 thru 0x27ec970 data_size 0x1(0x1af8 bytes) 2024-09-21T22:16:13.490 INFO:teuthology.orchestra.run.smithi134.stdout:1846 read 0x6a7dd78 thru 0x6a8504f (0x72d8 bytes) 2024-09-21T22:16:13.500 INFO:teuthology.orchestra.run.smithi134.stdout:1847 write 0x986f70a thru 0x987a5ad (0xaea4 bytes) 2024-09-21T22:16:13.510 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.510 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.513 INFO:teuthology.orchestra.run.smithi134.stdout:1848 trunc from 0x987a5ae to 0x24ce8ae 2024-09-21T22:16:13.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:13.524 INFO:teuthology.orchestra.run.smithi134.stdout:1849 read 0xd65d2c thru 0xd6cf5f (0x7234 bytes) 2024-09-21T22:16:13.524 INFO:teuthology.orchestra.run.smithi134.stdout:1850 writesame 0x1be9dbe thru 0x1beb688 data_size 0x1(0x18cb bytes) 2024-09-21T22:16:13.528 INFO:teuthology.orchestra.run.smithi134.stdout:1851 punch from 0x15efabc to 0x15fb6d9, (0xbc1d bytes) 2024-09-21T22:16:13.529 INFO:teuthology.orchestra.run.smithi134.stdout:1854 trunc from 0x24ce8ae to 0x12f6174 2024-09-21T22:16:13.546 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:13.544+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:13.552 INFO:teuthology.orchestra.run.smithi134.stdout:1856 writesame 0x8e3e996 thru 0x8e48a95 data_size 0x40(0xa100 bytes) 2024-09-21T22:16:13.667 INFO:teuthology.orchestra.run.smithi134.stdout:1858 punch from 0xa9ed23 to 0xaa9e52, (0xb12f bytes) 2024-09-21T22:16:13.668 INFO:teuthology.orchestra.run.smithi134.stdout:1860 punch from 0x9d8b60 to 0x9de424, (0x58c4 bytes) 2024-09-21T22:16:13.668 INFO:teuthology.orchestra.run.smithi134.stdout:1861 write 0x16dc72a thru 0x16e8c41 (0xc518 bytes) 2024-09-21T22:16:13.670 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.670 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.670 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:13.670 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:13.667+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:13.671 INFO:teuthology.orchestra.run.smithi134.stdout:1862 write 0xddbc33f thru 0xddc920b (0xcecd bytes) 2024-09-21T22:16:13.671 INFO:teuthology.orchestra.run.smithi134.stdout:1863 writesame 0xdb5fcf1 thru 0xdb66424 data_size 0xa(0x6734 bytes) 2024-09-21T22:16:13.671 INFO:teuthology.orchestra.run.smithi134.stdout:1864 trunc from 0xddc920c to 0x1a3a164 2024-09-21T22:16:13.671 INFO:teuthology.orchestra.run.smithi134.stdout:1865 trunc from 0x1a3a164 to 0x1344f10 2024-09-21T22:16:13.671 INFO:teuthology.orchestra.run.smithi134.stdout:1866 read 0x1317b24 thru 0x1320c54 (0x9131 bytes) 2024-09-21T22:16:13.671 INFO:teuthology.orchestra.run.smithi134.stdout:1867 write 0x2aedf43 thru 0x2af7717 (0x97d5 bytes) 2024-09-21T22:16:13.671 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.672 INFO:teuthology.orchestra.run.smithi134.stdout:1870 punch from 0xadd8cf to 0xae319e, (0x58cf bytes) 2024-09-21T22:16:13.672 INFO:teuthology.orchestra.run.smithi134.stdout:1871 write 0x988eccd thru 0x989904e (0xa382 bytes) 2024-09-21T22:16:13.672 INFO:teuthology.orchestra.run.smithi134.stdout:1872 write 0x28b9e3c thru 0x28c7252 (0xd417 bytes) 2024-09-21T22:16:13.672 INFO:teuthology.orchestra.run.smithi134.stdout:1873 read 0x34b8cf5 thru 0x34ba89d (0x1ba9 bytes) 2024-09-21T22:16:13.672 INFO:teuthology.orchestra.run.smithi134.stdout:1875 trunc from 0x989904f to 0x14889c7 2024-09-21T22:16:13.684 INFO:teuthology.orchestra.run.smithi134.stdout:1876 write 0x8beb48f thru 0x8bf5aa6 (0xa618 bytes) 2024-09-21T22:16:13.687 INFO:teuthology.orchestra.run.smithi134.stdout:1877 read 0x2ae2215 thru 0x2aec5b5 (0xa3a1 bytes) 2024-09-21T22:16:13.688 INFO:teuthology.orchestra.run.smithi134.stdout:1878 read 0x5526ea5 thru 0x552ef95 (0x80f1 bytes) 2024-09-21T22:16:13.688 INFO:teuthology.orchestra.run.smithi134.stdout:1881 writesame 0x691239e thru 0x6921b85 data_size 0x4(0xf7e8 bytes) 2024-09-21T22:16:13.694 INFO:teuthology.orchestra.run.smithi134.stdout:1884 read 0x7a665cc thru 0x7a6d93d (0x7372 bytes) 2024-09-21T22:16:13.700 INFO:teuthology.orchestra.run.smithi134.stdout:1885 trunc from 0x8bf5aa7 to 0xd1f810e 2024-09-21T22:16:13.705 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.706 INFO:teuthology.orchestra.run.smithi134.stdout:1888 read 0x98cbee0 thru 0x98ce180 (0x22a1 bytes) 2024-09-21T22:16:13.715 INFO:teuthology.orchestra.run.smithi134.stdout:1889 trunc from 0xd1f810e to 0x5b2f698 2024-09-21T22:16:13.729 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.741 INFO:teuthology.orchestra.run.smithi134.stdout:1891 writesame 0x9b0d2bd thru 0x9b17d44 data_size 0x44(0xaa88 bytes) 2024-09-21T22:16:13.741 INFO:teuthology.orchestra.run.smithi134.stdout:1892 write 0x62b327a thru 0x62b5f57 (0x2cde bytes) 2024-09-21T22:16:13.742 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.750 INFO:teuthology.orchestra.run.smithi134.stdout:1895 writesame 0xbab5d58 thru 0xbabfae3 data_size 0x6(0x9d8c bytes) 2024-09-21T22:16:13.762 INFO:teuthology.orchestra.run.smithi134.stdout:1896 trunc from 0xbabfae4 to 0x1aa07cc 2024-09-21T22:16:13.770 INFO:teuthology.orchestra.run.smithi134.stdout:1897 read 0x1643b85 thru 0x16518f4 (0xdd70 bytes) 2024-09-21T22:16:13.770 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:13.768+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:13.771 INFO:teuthology.orchestra.run.smithi134.stdout:1899 read 0x166003 thru 0x173318 (0xd316 bytes) 2024-09-21T22:16:13.771 INFO:teuthology.orchestra.run.smithi134.stdout:1900 read 0xc87605 thru 0xc946e5 (0xd0e1 bytes) 2024-09-21T22:16:13.779 INFO:teuthology.orchestra.run.smithi134.stdout:1902 write 0x29a3c95 thru 0x29a4513 (0x87f bytes) 2024-09-21T22:16:13.780 INFO:teuthology.orchestra.run.smithi134.stdout:1904 trunc from 0x29a4514 to 0x2f20e25 2024-09-21T22:16:13.785 INFO:teuthology.orchestra.run.smithi134.stdout:1907 read 0x1f85276 thru 0x1f873cd (0x2158 bytes) 2024-09-21T22:16:13.793 INFO:teuthology.orchestra.run.smithi134.stdout:1908 write 0x5540e19 thru 0x5549ded (0x8fd5 bytes) 2024-09-21T22:16:13.795 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.797 INFO:teuthology.orchestra.run.smithi134.stdout:1910 trunc from 0x5549dee to 0x78c5fd8 2024-09-21T22:16:13.802 INFO:teuthology.orchestra.run.smithi134.stdout:1911 punch from 0x2089aeb to 0x208ebc3, (0x50d8 bytes) 2024-09-21T22:16:13.814 INFO:teuthology.orchestra.run.smithi134.stdout:1912 writesame 0xbb46c05 thru 0xbb496bb data_size 0x9(0x2ab7 bytes) 2024-09-21T22:16:13.814 INFO:teuthology.orchestra.run.smithi134.stdout:1914 read 0xa33d63e thru 0xa343d8b (0x674e bytes) 2024-09-21T22:16:13.814 INFO:teuthology.orchestra.run.smithi134.stdout:1915 punch from 0x1fdc664 to 0x1feb8fc, (0xf298 bytes) 2024-09-21T22:16:13.814 INFO:teuthology.orchestra.run.smithi134.stdout:1916 read 0x6ab9694 thru 0x6abd0b6 (0x3a23 bytes) 2024-09-21T22:16:13.814 INFO:teuthology.orchestra.run.smithi134.stdout:1919 writesame 0x6d56588 thru 0x6d64d6a data_size 0x1(0xe7e3 bytes) 2024-09-21T22:16:13.817 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.817 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:13.836 INFO:teuthology.orchestra.run.smithi134.stdout:1920 write 0xed15d8 thru 0xedf837 (0xe260 bytes) 2024-09-21T22:16:13.837 INFO:teuthology.orchestra.run.smithi134.stdout:1921 write 0xb83fd56 thru 0xb840965 (0xc10 bytes) 2024-09-21T22:16:13.841 INFO:teuthology.orchestra.run.smithi134.stdout:1922 read 0x5bfb335 thru 0x5bfb3db (0xa7 bytes) 2024-09-21T22:16:13.841 INFO:teuthology.orchestra.run.smithi134.stdout:1923 read 0x7188b01 thru 0x718a597 (0x1a97 bytes) 2024-09-21T22:16:13.848 INFO:teuthology.orchestra.run.smithi134.stdout:1924 trunc from 0xbb496bc to 0x5dcd921 2024-09-21T22:16:13.860 INFO:teuthology.orchestra.run.smithi134.stdout:1925 read 0x2f0426a thru 0x2f0b5d9 (0x7370 bytes) 2024-09-21T22:16:13.860 INFO:teuthology.orchestra.run.smithi134.stdout:1928 read 0x7a4f2d thru 0x7b4808 (0xf8dc bytes) 2024-09-21T22:16:13.861 INFO:teuthology.orchestra.run.smithi134.stdout:1929 write 0x4e5c377 thru 0x4e66673 (0xa2fd bytes) 2024-09-21T22:16:13.862 INFO:teuthology.orchestra.run.smithi134.stdout:1930 write 0x28fbd5c thru 0x2906715 (0xa9ba bytes) 2024-09-21T22:16:13.864 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:13.871 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:13.869+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:13.873 INFO:teuthology.orchestra.run.smithi134.stdout:1932 trunc from 0x5dcd921 to 0xdc58369 2024-09-21T22:16:13.878 INFO:teuthology.orchestra.run.smithi134.stdout:1933 punch from 0x9757d05 to 0x975ff45, (0x8240 bytes) 2024-09-21T22:16:13.893 INFO:teuthology.orchestra.run.smithi134.stdout:1935 trunc from 0xdc58369 to 0x17a6b7d 2024-09-21T22:16:13.901 INFO:teuthology.orchestra.run.smithi134.stdout:1936 read 0x531fe6 thru 0x537366 (0x5381 bytes) 2024-09-21T22:16:13.901 INFO:teuthology.orchestra.run.smithi134.stdout:1937 read 0x13bba48 thru 0x13c3ccc (0x8285 bytes) 2024-09-21T22:16:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:1939 write 0x3ac93c1 thru 0x3acd1a2 (0x3de2 bytes) 2024-09-21T22:16:13.917 INFO:teuthology.orchestra.run.smithi134.stdout:1942 write 0x44b1e11 thru 0x44c0675 (0xe865 bytes) 2024-09-21T22:16:13.918 INFO:teuthology.orchestra.run.smithi134.stdout:1946 punch from 0x30ecb31 to 0x30f414d, (0x761c bytes) 2024-09-21T22:16:13.930 INFO:teuthology.orchestra.run.smithi134.stdout:1947 writesame 0x996b7b7 thru 0x996f2fb data_size 0x1(0x3b45 bytes) 2024-09-21T22:16:13.930 INFO:teuthology.orchestra.run.smithi134.stdout:1948 write 0x334330e thru 0x334c3c5 (0x90b8 bytes) 2024-09-21T22:16:13.931 INFO:teuthology.orchestra.run.smithi134.stdout:1951 punch from 0x2e4edd to 0x2f4bbb, (0xfcde bytes) 2024-09-21T22:16:13.934 INFO:teuthology.orchestra.run.smithi134.stdout:1954 trunc from 0x996f2fc to 0x756f897 2024-09-21T22:16:13.936 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:13.936 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:13.944 INFO:teuthology.orchestra.run.smithi134.stdout:1955 trunc from 0x756f897 to 0x9dfe916 2024-09-21T22:16:13.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:13.955 INFO:teuthology.orchestra.run.smithi134.stdout:1956 writesame 0xa69c0be thru 0xa6a4d43 data_size 0x1(0x8c86 bytes) 2024-09-21T22:16:13.955 INFO:teuthology.orchestra.run.smithi134.stdout:1957 read 0x9914a9a thru 0x992046a (0xb9d1 bytes) 2024-09-21T22:16:13.955 INFO:teuthology.orchestra.run.smithi134.stdout:1958 write 0x6f1f9b3 thru 0x6f25a56 (0x60a4 bytes) 2024-09-21T22:16:13.967 INFO:teuthology.orchestra.run.smithi134.stdout:1959 trunc from 0xa6a4d44 to 0x1cefec2 2024-09-21T22:16:13.984 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:16:13.989 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:13.987+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:13.992 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:13.998 INFO:teuthology.orchestra.run.smithi134.stdout:1960 writesame 0xdcf2f65 thru 0xdcfb934 data_size 0xa8(0x89d0 bytes) 2024-09-21T22:16:13.998 INFO:teuthology.orchestra.run.smithi134.stdout:1962 read 0x64bf532 thru 0x64c9608 (0xa0d7 bytes) 2024-09-21T22:16:14.007 INFO:teuthology.orchestra.run.smithi134.stdout:1963 trunc from 0xdcfb935 to 0x7e99fd2 2024-09-21T22:16:14.013 INFO:teuthology.orchestra.run.smithi134.stdout:1964 writesame 0x5e5e0a0 thru 0x5e60726 data_size 0x1(0x2687 bytes) 2024-09-21T22:16:14.019 INFO:teuthology.orchestra.run.smithi134.stdout:1965 writesame 0x5a66a35 thru 0x5a75c27 data_size 0x1(0xf1f3 bytes) 2024-09-21T22:16:14.053 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:14.053 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:14.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:14.066 INFO:teuthology.orchestra.run.smithi134.stdout:1966 write 0xe5cd640 thru 0xe5d5529 (0x7eea bytes) 2024-09-21T22:16:14.069 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.069 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.069 INFO:teuthology.orchestra.run.smithi134.stdout:1970 writesame 0x2677e32 thru 0x267b82d data_size 0x6(0x39fc bytes) 2024-09-21T22:16:14.072 INFO:teuthology.orchestra.run.smithi134.stdout:1971 writesame 0xe42c4c5 thru 0xe43c179 data_size 0x1(0xfcb5 bytes) 2024-09-21T22:16:14.104 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:14.102+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:14.104 INFO:teuthology.orchestra.run.smithi134.stdout:1972 write 0x61546dd thru 0x6160112 (0xba36 bytes) 2024-09-21T22:16:14.106 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.107 INFO:teuthology.orchestra.run.smithi134.stdout:1974 write 0x509b1e thru 0x515e9e (0xc381 bytes) 2024-09-21T22:16:14.108 INFO:teuthology.orchestra.run.smithi134.stdout:1975 writesame 0x4eac7d6 thru 0x4eb0139 data_size 0x2(0x3964 bytes) 2024-09-21T22:16:14.123 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:14.123 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:14.126 INFO:teuthology.orchestra.run.smithi134.stdout:1976 trunc from 0xe5d552a to 0x29ad05c 2024-09-21T22:16:14.140 INFO:teuthology.orchestra.run.smithi134.stdout:1977 write 0x195438 thru 0x1a3258 (0xde21 bytes) 2024-09-21T22:16:14.142 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.145 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:14.145 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:14.154 INFO:teuthology.orchestra.run.smithi134.stdout:1980 writesame 0x7302a64 thru 0x7303c1e data_size 0x11(0x11bb bytes) 2024-09-21T22:16:14.154 INFO:teuthology.orchestra.run.smithi134.stdout:1981 punch from 0x256475 to 0x266013, (0xfb9e bytes) 2024-09-21T22:16:14.161 INFO:teuthology.orchestra.run.smithi134.stdout:1982 trunc from 0x7303c1f to 0x7cba32 2024-09-21T22:16:14.164 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:14.164 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:14.173 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:14.171+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:14.183 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:14.183 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28980 3.b 3:d25d5696:::rbd_header.1185b6e976dc:head [call rbd.set_size in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.182831+0000", 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000110877, 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000136537, 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.184 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28980 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182831+0000", 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182831+0000", 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182832+0000", 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7599999999999996e-07 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182836+0000", 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182845+0000", 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6479999999999992e-06 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182850+0000", 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9799999999999998e-06 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182903+0000", 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2633999999999998e-05 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.182968+0000", 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5677000000000002e-05 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.188 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:14.188 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-09-21T22:16:14.188 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:14.188 INFO:teuthology.orchestra.run.smithi134.stdout:1983 write 0xa66ba40 thru 0xa670f3d (0x54fe bytes) 2024-09-21T22:16:14.190 INFO:teuthology.orchestra.run.smithi134.stdout:1984 read 0x2ee2e19 thru 0x2ee75c7 (0x47af bytes) 2024-09-21T22:16:14.190 INFO:teuthology.orchestra.run.smithi134.stdout:1985 read 0x29a466c thru 0x29b4345 (0xfcda bytes) 2024-09-21T22:16:14.190 INFO:teuthology.orchestra.run.smithi134.stdout:1986 write 0x605a4dd thru 0x606138d (0x6eb1 bytes) 2024-09-21T22:16:14.192 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.192 INFO:teuthology.orchestra.run.smithi134.stdout:1989 read 0xa1dd233 thru 0xa1ec18a (0xef58 bytes) 2024-09-21T22:16:14.192 INFO:teuthology.orchestra.run.smithi134.stdout:1990 write 0x7454b2a thru 0x745e380 (0x9857 bytes) 2024-09-21T22:16:14.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:14.195 INFO:teuthology.orchestra.run.smithi134.stdout:1991 writesame 0x25e22a9 thru 0x25f07bc data_size 0x12(0xe514 bytes) 2024-09-21T22:16:14.197 INFO:teuthology.orchestra.run.smithi134.stdout:1992 read 0x8f158cf thru 0x8f20318 (0xaa4a bytes) 2024-09-21T22:16:14.197 INFO:teuthology.orchestra.run.smithi134.stdout:1993 write 0x3fa891f thru 0x3fb2a32 (0xa114 bytes) 2024-09-21T22:16:14.199 INFO:teuthology.orchestra.run.smithi134.stdout:1994 writesame 0x3ed4b76 thru 0x3ede7f3 data_size 0x21(0x9c7e bytes) 2024-09-21T22:16:14.200 INFO:teuthology.orchestra.run.smithi134.stdout:1995 writesame 0x6252a30 thru 0x62614b8 data_size 0x1(0xea89 bytes) 2024-09-21T22:16:14.202 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:14.202 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:14.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:14.221 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:14.227 INFO:teuthology.orchestra.run.smithi134.stdout:1996 read 0x2a97951 thru 0x2aa23fb (0xaaab bytes) 2024-09-21T22:16:14.227 INFO:teuthology.orchestra.run.smithi134.stdout:1999 read 0x405639c thru 0x405cc2e (0x6893 bytes) 2024-09-21T22:16:14.228 INFO:teuthology.orchestra.run.smithi134.stdout:2000 write 0x4a30e56 thru 0x4a33e4d (0x2ff8 bytes) 2024-09-21T22:16:14.238 INFO:teuthology.orchestra.run.smithi134.stdout:2001 write 0xcb5ca28 thru 0xcb6866f (0xbc48 bytes) 2024-09-21T22:16:14.240 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:14.240 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:14.243 INFO:teuthology.orchestra.run.smithi134.stdout:2002 write 0xa44407d thru 0xa4521a3 (0xe127 bytes) 2024-09-21T22:16:14.246 INFO:teuthology.orchestra.run.smithi134.stdout:2004 read 0x929dd42 thru 0x92a1bc6 (0x3e85 bytes) 2024-09-21T22:16:14.247 INFO:teuthology.orchestra.run.smithi134.stdout:2005 read 0x9a4bc5f thru 0x9a4f504 (0x38a6 bytes) 2024-09-21T22:16:14.254 INFO:teuthology.orchestra.run.smithi134.stdout:2006 write 0xe07041c thru 0xe07ad54 (0xa939 bytes) 2024-09-21T22:16:14.260 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:14.260 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:14.274 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:14.272+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:14.275 INFO:teuthology.orchestra.run.smithi134.stdout:2007 trunc from 0xe07ad55 to 0x1a6eaf6 2024-09-21T22:16:14.291 INFO:teuthology.orchestra.run.smithi134.stdout:2009 read 0x66f58d thru 0x67f3a8 (0xfe1c bytes) 2024-09-21T22:16:14.302 INFO:teuthology.orchestra.run.smithi134.stdout:2011 write 0x425c2f6 thru 0x4266784 (0xa48f bytes) 2024-09-21T22:16:14.303 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.303 INFO:teuthology.orchestra.run.smithi134.stdout:2014 read 0x268f92e thru 0x269a171 (0xa844 bytes) 2024-09-21T22:16:14.314 INFO:teuthology.orchestra.run.smithi134.stdout:2016 write 0x67f26f1 thru 0x67f5408 (0x2d18 bytes) 2024-09-21T22:16:14.323 INFO:teuthology.orchestra.run.smithi134.stdout:2019 trunc from 0x67f5409 to 0xb94a80e 2024-09-21T22:16:14.328 INFO:teuthology.orchestra.run.smithi134.stdout:2021 read 0x932f265 thru 0x933a2e8 (0xb084 bytes) 2024-09-21T22:16:14.329 INFO:teuthology.orchestra.run.smithi134.stdout:2022 trunc from 0xb94a80e to 0xb10c7ec 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout:2023 punch from 0x32949e9 to 0x329a7f1, (0x5e08 bytes) 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout:2024 read 0x2c06ed5 thru 0x2c10613 (0x973f bytes) 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:14.335 INFO:teuthology.orchestra.run.smithi134.stdout:2025 write 0xaeedf1e thru 0xaef5617 (0x76fa bytes) 2024-09-21T22:16:14.338 INFO:teuthology.orchestra.run.smithi134.stdout:2026 punch from 0x5d77802 to 0x5d848ff, (0xd0fd bytes) 2024-09-21T22:16:14.342 INFO:teuthology.orchestra.run.smithi134.stdout:2028 trunc from 0xb10c7ec to 0xdb88d46 2024-09-21T22:16:14.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:14.349 INFO:teuthology.orchestra.run.smithi134.stdout:2029 write 0x7993486 thru 0x799a80f (0x738a bytes) 2024-09-21T22:16:14.351 INFO:teuthology.orchestra.run.smithi134.stdout:2030 punch from 0x2c6fefc to 0x2c7396a, (0x3a6e bytes) 2024-09-21T22:16:14.363 INFO:teuthology.orchestra.run.smithi134.stdout:2032 trunc from 0xdb88d46 to 0x2e5d2ad 2024-09-21T22:16:14.375 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:14.373+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:14.378 INFO:teuthology.orchestra.run.smithi134.stdout:2033 read 0x27a7a6e thru 0x27a8bd2 (0x1165 bytes) 2024-09-21T22:16:14.378 INFO:teuthology.orchestra.run.smithi134.stdout:2034 read 0x255aab thru 0x25b4d7 (0x5a2d bytes) 2024-09-21T22:16:14.391 INFO:teuthology.orchestra.run.smithi134.stdout:2036 trunc from 0x2e5d2ad to 0xcca381d 2024-09-21T22:16:14.398 INFO:teuthology.orchestra.run.smithi134.stdout:2037 punch from 0xc4610a2 to 0xc46bd8a, (0xace8 bytes) 2024-09-21T22:16:14.403 INFO:teuthology.orchestra.run.smithi134.stdout:2039 write 0xcd1b41a thru 0xcd1fbf6 (0x47dd bytes) 2024-09-21T22:16:14.406 INFO:teuthology.orchestra.run.smithi134.stdout:2041 writesame 0x7ef911e thru 0x7efd261 data_size 0x2(0x4144 bytes) 2024-09-21T22:16:14.419 INFO:teuthology.orchestra.run.smithi134.stdout:2042 write 0xd275793 thru 0xd27bf89 (0x67f7 bytes) 2024-09-21T22:16:14.423 INFO:teuthology.orchestra.run.smithi134.stdout:2043 write 0x75d584a thru 0x75e3577 (0xdd2e bytes) 2024-09-21T22:16:14.436 INFO:teuthology.orchestra.run.smithi134.stdout:2044 write 0xe20300b thru 0xe207771 (0x4767 bytes) 2024-09-21T22:16:14.439 INFO:teuthology.orchestra.run.smithi134.stdout:2047 read 0x32572f0 thru 0x3259be1 (0x28f2 bytes) 2024-09-21T22:16:14.439 INFO:teuthology.orchestra.run.smithi134.stdout:2048 writesame 0xb5a3ea thru 0xb62f86 data_size 0x1(0x8b9d bytes) 2024-09-21T22:16:14.441 INFO:teuthology.orchestra.run.smithi134.stdout:2050 read 0x6d85af4 thru 0x6d8d691 (0x7b9e bytes) 2024-09-21T22:16:14.441 INFO:teuthology.orchestra.run.smithi134.stdout:2051 write 0xa38e935 thru 0xa39b573 (0xcc3f bytes) 2024-09-21T22:16:14.444 INFO:teuthology.orchestra.run.smithi134.stdout:2052 punch from 0x8299b0d to 0x829fb77, (0x606a bytes) 2024-09-21T22:16:14.444 INFO:teuthology.orchestra.run.smithi134.stdout:2053 write 0x35c885e thru 0x35cb1b3 (0x2956 bytes) 2024-09-21T22:16:14.445 INFO:teuthology.orchestra.run.smithi134.stdout:2054 writesame 0x1608e5b thru 0x16099f5 data_size 0x1(0xb9b bytes) 2024-09-21T22:16:14.447 INFO:teuthology.orchestra.run.smithi134.stdout:2055 read 0x285e8b1 thru 0x286c54e (0xdc9e bytes) 2024-09-21T22:16:14.447 INFO:teuthology.orchestra.run.smithi134.stdout:2057 read 0xcc057fd thru 0xcc0c47e (0x6c82 bytes) 2024-09-21T22:16:14.447 INFO:teuthology.orchestra.run.smithi134.stdout:2058 read 0x64e63ab thru 0x64e82e9 (0x1f3f bytes) 2024-09-21T22:16:14.447 INFO:teuthology.orchestra.run.smithi134.stdout:2060 read 0x2ff16ce thru 0x2ffdb09 (0xc43c bytes) 2024-09-21T22:16:14.448 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.462 INFO:teuthology.orchestra.run.smithi134.stdout:2063 trunc from 0xe207772 to 0x1ccd78a 2024-09-21T22:16:14.473 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:14.473 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:14.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.561402958, 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.474 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.558780885000001, 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:14.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:14.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:14.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14146 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2733472589999995, 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015254134000000001, 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14146 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198240+0000", 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198242+0000", 2024-09-21T22:16:14.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8980000000000001e-06 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198248+0000", 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6060000000000002e-06 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198252+0000", 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1389999999999997e-06 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213293+0000", 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015041077 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213380+0000", 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6990999999999994e-05 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213494+0000", 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114071 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14147 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1867776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2733298239999993, 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015400951, 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14147 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198260+0000", 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.576e-06 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198266+0000", 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198270+0000", 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.42e-06 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213525+0000", 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015254304 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213593+0000", 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8192e-05 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213658+0000", 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-05 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.491 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14148 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1949696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.27331021, 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015536743, 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14148 2024-09-21T22:16:14.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:14.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198279+0000", 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198285+0000", 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198290+0000", 2024-09-21T22:16:14.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5759999999999999e-06 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213689+0000", 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015398719999999999 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213735+0000", 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6873999999999999e-05 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213813+0000", 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8047999999999995e-05 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14149 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2031616~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.27329179, 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015749758999999999, 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14149 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198297+0000", 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198303+0000", 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198317+0000", 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-05 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213846+0000", 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015529685 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213929+0000", 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2341000000000003e-05 2024-09-21T22:16:14.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214045+0000", 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116208 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.273263085, 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.504 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2732441909999999, 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:14.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:14.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:14.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2732210770000005, 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:14.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:14.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2725468899999992, 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14284 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3670016~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2521548790000008, 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015138125000000001, 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14284 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:14.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219432+0000", 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219434+0000", 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3769999999999999e-06 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219437+0000", 2024-09-21T22:16:14.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.507e-06 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219440+0000", 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234370+0000", 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014930399 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234449+0000", 2024-09-21T22:16:14.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8738000000000004e-05 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234570+0000", 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121018 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14285 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3751936~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2521434159999991, 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015470901, 2024-09-21T22:16:14.524 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14285 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219444+0000", 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3099999999999999e-07 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219445+0000", 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1349999999999999e-06 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219449+0000", 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9360000000000001e-06 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219453+0000", 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1629999999999998e-06 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234705+0000", 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015251740999999999 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234797+0000", 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2108000000000006e-05 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234914+0000", 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117587 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14286 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3833856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.528 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2521282800000009, 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015717103999999999, 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14286 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:14.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219461+0000", 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219467+0000", 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219471+0000", 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2640000000000002e-06 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234983+0000", 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015511680999999999 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235069+0000", 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5778000000000004e-05 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235176+0000", 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107092 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14287 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2521118950000005, 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015894090999999999, 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14287 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:14.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6800000000000002e-07 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219477+0000", 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.362e-06 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219480+0000", 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1700000000000001e-06 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219482+0000", 2024-09-21T22:16:14.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.475e-06 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235247+0000", 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015765000000000001 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235298+0000", 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0577e-05 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235369+0000", 2024-09-21T22:16:14.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1239e-05 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2521016360000008, 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2520865269999994, 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2520682329999993, 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:14.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2514114979999995, 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:14.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:14.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:15946 3.1e 3:7b0bb837:::rbd_data.11854f79dd7.000000000000001c:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0860448070000004, 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015259356999999999, 2024-09-21T22:16:14.553 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 15946 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385542+0000", 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385543+0000", 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0330000000000001e-06 2024-09-21T22:16:14.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385546+0000", 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9670000000000001e-06 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.385549+0000", 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5239999999999999e-06 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400633+0000", 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015084505 2024-09-21T22:16:14.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400695+0000", 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1203000000000003e-05 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.400801+0000", 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010691700000000001 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.557 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.27092820099999998, 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.563 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:14.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2065 trunc from 0x1ccd78a to 0xa045d62 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2069 read 0x33cbff6 thru 0x33cf08a (0x3095 bytes) 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2070 write 0xe08d624 thru 0xe095148 (0x7b25 bytes) 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2071 write 0xcad35a6 thru 0xcad63fb (0x2e56 bytes) 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2072 write 0xcb7ac24 thru 0xcb82704 (0x7ae1 bytes) 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2073 write 0x9ab59c7 thru 0x9ac546c (0xfaa6 bytes) 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2074 trunc from 0xe095149 to 0x8dbb317 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2075 writesame 0x2acf2fe thru 0x2ad67f0 data_size 0x31(0x74f3 bytes) 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.567 INFO:teuthology.orchestra.run.smithi134.stdout:2077 write 0x9947176 thru 0x9948880 (0x170b bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2079 punch from 0x56a34c to 0x5701ff, (0x5eb3 bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2080 punch from 0x1066fd to 0x10730c, (0xc0f bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2082 punch from 0x67f9953 to 0x6800e8e, (0x753b bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2083 write 0x1989ca1 thru 0x198e23c (0x459c bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2084 writesame 0x36c88c4 thru 0x36d139f data_size 0x2(0x8adc bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2085 trunc from 0x9948881 to 0x92dc0c6 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2086 read 0x8df2daa thru 0x8df443a (0x1691 bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2089 read 0x80849b7 thru 0x808ed2b (0xa375 bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2090 read 0x486186a thru 0x48631df (0x1976 bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2091 read 0x105e42f thru 0x106c32e (0xdf00 bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2093 read 0x869390a thru 0x86a02af (0xc9a6 bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:2094 read 0x3a572a6 thru 0x3a6241c (0xb177 bytes) 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.568 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.569 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:14.562+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:14.577 INFO:teuthology.orchestra.run.smithi134.stdout:2099 write 0xec54aa9 thru 0xec59e0e (0x5366 bytes) 2024-09-21T22:16:14.580 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.580 INFO:teuthology.orchestra.run.smithi134.stdout:2101 write 0xc3af684 thru 0xc3b8f48 (0x98c5 bytes) 2024-09-21T22:16:14.581 INFO:teuthology.orchestra.run.smithi134.stdout:2102 read 0xc36ff0e thru 0xc3744c9 (0x45bc bytes) 2024-09-21T22:16:14.582 INFO:teuthology.orchestra.run.smithi134.stdout:2103 read 0x66d2f35 thru 0x66d84cd (0x5599 bytes) 2024-09-21T22:16:14.582 INFO:teuthology.orchestra.run.smithi134.stdout:2104 write 0x3ab8ad6 thru 0x3ab9bd1 (0x10fc bytes) 2024-09-21T22:16:14.583 INFO:teuthology.orchestra.run.smithi134.stdout:2105 write 0x26d3eed thru 0x26d83a4 (0x44b8 bytes) 2024-09-21T22:16:14.585 INFO:teuthology.orchestra.run.smithi134.stdout:2108 read 0x2f3d67 thru 0x2f3df8 (0x92 bytes) 2024-09-21T22:16:14.585 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.590 INFO:teuthology.orchestra.run.smithi134.stdout:2110 write 0xedcd4ef thru 0xedd5eae (0x89c0 bytes) 2024-09-21T22:16:14.593 INFO:teuthology.orchestra.run.smithi134.stdout:2112 punch from 0xc9ea122 to 0xc9f9d97, (0xfc75 bytes) 2024-09-21T22:16:14.594 INFO:teuthology.orchestra.run.smithi134.stdout:2113 read 0xedcc093 thru 0xedce51d (0x248b bytes) 2024-09-21T22:16:14.596 INFO:teuthology.orchestra.run.smithi134.stdout:2114 read 0x1ea948c thru 0x1eaee25 (0x599a bytes) 2024-09-21T22:16:14.596 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.596 INFO:teuthology.orchestra.run.smithi134.stdout:2116 writesame 0x9b9c061 thru 0x9b9d1cc data_size 0xa(0x116c bytes) 2024-09-21T22:16:14.598 INFO:teuthology.orchestra.run.smithi134.stdout:2117 write 0xd273060 thru 0xd2805e2 (0xd583 bytes) 2024-09-21T22:16:14.599 INFO:teuthology.orchestra.run.smithi134.stdout:2118 writesame 0xad9d599 thru 0xada8db2 data_size 0x6(0xb81a bytes) 2024-09-21T22:16:14.620 INFO:teuthology.orchestra.run.smithi134.stdout:2119 trunc from 0xedd5eaf to 0x140c50e 2024-09-21T22:16:14.644 INFO:teuthology.orchestra.run.smithi134.stdout:2123 trunc from 0x140c50e to 0x7617a06 2024-09-21T22:16:14.652 INFO:teuthology.orchestra.run.smithi134.stdout:2124 write 0x60a1b64 thru 0x60ad3c1 (0xb85e bytes) 2024-09-21T22:16:14.653 INFO:teuthology.orchestra.run.smithi134.stdout:2126 punch from 0x626d5b to 0x62b5c9, (0x486e bytes) 2024-09-21T22:16:14.660 INFO:teuthology.orchestra.run.smithi134.stdout:2127 trunc from 0x7617a06 to 0xd564c9f 2024-09-21T22:16:14.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:14.662+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:14.666 INFO:teuthology.orchestra.run.smithi134.stdout:2128 write 0x471611d thru 0x471644a (0x32e bytes) 2024-09-21T22:16:14.667 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.667 INFO:teuthology.orchestra.run.smithi134.stdout:2130 read 0x807515a thru 0x807b0ae (0x5f55 bytes) 2024-09-21T22:16:14.667 INFO:teuthology.orchestra.run.smithi134.stdout:2131 read 0x3ef2078 thru 0x3efee98 (0xce21 bytes) 2024-09-21T22:16:14.668 INFO:teuthology.orchestra.run.smithi134.stdout:2134 writesame 0x9c4179 thru 0x9d2dad data_size 0x1(0xec35 bytes) 2024-09-21T22:16:14.696 INFO:teuthology.orchestra.run.smithi134.stdout:2135 write 0xd6b4a76 thru 0xd6bba6c (0x6ff7 bytes) 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:29394 3.18 e59/45)", 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.697302+0000", 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.2653000000000001e-05, 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6928999999999998e-05, 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:14.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.697302+0000", 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.697302+0000", 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.697303+0000", 2024-09-21T22:16:14.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1500000000000004e-07 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.697308+0000", 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2460000000000003e-06 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.697318+0000", 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0183000000000001e-05 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.697323+0000", 2024-09-21T22:16:14.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3449999999999996e-06 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:14.701 INFO:teuthology.orchestra.run.smithi134.stdout:2136 punch from 0xaae18b9 to 0xaaf182d, (0xff74 bytes) 2024-09-21T22:16:14.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:14.712 INFO:teuthology.orchestra.run.smithi134.stdout:2137 trunc from 0xd6bba6d to 0x3bc574d 2024-09-21T22:16:14.729 INFO:teuthology.orchestra.run.smithi134.stdout:2138 trunc from 0x3bc574d to 0x23367d0 2024-09-21T22:16:14.740 INFO:teuthology.orchestra.run.smithi134.stdout:2139 read 0xfe6e0d thru 0xfeef8a (0x817e bytes) 2024-09-21T22:16:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:2142 write 0x4f412f2 thru 0x4f46bdb (0x58ea bytes) 2024-09-21T22:16:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:2143 write 0x312ff97 thru 0x3135be7 (0x5c51 bytes) 2024-09-21T22:16:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:2144 punch from 0x4286c66 to 0x428b3ed, (0x4787 bytes) 2024-09-21T22:16:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:2145 read 0x43f0ddf thru 0x43fa3fc (0x961e bytes) 2024-09-21T22:16:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:2148 punch from 0x6c59d6 to 0x6c722a, (0x1854 bytes) 2024-09-21T22:16:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:2149 read 0x20a7dd3 thru 0x20af8aa (0x7ad8 bytes) 2024-09-21T22:16:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:2150 trunc from 0x4f46bdc to 0xd936977 2024-09-21T22:16:14.765 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:14.763+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:14.769 INFO:teuthology.orchestra.run.smithi134.stdout:2151 read 0x5108784 thru 0x510fff0 (0x786d bytes) 2024-09-21T22:16:14.776 INFO:teuthology.orchestra.run.smithi134.stdout:2154 write 0xe504c75 thru 0xe50a267 (0x55f3 bytes) 2024-09-21T22:16:14.779 INFO:teuthology.orchestra.run.smithi134.stdout:2155 read 0x7b71e22 thru 0x7b794d5 (0x76b4 bytes) 2024-09-21T22:16:14.793 INFO:teuthology.orchestra.run.smithi134.stdout:2156 trunc from 0xe50a268 to 0x2afae79 2024-09-21T22:16:14.807 INFO:teuthology.orchestra.run.smithi134.stdout:2157 read 0x281cca7 thru 0x28213fc (0x4756 bytes) 2024-09-21T22:16:14.808 INFO:teuthology.orchestra.run.smithi134.stdout:2158 read 0x183fbd8 thru 0x184bb31 (0xbf5a bytes) 2024-09-21T22:16:14.808 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.826 INFO:teuthology.orchestra.run.smithi134.stdout:2160 write 0xcc27db8 thru 0xcc2d425 (0x566e bytes) 2024-09-21T22:16:14.829 INFO:teuthology.orchestra.run.smithi134.stdout:2161 read 0x84b88ae thru 0x84c1fec (0x973f bytes) 2024-09-21T22:16:14.829 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.830 INFO:teuthology.orchestra.run.smithi134.stdout:2166 punch from 0xc11057 to 0xc1383f, (0x27e8 bytes) 2024-09-21T22:16:14.830 INFO:teuthology.orchestra.run.smithi134.stdout:2167 write 0x4b9f2b3 thru 0x4bad1c2 (0xdf10 bytes) 2024-09-21T22:16:14.831 INFO:teuthology.orchestra.run.smithi134.stdout:2168 read 0x78adb2a thru 0x78b1c15 (0x40ec bytes) 2024-09-21T22:16:14.831 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.831 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.831 INFO:teuthology.orchestra.run.smithi134.stdout:2172 writesame 0x85b6d01 thru 0x85c1960 data_size 0x70(0xac60 bytes) 2024-09-21T22:16:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:2173 write 0xa97c585 thru 0xa98450a (0x7f86 bytes) 2024-09-21T22:16:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:2178 read 0x3840060 thru 0x38486bf (0x8660 bytes) 2024-09-21T22:16:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:2181 read 0x1891a17 thru 0x189b293 (0x987d bytes) 2024-09-21T22:16:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:2182 write 0xe5f2eb7 thru 0xe5fb67c (0x87c6 bytes) 2024-09-21T22:16:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:14.845 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:14.846 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:14.846 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:14.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:2183 trunc from 0xe5fb67d to 0x3d1130b 2024-09-21T22:16:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:2185 write 0x2fb78ba thru 0x2fbefc2 (0x7709 bytes) 2024-09-21T22:16:14.876 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:14.874+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:2186 read 0x24374dc thru 0x2438dc1 (0x18e6 bytes) 2024-09-21T22:16:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:2188 write 0x192e8f7 thru 0x193295d (0x4067 bytes) 2024-09-21T22:16:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:2189 read 0x2a56a7 thru 0x2af24e (0x9ba8 bytes) 2024-09-21T22:16:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:2190 write 0x4fd1382 thru 0x4fd28e2 (0x1561 bytes) 2024-09-21T22:16:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:2191 writesame 0x24bdb8f thru 0x24c0af7 data_size 0x1(0x2f69 bytes) 2024-09-21T22:16:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.904 INFO:teuthology.orchestra.run.smithi134.stdout:2193 write 0x7c763f7 thru 0x7c855ce (0xf1d8 bytes) 2024-09-21T22:16:14.909 INFO:teuthology.orchestra.run.smithi134.stdout:2194 write 0x673fe62 thru 0x6740972 (0xb11 bytes) 2024-09-21T22:16:14.911 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:14.916 INFO:teuthology.orchestra.run.smithi134.stdout:2196 trunc from 0x7c855cf to 0x3393ab0 2024-09-21T22:16:14.946 INFO:teuthology.orchestra.run.smithi134.stdout:2197 writesame 0xbb6f71a thru 0xbb76980 data_size 0x1(0x7267 bytes) 2024-09-21T22:16:14.954 INFO:teuthology.orchestra.run.smithi134.stdout:2199 trunc from 0xbb76981 to 0x50e1b06 2024-09-21T22:16:14.963 INFO:teuthology.orchestra.run.smithi134.stdout:2200 write 0x201c109 thru 0x20256ae (0x95a6 bytes) 2024-09-21T22:16:14.964 INFO:teuthology.orchestra.run.smithi134.stdout:2201 read 0x2778780 thru 0x278306f (0xa8f0 bytes) 2024-09-21T22:16:14.966 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:14.964+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:2202 write 0x890f971 thru 0x891cff3 (0xd683 bytes) 2024-09-21T22:16:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:14.987 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:14.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12194 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1327104~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037494669999999, 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024432683, 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12194 2024-09-21T22:16:14.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947443+0000", 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.102e-06 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947446+0000", 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0359999999999998e-06 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947449+0000", 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.357e-06 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971629+0000", 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024180103000000001 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971669+0000", 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0457999999999998e-05 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971875+0000", 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020541299999999999 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12195 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1409024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037482187, 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024694972999999999, 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12195 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947455+0000", 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.16e-07 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947456+0000", 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1650000000000001e-06 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947460+0000", 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1250000000000003e-06 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947464+0000", 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971900+0000", 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024436198999999999 2024-09-21T22:16:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971941+0000", 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0914999999999997e-05 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972149+0000", 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000208581 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12196 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1490944~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037467274999999, 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024916424999999999, 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12196 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:14.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947470+0000", 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:14.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947472+0000", 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.894e-06 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947479+0000", 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.182e-06 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:14.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4669999999999998e-06 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972175+0000", 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024691870000000001 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972216+0000", 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0747000000000001e-05 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972386+0000", 2024-09-21T22:16:15.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169875 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12219 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 835584~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037420021000001, 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025132278000000001, 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12219 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947525+0000", 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2549999999999997e-06 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947535+0000", 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5400000000000001e-06 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947547+0000", 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1721e-05 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972410+0000", 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024863703000000001 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972450+0000", 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9440999999999997e-05 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972649+0000", 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000199044 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12220 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 917504~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037356761, 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025318852999999999, 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12220 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:16:15.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0447e-05 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947600+0000", 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3649999999999993e-06 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8660000000000002e-06 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972675+0000", 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025069168999999999 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972719+0000", 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3757999999999997e-05 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972899+0000", 2024-09-21T22:16:15.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017969899999999999 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12221 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 999424~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037320689, 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025531113000000001, 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12221 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947619+0000", 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947629+0000", 2024-09-21T22:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0325e-05 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947634+0000", 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1760000000000001e-06 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972923+0000", 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025289282999999999 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972964+0000", 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0225000000000002e-05 2024-09-21T22:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973147+0000", 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183365 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12222 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1048576~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037295422, 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02581663, 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12222 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947642+0000", 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947649+0000", 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999999e-06 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947659+0000", 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0023e-05 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947664+0000", 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2399999999999998e-06 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973181+0000", 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025516975000000001 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973232+0000", 2024-09-21T22:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1538e-05 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973458+0000", 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225405 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12223 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1130496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037265444999999, 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026051338, 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12223 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947672+0000", 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947674+0000", 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1880000000000001e-06 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947680+0000", 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2149999999999998e-06 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947689+0000", 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6889999999999993e-06 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973492+0000", 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025803362 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973543+0000", 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378000000000002e-05 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973723+0000", 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017904499999999999 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12224 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1212416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037240024999999, 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026304080000000001, 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12224 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6899999999999998e-07 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947699+0000", 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947710+0000", 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5210000000000004e-06 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973748+0000", 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026037801999999999 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973795+0000", 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6866999999999997e-05 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974001+0000", 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020599600000000001 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12225 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1294336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037220283, 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026580894000000001, 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12225 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947717+0000", 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947719+0000", 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.885e-06 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947724+0000", 2024-09-21T22:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7180000000000001e-06 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947729+0000", 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974025+0000", 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026295888999999999 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974066+0000", 2024-09-21T22:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1458999999999997e-05 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974297+0000", 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023100900000000001 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12226 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1343488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037202171000001, 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026843615000000001, 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12226 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947735+0000", 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947737+0000", 2024-09-21T22:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.812e-06 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947744+0000", 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9500000000000004e-06 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947748+0000", 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974323+0000", 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026574644000000001 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974385+0000", 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2318999999999997e-05 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974578+0000", 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192864 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12227 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1425408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037182326, 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027110875999999999, 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12227 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947755+0000", 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947757+0000", 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0099999999999998e-06 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947766+0000", 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4089999999999992e-06 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947792+0000", 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6367999999999999e-05 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974604+0000", 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026811181 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974646+0000", 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2694000000000002e-05 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974865+0000", 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021881900000000001 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12228 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1507328~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.037138042, 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027303377, 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12228 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7700000000000001e-07 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947800+0000", 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6220000000000001e-06 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947813+0000", 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2833999999999999e-05 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947816+0000", 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1030000000000002e-06 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974890+0000", 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027073904999999999 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974931+0000", 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0194000000000002e-05 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975102+0000", 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171442 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12229 3.1f 3:f99fee0f:::rbd_object_map.1185fc79843.000000000000000e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.033823007000001, 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026242102, 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12229 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951121+0000", 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0559999999999999e-06 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951129+0000", 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951137+0000", 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4600000000000003e-06 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951143+0000", 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9989999999999997e-06 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975127+0000", 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023983563999999999 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975176+0000", 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9753000000000003e-05 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975510+0000", 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033344700000000001 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977251+0000", 2024-09-21T22:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017413859999999999 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977283+0000", 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2261000000000002e-05 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977317+0000", 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3463999999999997e-05 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977356+0000", 2024-09-21T22:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8859000000000002e-05 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12465 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9873152980000004, 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024627518000000001, 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12465 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997622+0000", 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5600000000000002e-07 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997624+0000", 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997630+0000", 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.392e-06 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997634+0000", 2024-09-21T22:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3810000000000001e-06 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021905+0000", 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024270242000000001 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021988+0000", 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3836000000000002e-05 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022249+0000", 2024-09-21T22:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026042300000000002 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12466 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9872974770000003, 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025061416, 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12466 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.53e-07 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997641+0000", 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6700000000000001e-06 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997647+0000", 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.942e-06 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997652+0000", 2024-09-21T22:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7639999999999996e-06 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022294+0000", 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024641880000000001 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022385+0000", 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1324999999999997e-05 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022701+0000", 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031558200000000002 2024-09-21T22:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12467 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9872768430000001, 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02537503, 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12467 2024-09-21T22:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-07 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997662+0000", 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9039999999999999e-06 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997668+0000", 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997673+0000", 2024-09-21T22:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022728+0000", 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025054937999999999 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022814+0000", 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6520000000000005e-05 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023035+0000", 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022056699999999999 2024-09-21T22:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12476 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9870201630000004, 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025528713000000001, 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12476 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997917+0000", 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9199999999999999e-07 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997922+0000", 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6589999999999998e-06 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997934+0000", 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.224e-05 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997941+0000", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8669999999999996e-06 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023079+0000", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025137836 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023169+0000", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0457999999999993e-05 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023445+0000", 2024-09-21T22:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027576100000000002 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12477 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9869731739999992, 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025850773000000001, 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12477 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2099999999999996e-07 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997967+0000", 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1089999999999998e-06 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997976+0000", 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.524e-06 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997979+0000", 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7589999999999999e-06 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023470+0000", 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025490777999999999 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023552+0000", 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1893999999999999e-05 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023814+0000", 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262088 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12478 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9869498730000004, 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026321787999999999, 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12478 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8799999999999998e-07 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997992+0000", 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.045e-06 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997996+0000", 2024-09-21T22:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3939999999999998e-06 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997999+0000", 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.937e-06 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023857+0000", 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025858069000000001 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023951+0000", 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3226999999999994e-05 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.024309+0000", 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035782799999999998 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout:2203 write 0xe77d982 thru 0xe77dbcf (0x24e bytes) 2024-09-21T22:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout:2205 write 0xdc1e92f thru 0xdc22bd5 (0x42a7 bytes) 2024-09-21T22:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout:2207 punch from 0x62354d8 to 0x62378d6, (0x23fe bytes) 2024-09-21T22:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout:2210 writesame 0x46ea828 thru 0x46f16f1 data_size 0x57(0x6eca bytes) 2024-09-21T22:16:15.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout:2212 write 0xa5500c9 thru 0xa55aa1a (0xa952 bytes) 2024-09-21T22:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout:2213 write 0x1f772b7 thru 0x1f7e5fb (0x7345 bytes) 2024-09-21T22:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout:2215 punch from 0xdd22174 to 0xdd267ff, (0x468b bytes) 2024-09-21T22:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout:2216 write 0xe03f294 thru 0xe0458cb (0x6638 bytes) 2024-09-21T22:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout:2217 read 0x1c20e25 thru 0x1c2d8ba (0xca96 bytes) 2024-09-21T22:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout:2218 punch from 0xbdb7cd8 to 0xbdbf1d6, (0x74fe bytes) 2024-09-21T22:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout:2220 read 0x7523eb thru 0x755773 (0x3389 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2221 punch from 0x8c0e500 to 0x8c11496, (0x2f96 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2223 punch from 0xac01616 to 0xac01cd9, (0x6c3 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2226 read 0x9cdd06d thru 0x9ce9042 (0xbfd6 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2228 punch from 0x1c6000b to 0x1c6d618, (0xd60d bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2229 write 0xc976cef thru 0xc9867ec (0xfafe bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2231 read 0xe3c8a04 thru 0xe3d44d2 (0xbacf bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2232 write 0xc7c5682 thru 0xc7c94be (0x3e3d bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2233 writesame 0xa10f3ac thru 0xa11c269 data_size 0x3(0xcebe bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2235 writesame 0x49e3e45 thru 0x49edb2b data_size 0x3(0x9ce7 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2236 writesame 0x24fc65b thru 0x24fe793 data_size 0x1b(0x2139 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2237 writesame 0x2efc62e thru 0x2eff2b4 data_size 0x1(0x2c87 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2238 read 0x156955f thru 0x1573727 (0xa1c9 bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2240 write 0xa4774e1 thru 0xa47ac0f (0x372f bytes) 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout:2242 write 0xbe4e2a4 thru 0xbe55dd0 (0x7b2d bytes) 2024-09-21T22:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:2244 trunc from 0xe77dbd0 to 0x4149821 2024-09-21T22:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:2245 writesame 0x35ae413 thru 0x35b057c data_size 0x7(0x216a bytes) 2024-09-21T22:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:2247 writesame 0x52da78c thru 0x52e7aac data_size 0x1(0xd321 bytes) 2024-09-21T22:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:2248 trunc from 0x52e7aad to 0x3881721 2024-09-21T22:16:15.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:15.073+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:2249 write 0x820917c thru 0x820ce5d (0x3ce2 bytes) 2024-09-21T22:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:2250 write 0xb5d8c5d thru 0xb5dd713 (0x4ab7 bytes) 2024-09-21T22:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:2251 writesame 0x4cf7b2b thru 0x4d0246b data_size 0x21(0xa941 bytes) 2024-09-21T22:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:2252 punch from 0x180bb23 to 0x1812706, (0x6be3 bytes) 2024-09-21T22:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:2253 write 0x49566dc thru 0x496126e (0xab93 bytes) 2024-09-21T22:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:2254 trunc from 0xb5dd714 to 0xadbcecd 2024-09-21T22:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout:2255 trunc from 0xadbcecd to 0x74b9864 2024-09-21T22:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout:2257 punch from 0x58b0b5d to 0x58bb7b7, (0xac5a bytes) 2024-09-21T22:16:15.139 INFO:teuthology.orchestra.run.smithi134.stdout:2261 write 0xa68ce80 thru 0xa68fa85 (0x2c06 bytes) 2024-09-21T22:16:15.142 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.143 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.143 INFO:teuthology.orchestra.run.smithi134.stdout:2266 punch from 0x8b8582c to 0x8b9406d, (0xe841 bytes) 2024-09-21T22:16:15.143 INFO:teuthology.orchestra.run.smithi134.stdout:2267 read 0x183d6b6 thru 0x1845088 (0x79d3 bytes) 2024-09-21T22:16:15.150 INFO:teuthology.orchestra.run.smithi134.stdout:2268 write 0xbcc9483 thru 0xbcd8492 (0xf010 bytes) 2024-09-21T22:16:15.152 INFO:teuthology.orchestra.run.smithi134.stdout:2270 read 0xb501685 thru 0xb506e81 (0x57fd bytes) 2024-09-21T22:16:15.152 INFO:teuthology.orchestra.run.smithi134.stdout:2271 read 0x429fe9d thru 0x42aa50f (0xa673 bytes) 2024-09-21T22:16:15.154 INFO:teuthology.orchestra.run.smithi134.stdout:2272 trunc from 0xbcd8493 to 0x9b77970 2024-09-21T22:16:15.161 INFO:teuthology.orchestra.run.smithi134.stdout:2275 punch from 0x451f942 to 0x45298af, (0x9f6d bytes) 2024-09-21T22:16:15.161 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.161 INFO:teuthology.orchestra.run.smithi134.stdout:2279 writesame 0x29fff3a thru 0x2a049d0 data_size 0x13(0x4a97 bytes) 2024-09-21T22:16:15.167 INFO:teuthology.orchestra.run.smithi134.stdout:2280 trunc from 0x9b77970 to 0x5c8501c 2024-09-21T22:16:15.176 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:15.174+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:15.198 INFO:teuthology.orchestra.run.smithi134.stdout:2281 writesame 0xbe0adaa thru 0xbe0f838 data_size 0x1(0x4a8f bytes) 2024-09-21T22:16:15.198 INFO:teuthology.orchestra.run.smithi134.stdout:2282 writesame 0x6b7dd9c thru 0x6b8d81c data_size 0x1(0xfa81 bytes) 2024-09-21T22:16:15.214 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:15.215 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:15.215 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:15.215 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:15.222 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:15.232 INFO:teuthology.orchestra.run.smithi134.stdout:2284 trunc from 0xbe0f839 to 0x392f632 2024-09-21T22:16:15.240 INFO:teuthology.orchestra.run.smithi134.stdout:2285 read 0x5cb7d9 thru 0x5d8709 (0xcf31 bytes) 2024-09-21T22:16:15.261 INFO:teuthology.orchestra.run.smithi134.stdout:2288 writesame 0xdfd63b2 thru 0xdfdea6f data_size 0x3(0x86be bytes) 2024-09-21T22:16:15.261 INFO:teuthology.orchestra.run.smithi134.stdout:2289 write 0xd34c938 thru 0xd3509fc (0x40c5 bytes) 2024-09-21T22:16:15.265 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.265 INFO:teuthology.orchestra.run.smithi134.stdout:2291 write 0x6372981 thru 0x6380acc (0xe14c bytes) 2024-09-21T22:16:15.267 INFO:teuthology.orchestra.run.smithi134.stdout:2292 write 0x67a61dd thru 0x67a8fde (0x2e02 bytes) 2024-09-21T22:16:15.268 INFO:teuthology.orchestra.run.smithi134.stdout:2294 writesame 0x6b0c51a thru 0x6b1bd17 data_size 0x9(0xf7fe bytes) 2024-09-21T22:16:15.277 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:15.276+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:15.280 INFO:teuthology.orchestra.run.smithi134.stdout:2295 trunc from 0xdfdea70 to 0x7775749 2024-09-21T22:16:15.301 INFO:teuthology.orchestra.run.smithi134.stdout:2298 write 0xe31d032 thru 0xe3209fb (0x39ca bytes) 2024-09-21T22:16:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:2299 read 0xace2448 thru 0xace7eeb (0x5aa4 bytes) 2024-09-21T22:16:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:2300 write 0xcab7a5d thru 0xcac5fc9 (0xe56d bytes) 2024-09-21T22:16:15.319 INFO:teuthology.orchestra.run.smithi134.stdout:2301 writesame 0xeb94a93 thru 0xeb9aca2 data_size 0x18(0x6210 bytes) 2024-09-21T22:16:15.336 INFO:teuthology.orchestra.run.smithi134.stdout:2302 trunc from 0xeb9aca3 to 0x62e72f 2024-09-21T22:16:15.356 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:15.356 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:15.356 INFO:teuthology.orchestra.run.smithi134.stdout:2303 read 0x5df736 thru 0x5eaf6f (0xb83a bytes) 2024-09-21T22:16:15.365 INFO:teuthology.orchestra.run.smithi134.stdout:2306 write 0x28c07f7 thru 0x28cb6fb (0xaf05 bytes) 2024-09-21T22:16:15.367 INFO:teuthology.orchestra.run.smithi134.stdout:2312 writesame 0x18b3782 thru 0x18c1640 data_size 0x1(0xdebf bytes) 2024-09-21T22:16:15.369 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:15.399 INFO:teuthology.orchestra.run.smithi134.stdout:2313 trunc from 0x28cb6fc to 0x901049e 2024-09-21T22:16:15.400 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:15.398+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:15.405 INFO:teuthology.orchestra.run.smithi134.stdout:2314 read 0x7b9cdf2 thru 0x7babc81 (0xee90 bytes) 2024-09-21T22:16:15.405 INFO:teuthology.orchestra.run.smithi134.stdout:2315 writesame 0x73d8c0a thru 0x73e16dd data_size 0xa(0x8ad4 bytes) 2024-09-21T22:16:15.409 INFO:teuthology.orchestra.run.smithi134.stdout:2316 read 0x170e895 thru 0x1715492 (0x6bfe bytes) 2024-09-21T22:16:15.410 INFO:teuthology.orchestra.run.smithi134.stdout:2317 read 0x424b8a4 thru 0x424ea9c (0x31f9 bytes) 2024-09-21T22:16:15.410 INFO:teuthology.orchestra.run.smithi134.stdout:2318 read 0x10dbec8 thru 0x10dedd7 (0x2f10 bytes) 2024-09-21T22:16:15.411 INFO:teuthology.orchestra.run.smithi134.stdout:2319 writesame 0x1b6c49a thru 0x1b74c99 data_size 0x80(0x8800 bytes) 2024-09-21T22:16:15.420 INFO:teuthology.orchestra.run.smithi134.stdout:2320 trunc from 0x901049e to 0x2504bea 2024-09-21T22:16:15.433 INFO:teuthology.orchestra.run.smithi134.stdout:2322 read 0x4ac31c thru 0x4b544a (0x912f bytes) 2024-09-21T22:16:15.438 INFO:teuthology.orchestra.run.smithi134.stdout:2323 trunc from 0x2504bea to 0x64fed70 2024-09-21T22:16:15.452 INFO:teuthology.orchestra.run.smithi134.stdout:2324 write 0x783c3cf thru 0x7843681 (0x72b3 bytes) 2024-09-21T22:16:15.457 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.457 INFO:teuthology.orchestra.run.smithi134.stdout:2326 punch from 0x32e1f8f to 0x32f0226, (0xe297 bytes) 2024-09-21T22:16:15.457 INFO:teuthology.orchestra.run.smithi134.stdout:2327 punch from 0x6e1b340 to 0x6e2572c, (0xa3ec bytes) 2024-09-21T22:16:15.457 INFO:teuthology.orchestra.run.smithi134.stdout:2328 punch from 0x273add4 to 0x273ce73, (0x209f bytes) 2024-09-21T22:16:15.457 INFO:teuthology.orchestra.run.smithi134.stdout:2329 read 0x2cfa2d6 thru 0x2d03606 (0x9331 bytes) 2024-09-21T22:16:15.458 INFO:teuthology.orchestra.run.smithi134.stdout:2330 writesame 0x36e2dac thru 0x36eefa1 data_size 0x4a(0xc1f6 bytes) 2024-09-21T22:16:15.458 INFO:teuthology.orchestra.run.smithi134.stdout:2332 read 0x4f9b672 thru 0x4f9e8b3 (0x3242 bytes) 2024-09-21T22:16:15.459 INFO:teuthology.orchestra.run.smithi134.stdout:2333 punch from 0x140158e to 0x140c0cd, (0xab3f bytes) 2024-09-21T22:16:15.459 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:15.459 INFO:teuthology.orchestra.run.smithi134.stdout:2335 writesame 0x4a028d9 thru 0x4a04b11 data_size 0x1(0x2239 bytes) 2024-09-21T22:16:15.463 INFO:teuthology.orchestra.run.smithi134.stdout:2336 read 0x5e8a742 thru 0x5e95844 (0xb103 bytes) 2024-09-21T22:16:15.464 INFO:teuthology.orchestra.run.smithi134.stdout:2337 writesame 0x77bf8b4 thru 0x77cd1c4 data_size 0x1(0xd911 bytes) 2024-09-21T22:16:15.479 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:15.477+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:15.493 INFO:teuthology.orchestra.run.smithi134.stdout:2338 clone 9 order 25 su 262144 sc 13 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:956 3.6 e30/23 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.017774998, 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091893070000000007, 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497369+0000", 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001336804 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497387+0000", 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8014999999999999e-05 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497398+0000", 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1581e-05 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497480+0000", 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1874999999999998e-05 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497511+0000", 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1103999999999999e-05 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505165+0000", 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076536219999999997 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505221+0000", 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6026000000000002e-05 2024-09-21T22:16:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:960 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.015841447, 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084308620000000008, 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 960 2024-09-21T22:16:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497968+0000", 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.429e-06 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498743+0000", 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077512399999999997 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498766+0000", 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2983999999999999e-05 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498790+0000", 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389e-05 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498881+0000", 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0780999999999997e-05 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498890+0000", 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7579999999999998e-06 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500819+0000", 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929491 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500968+0000", 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014854199999999999 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501114+0000", 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146298 2024-09-21T22:16:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505622+0000", 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045081649999999997 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506247+0000", 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062455099999999999 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506353+0000", 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010586699999999999 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506396+0000", 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3482999999999997e-05 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2346 3.0 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.998804653000001, 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083135759999999996, 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2346 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515003+0000", 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-06 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515950+0000", 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094629499999999999 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515967+0000", 2024-09-21T22:16:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7554000000000002e-05 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515974+0000", 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516038+0000", 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3176999999999995e-05 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516167+0000", 2024-09-21T22:16:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012979800000000001 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516306+0000", 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138887 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522280+0000", 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059732750000000001 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523229+0000", 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094895000000000005 2024-09-21T22:16:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523280+0000", 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1554999999999997e-05 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523316+0000", 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5602999999999998e-05 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2364 3.0 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head [write 0~983607 [fadvise_sequential+fadvise_nocache],write 1048576~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.9866791, 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077052980000000002, 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2364 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527129+0000", 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527492+0000", 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036298100000000001 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527504+0000", 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1814000000000001e-05 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527510+0000", 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4649999999999999e-06 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527564+0000", 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3893000000000001e-05 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527665+0000", 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101468 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527817+0000", 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015177100000000001 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534445+0000", 2024-09-21T22:16:15.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066276169999999997 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534752+0000", 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030757499999999998 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534799+0000", 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6310000000000002e-05 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534833+0000", 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341999999999997e-05 2024-09-21T22:16:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7887 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.109897927999999, 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019112581, 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7887 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403910+0000", 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3300000000000001e-07 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403914+0000", 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1370000000000004e-06 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403924+0000", 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0365e-05 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403929+0000", 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403979+0000", 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0420000000000002e-05 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.404033+0000", 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3489999999999998e-05 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.407250+0000", 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003216975 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422946+0000", 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015696266 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422957+0000", 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0608000000000001e-05 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422987+0000", 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0552999999999997e-05 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.423021+0000", 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4056000000000001e-05 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:7887 3.4 e41/23 ondisk, result = 0)", 2024-09-21T22:16:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.097594356999998, 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067395329999999998, 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416213+0000", 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416216+0000", 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0989999999999999e-06 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416227+0000", 2024-09-21T22:16:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0604e-05 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416232+0000", 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.938e-06 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422936+0000", 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067038089999999998 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422942+0000", 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5939999999999999e-06 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422952+0000", 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8090000000000004e-06 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7981 3.0 3:03cb8c30:::rbd_data.1185acca6c1f.000000000000001b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.000464660999999, 2024-09-21T22:16:15.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015150808999999999, 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7981 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513343+0000", 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6000000000000003e-07 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513347+0000", 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9910000000000004e-06 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513358+0000", 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0772e-05 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513363+0000", 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1490000000000002e-06 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513403+0000", 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0290000000000002e-05 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513450+0000", 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7349999999999999e-05 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.515475+0000", 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020249640000000002 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528357+0000", 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012881782 2024-09-21T22:16:15.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528396+0000", 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8674000000000003e-05 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528438+0000", 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2006999999999999e-05 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528493+0000", 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.507e-05 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8534 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.351561687, 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013031713, 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8534 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162246+0000", 2024-09-21T22:16:15.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162250+0000", 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9550000000000002e-06 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162259+0000", 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5780000000000005e-06 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162264+0000", 2024-09-21T22:16:15.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162312+0000", 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7361000000000003e-05 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162368+0000", 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6104999999999999e-05 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.164384+0000", 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020158120000000001 2024-09-21T22:16:15.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175199+0000", 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010815455 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175212+0000", 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2422000000000001e-05 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175243+0000", 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1142000000000001e-05 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175277+0000", 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4057999999999998e-05 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.599302324, 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.562 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13497 3.0 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head [write 0~49152 [fadvise_sequential+fadvise_nocache],write 98304~98304 [fadvise_sequential+fadvise_nocache],write 262144~98304 [fadvise_sequential+fadvise_nocache],write 409600~114688 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.132525+0000", 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.381281376, 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050977899999999996, 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.563 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13497 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132525+0000", 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132525+0000", 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132527+0000", 2024-09-21T22:16:15.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3799999999999999e-06 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132632+0000", 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105326 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132646+0000", 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3929e-05 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132652+0000", 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1680000000000001e-06 2024-09-21T22:16:15.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132694+0000", 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2239e-05 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132816+0000", 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012131800000000001 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132938+0000", 2024-09-21T22:16:15.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012274200000000001 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.134020+0000", 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010819600000000001 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137464+0000", 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003443776 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137559+0000", 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4481000000000006e-05 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137623+0000", 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4471e-05 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16577 3.0 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1100457739999996, 2024-09-21T22:16:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056490309999999997, 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16577 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403762+0000", 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403773+0000", 2024-09-21T22:16:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0584999999999999e-05 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403787+0000", 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4630999999999999e-05 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403796+0000", 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4500000000000004e-06 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403921+0000", 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012577000000000001 2024-09-21T22:16:15.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404002+0000", 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0626999999999999e-05 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404115+0000", 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113169 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.405859+0000", 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017439809999999999 2024-09-21T22:16:15.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408749+0000", 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028899479999999998 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409367+0000", 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000617872 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409410+0000", 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2942999999999999e-05 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16593 3.4 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1050834920000003, 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051936209999999998, 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16593 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408724+0000", 2024-09-21T22:16:15.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4099999999999997e-07 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408728+0000", 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9879999999999998e-06 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408737+0000", 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9760000000000001e-06 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408744+0000", 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7270000000000001e-06 2024-09-21T22:16:15.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408800+0000", 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6351000000000003e-05 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408893+0000", 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3158999999999994e-05 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409022+0000", 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915499999999999 2024-09-21T22:16:15.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413621+0000", 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00459868 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413809+0000", 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018772299999999999 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413868+0000", 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9611000000000002e-05 2024-09-21T22:16:15.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413917+0000", 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8409999999999999e-05 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16618 3.4 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0968892239999999, 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085534029999999994, 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16618 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7599999999999996e-07 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416923+0000", 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.634e-06 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416935+0000", 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416943+0000", 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5860000000000005e-06 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417028+0000", 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4352999999999997e-05 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417137+0000", 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109226 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417259+0000", 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012192 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417821+0000", 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056199500000000003 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425374+0000", 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075528499999999998 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425426+0000", 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2179000000000003e-05 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425471+0000", 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5244000000000003e-05 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16629 3.19 3:9e091eba:::rbd_data.1185fc79843.00000000000000cf:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0935603319999991, 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053360919999999997, 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16629 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420247+0000", 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3099999999999996e-07 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420252+0000", 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5249999999999999e-06 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420264+0000", 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2473999999999999e-05 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420271+0000", 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.64e-06 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420322+0000", 2024-09-21T22:16:15.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1354000000000003e-05 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420382+0000", 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9367999999999998e-05 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420451+0000", 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9521000000000001e-05 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425286+0000", 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048351119999999999 2024-09-21T22:16:15.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425478+0000", 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019156500000000001 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425536+0000", 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479e-05 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425583+0000", 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6223000000000001e-05 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.589 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16861 3.19 3:9ed45132:::rbd_data.1185fc79843.00000000000000fd:head [set-alloc-hint object_size 524288 write_size 524288,write 180224~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.578116+0000", 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9356907519999993, 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050333870000000003, 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16861 2024-09-21T22:16:15.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578116+0000", 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578116+0000", 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578118+0000", 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6279999999999999e-06 2024-09-21T22:16:15.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578133+0000", 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4881e-05 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578145+0000", 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2218000000000001e-05 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578151+0000", 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8109999999999999e-06 2024-09-21T22:16:15.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578210+0000", 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9277999999999997e-05 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578294+0000", 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4276000000000004e-05 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578456+0000", 2024-09-21T22:16:15.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000161426 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.580673+0000", 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022175799999999998 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.583082+0000", 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024093589999999998 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.583120+0000", 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7866e-05 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.583149+0000", 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9064000000000002e-05 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16942 3.19 3:9cb4a31c:::rbd_data.1185fc79843.0000000000000160:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:15.595 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.8540867130000009, 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005348022, 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16942 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659722+0000", 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9479999999999998e-06 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659731+0000", 2024-09-21T22:16:15.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8619999999999992e-06 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659751+0000", 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0275000000000002e-05 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659761+0000", 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8530000000000004e-06 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659833+0000", 2024-09-21T22:16:15.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2504999999999998e-05 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659932+0000", 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8164000000000004e-05 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.660693+0000", 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076168099999999995 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.663320+0000", 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026266140000000002 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.664952+0000", 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016316589999999999 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.665011+0000", 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9710999999999998e-05 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.665068+0000", 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6749999999999997e-05 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16959 3.19 3:9c0b7e71:::rbd_data.1185fc79843.000000000000006a:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.8342453550000002, 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054482150000000002, 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16959 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679563+0000", 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2860000000000001e-06 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679568+0000", 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9799999999999998e-06 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679581+0000", 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3434999999999999e-05 2024-09-21T22:16:15.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679588+0000", 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2110000000000001e-06 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679640+0000", 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2086999999999998e-05 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679753+0000", 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112991 2024-09-21T22:16:15.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.680669+0000", 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00091544800000000002 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684899+0000", 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004229984 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684932+0000", 2024-09-21T22:16:15.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3522999999999997e-05 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684966+0000", 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3735999999999997e-05 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.685010+0000", 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3534e-05 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17128 3.19 3:9889dc56:::rbd_data.1185fc79843.0000000000000063:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6572829060000007, 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051858959999999997, 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17128 2024-09-21T22:16:15.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856526+0000", 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.928e-06 2024-09-21T22:16:15.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856533+0000", 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6070000000000002e-06 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856555+0000", 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1209e-05 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856564+0000", 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8179999999999999e-06 2024-09-21T22:16:15.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856639+0000", 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4604999999999995e-05 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856738+0000", 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9291999999999997e-05 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:15.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856889+0000", 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015028599999999999 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.857493+0000", 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000604025 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861598+0000", 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041055880000000003 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861659+0000", 2024-09-21T22:16:15.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0529999999999998e-05 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861710+0000", 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1007999999999997e-05 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17226 3.19 3:9e091eba:::rbd_data.1185fc79843.00000000000000cf:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5776663709999994, 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062013320000000004, 2024-09-21T22:16:15.612 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17226 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936142+0000", 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3680000000000001e-06 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936148+0000", 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3840000000000002e-06 2024-09-21T22:16:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936161+0000", 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2522e-05 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936169+0000", 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4149999999999999e-06 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936218+0000", 2024-09-21T22:16:15.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9128999999999997e-05 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936277+0000", 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8832000000000002e-05 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.937245+0000", 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00096821899999999998 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.941109+0000", 2024-09-21T22:16:15.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038635430000000001 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942246+0000", 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011373760000000001 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942294+0000", 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7478000000000002e-05 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942342+0000", 2024-09-21T22:16:15.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8065999999999997e-05 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:26837 3.19 3:9ddb6656:::rbd_data.118527d5458b.0000000000000012:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1012029480000001, 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055045679999999996, 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:15.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26837 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412606+0000", 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0260000000000002e-06 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412613+0000", 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4100000000000002e-06 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412632+0000", 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8309e-05 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:15.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412641+0000", 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-06 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412719+0000", 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7086e-05 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412828+0000", 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010985 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412962+0000", 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013390799999999999 2024-09-21T22:16:15.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.414950+0000", 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019879479999999998 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.417992+0000", 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030417339999999999 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.418053+0000", 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0572999999999998e-05 2024-09-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.418108+0000", 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5804000000000003e-05 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:15.623 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:15.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:15.625 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:15.623+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:15.726 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:15.723+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:15.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:15.827 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:15.825+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:15.921 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:15.922 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:15.928 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:15.926+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:15.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:16.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:16:16.029 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:16.027+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.541035866999998, 2024-09-21T22:16:16.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:16:16.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:16:16.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.525852407999999, 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.514405969999999, 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:16.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:16:16.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:16:16.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:16:16.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2603 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'36, mlcod=34'34)", 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.043202952000001, 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032135610000000002, 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:16:16.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999129+0000", 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999139+0000", 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5300000000000002e-06 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999143+0000", 2024-09-21T22:16:16.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999184+0000", 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999198+0000", 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3971999999999999e-05 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002303+0000", 2024-09-21T22:16:16.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031052179999999999 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002337+0000", 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3992000000000003e-05 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.994499631, 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:16:16.061 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2636 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'42, mlcod=34'40)", 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:16.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.983308402999999, 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033367480000000001, 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:16.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059019+0000", 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-06 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059029+0000", 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4509999999999998e-06 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059044+0000", 2024-09-21T22:16:16.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5218000000000001e-05 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059052+0000", 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059114+0000", 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2094999999999994e-05 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059139+0000", 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-05 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062305+0000", 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031661020000000001 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062355+0000", 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0129000000000001e-05 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.832564824999999, 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:16:16.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:8183 3.9 e41/23 3:915aea64:::rbd_data.1185acca6c1f.0000000000000012:head v 41'72, mlcod=41'69)", 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.275705465000001, 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031809400000000002, 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766622+0000", 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0500000000000003e-07 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766627+0000", 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9899999999999997e-06 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766634+0000", 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3669999999999999e-06 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766639+0000", 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4070000000000001e-06 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766677+0000", 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7242e-05 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766695+0000", 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8694000000000001e-05 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769713+0000", 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030172060000000001 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769802+0000", 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9429e-05 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9185 3.4 e42/23 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head v 42'42, mlcod=42'40)", 2024-09-21T22:16:16.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.097106725, 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033010399999999999, 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945221+0000", 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199999999999998e-07 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945226+0000", 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3449999999999996e-06 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945236+0000", 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044e-05 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945241+0000", 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1499999999999998e-06 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945289+0000", 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7142999999999999e-05 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945310+0000", 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1314e-05 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948453+0000", 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031435539999999998 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948521+0000", 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7422000000000006e-05 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9187 3.0 e42/23 3:057833b6:::rbd_data.1185acca6c1f.0000000000000004:head v 42'223, mlcod=42'221)", 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.097073039000001, 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003477997, 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7100000000000001e-07 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945256+0000", 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5610000000000001e-06 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945261+0000", 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5290000000000002e-06 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945264+0000", 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.078e-06 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945304+0000", 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0345000000000001e-05 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945326+0000", 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1733999999999999e-05 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948698+0000", 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033719520000000001 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948732+0000", 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3627000000000002e-05 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.964318742, 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:12256 3.4 e50/23 3:22ba8708:::rbd_data.1185fc79843.0000000000000007:head v 50'45, mlcod=42'43)", 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.055606990999999, 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034474280000000002, 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986721+0000", 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.178e-06 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987147+0000", 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042672899999999999 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987162+0000", 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4619e-05 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987171+0000", 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7900000000000005e-06 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987229+0000", 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8338000000000003e-05 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987251+0000", 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2140000000000001e-05 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990117+0000", 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028654069999999999 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990167+0000", 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0226999999999999e-05 2024-09-21T22:16:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.909230979, 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:16:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:16:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6381382900000006, 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:16:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16591 3.0 e51/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 51'238, mlcod=50'235)", 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6343760849999995, 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032416879999999999, 2024-09-21T22:16:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407951+0000", 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8899999999999998e-07 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407957+0000", 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407971+0000", 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4246e-05 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407977+0000", 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5489999999999997e-06 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408027+0000", 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0488999999999997e-05 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408060+0000", 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2595000000000002e-05 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.411148+0000", 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030882940000000001 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.411192+0000", 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3778e-05 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:16:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6332317159999992, 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:16:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6300211170000001, 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:16:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16615 3.0 e51/23 3:01d11d11:::rbd_data.1185fc79843.00000000000000c1:head v 51'239, mlcod=51'237)", 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6255342430000006, 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031352709999999998, 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416793+0000", 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4300000000000002e-07 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416799+0000", 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8969999999999996e-06 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416813+0000", 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4372000000000001e-05 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416820+0000", 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416868+0000", 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7376000000000002e-05 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416887+0000", 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9233e-05 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419885+0000", 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029975929999999998 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419928+0000", 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2982999999999998e-05 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.62499942, 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:16:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:16:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6230120879999994, 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:16.129 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:16.130 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:16.131 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:16.129+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:16.231 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:16.230+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:16.236 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:16.236 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:16.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:16.279 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:16.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:16.330+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:16.389 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:16.390 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:16.390 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:16.390 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:16.390 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:16.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:16.399 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:16.416 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:16.431 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:16.432 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:16.441 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:16.440+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:16.447 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:16.448 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:16.464 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:16.464 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:16.480 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:16.481 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:16.497 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:16.497 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:16.504 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:16.504 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:16.514 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:16.514 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:16.514 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:16.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:16.563+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:16.634 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:16.632+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:16.657 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:16.657 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:16.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:16.751 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:16.749+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:16.810 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:16.810 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:16.819 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:16.860 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:16.858+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:16.875 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:16:16.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:16.935+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:16.978 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:16.978 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:16.988 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:17.037 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:17.035+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:17.091 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:17.092 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:17.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:17.142 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:17.140+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:17.239 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:17.237+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:17.243 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:17.244 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:17.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:17.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:17.339+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:17.396 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:17.396 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:17.405 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:17.441 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:17.440+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:17.509 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:17.509 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:17.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:17.563 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:17.561+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:17.621 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:17.621 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:17.630 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:17.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:17.642+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:17.745 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:17.742+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:17.774 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:17.774 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:17.783 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:17.845 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:17.843+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:17.904 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:17.904 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:17.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:17.955 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:17.953+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:17.976 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-21T22:16:18.043 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:16:18.044 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:16:18.044 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:16:18.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:16:18.047 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:18.045+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:18.052 INFO:teuthology.orchestra.run.smithi134.stdout:2340 read 0x239ec81 thru 0x23a1cea (0x306a bytes) 2024-09-21T22:16:18.052 INFO:teuthology.orchestra.run.smithi134.stdout:2341 punch from 0x219ad9a to 0x21a3c4e, (0x8eb4 bytes) 2024-09-21T22:16:18.056 INFO:teuthology.orchestra.run.smithi134.stdout:2343 write 0x5860bb6 thru 0x586df5b (0xd3a6 bytes) 2024-09-21T22:16:18.071 INFO:teuthology.orchestra.run.smithi134.stdout:2344 write 0xd4feaa4 thru 0xd502893 (0x3df0 bytes) 2024-09-21T22:16:18.073 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:18.073 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:18.076 INFO:teuthology.orchestra.run.smithi134.stdout:2348 trunc from 0xd502894 to 0x9d20a81 2024-09-21T22:16:18.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:18.089 INFO:teuthology.orchestra.run.smithi134.stdout:2349 write 0x60e52b1 thru 0x60e6769 (0x14b9 bytes) 2024-09-21T22:16:18.091 INFO:teuthology.orchestra.run.smithi134.stdout:2350 read 0x51db45f thru 0x51e52e7 (0x9e89 bytes) 2024-09-21T22:16:18.091 INFO:teuthology.orchestra.run.smithi134.stdout:2353 punch from 0x1d320ac to 0x1d3252a, (0x47e bytes) 2024-09-21T22:16:18.091 INFO:teuthology.orchestra.run.smithi134.stdout:2355 write 0x600599b thru 0x6008135 (0x279b bytes) 2024-09-21T22:16:18.092 INFO:teuthology.orchestra.run.smithi134.stdout:2356 read 0x9bc61af thru 0x9bcb18d (0x4fdf bytes) 2024-09-21T22:16:18.094 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.094 INFO:teuthology.orchestra.run.smithi134.stdout:2358 punch from 0x2855d5d to 0x2855f25, (0x1c8 bytes) 2024-09-21T22:16:18.094 INFO:teuthology.orchestra.run.smithi134.stdout:2360 read 0x7d4b1a3 thru 0x7d4bb79 (0x9d7 bytes) 2024-09-21T22:16:18.094 INFO:teuthology.orchestra.run.smithi134.stdout:2361 read 0x2468163 thru 0x2473814 (0xb6b2 bytes) 2024-09-21T22:16:18.094 INFO:teuthology.orchestra.run.smithi134.stdout:2362 read 0x518cf48 thru 0x51980ed (0xb1a6 bytes) 2024-09-21T22:16:18.094 INFO:teuthology.orchestra.run.smithi134.stdout:2363 punch from 0x198b178 to 0x198e40d, (0x3295 bytes) 2024-09-21T22:16:18.095 INFO:teuthology.orchestra.run.smithi134.stdout:2366 read 0x56bc304 thru 0x56c6e43 (0xab40 bytes) 2024-09-21T22:16:18.095 INFO:teuthology.orchestra.run.smithi134.stdout:2367 writesame 0x628836b thru 0x62911b0 data_size 0x1(0x8e46 bytes) 2024-09-21T22:16:18.113 INFO:teuthology.orchestra.run.smithi134.stdout:2369 writesame 0x7d8e872 thru 0x7d9d3ec data_size 0x1(0xeb7b bytes) 2024-09-21T22:16:18.140 INFO:teuthology.orchestra.run.smithi134.stdout:2370 read 0x1832aa3 thru 0x183628a (0x37e8 bytes) 2024-09-21T22:16:18.140 INFO:teuthology.orchestra.run.smithi134.stdout:2371 read 0x4456b03 thru 0x445e3f6 (0x78f4 bytes) 2024-09-21T22:16:18.148 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:18.146+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:18.152 INFO:teuthology.orchestra.run.smithi134.stdout:2372 writesame 0xec34182 thru 0xec3dc82 data_size 0x3(0x9b01 bytes) 2024-09-21T22:16:18.153 INFO:teuthology.orchestra.run.smithi134.stdout:2373 writesame 0x5c4ba38 thru 0x5c4d9eb data_size 0x2(0x1fb4 bytes) 2024-09-21T22:16:18.156 INFO:teuthology.orchestra.run.smithi134.stdout:2374 read 0x1022ccb thru 0x102695c (0x3c92 bytes) 2024-09-21T22:16:18.156 INFO:teuthology.orchestra.run.smithi134.stdout:2375 punch from 0x983df72 to 0x9846651, (0x86df bytes) 2024-09-21T22:16:18.156 INFO:teuthology.orchestra.run.smithi134.stdout:2376 writesame 0x6977403 thru 0x698408e data_size 0x6a(0xcc8c bytes) 2024-09-21T22:16:18.158 INFO:teuthology.orchestra.run.smithi134.stdout:2377 read 0xdb5b5b3 thru 0xdb6ae01 (0xf84f bytes) 2024-09-21T22:16:18.158 INFO:teuthology.orchestra.run.smithi134.stdout:2378 punch from 0x8238a91 to 0x82482dd, (0xf84c bytes) 2024-09-21T22:16:18.158 INFO:teuthology.orchestra.run.smithi134.stdout:2379 write 0xdb3e004 thru 0xdb401f3 (0x21f0 bytes) 2024-09-21T22:16:18.160 INFO:teuthology.orchestra.run.smithi134.stdout:2380 read 0xe36dc5c thru 0xe373841 (0x5be6 bytes) 2024-09-21T22:16:18.160 INFO:teuthology.orchestra.run.smithi134.stdout:2381 read 0x7cf61da thru 0x7d0323f (0xd066 bytes) 2024-09-21T22:16:18.161 INFO:teuthology.orchestra.run.smithi134.stdout:2382 write 0x22355b6 thru 0x223ea90 (0x94db bytes) 2024-09-21T22:16:18.162 INFO:teuthology.orchestra.run.smithi134.stdout:2384 punch from 0x75759df to 0x7581196, (0xb7b7 bytes) 2024-09-21T22:16:18.162 INFO:teuthology.orchestra.run.smithi134.stdout:2385 write 0x3d0034e thru 0x3d04169 (0x3e1c bytes) 2024-09-21T22:16:18.163 INFO:teuthology.orchestra.run.smithi134.stdout:2386 punch from 0x2a3f6f1 to 0x2a42b52, (0x3461 bytes) 2024-09-21T22:16:18.164 INFO:teuthology.orchestra.run.smithi134.stdout:2389 write 0x9061a24 thru 0x90622ba (0x897 bytes) 2024-09-21T22:16:18.169 INFO:teuthology.orchestra.run.smithi134.stdout:2390 trunc from 0xec3dc83 to 0xb4f376b 2024-09-21T22:16:18.184 INFO:teuthology.orchestra.run.smithi134.stdout:2391 write 0xbd09b68 thru 0xbd0fbb0 (0x6049 bytes) 2024-09-21T22:16:18.185 INFO:teuthology.orchestra.run.smithi134.stdout:2392 punch from 0xa06ac5 to 0xa0b34f, (0x488a bytes) 2024-09-21T22:16:18.185 INFO:teuthology.orchestra.run.smithi134.stdout:2393 read 0x76ae8e thru 0x770bd3 (0x5d46 bytes) 2024-09-21T22:16:18.186 INFO:teuthology.orchestra.run.smithi134.stdout:2394 read 0xb56793d thru 0xb56cea3 (0x5567 bytes) 2024-09-21T22:16:18.186 INFO:teuthology.orchestra.run.smithi134.stdout:2395 read 0x95c6fa5 thru 0x95d4625 (0xd681 bytes) 2024-09-21T22:16:18.187 INFO:teuthology.orchestra.run.smithi134.stdout:2397 write 0x8e13557 thru 0x8e137ee (0x298 bytes) 2024-09-21T22:16:18.188 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.189 INFO:teuthology.orchestra.run.smithi134.stdout:2400 write 0x7a01e51 thru 0x7a08598 (0x6748 bytes) 2024-09-21T22:16:18.190 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.190 INFO:teuthology.orchestra.run.smithi134.stdout:2402 write 0x927a8ed thru 0x928944c (0xeb60 bytes) 2024-09-21T22:16:18.192 INFO:teuthology.orchestra.run.smithi134.stdout:2403 write 0x7ce24a2 thru 0x7ce4625 (0x2184 bytes) 2024-09-21T22:16:18.195 INFO:teuthology.orchestra.run.smithi134.stdout:2404 punch from 0x2363573 to 0x236b9d5, (0x8462 bytes) 2024-09-21T22:16:18.195 INFO:teuthology.orchestra.run.smithi134.stdout:2406 punch from 0x8cce1c1 to 0x8cdb609, (0xd448 bytes) 2024-09-21T22:16:18.195 INFO:teuthology.orchestra.run.smithi134.stdout:2409 read 0x5c3852f thru 0x5c3b70c (0x31de bytes) 2024-09-21T22:16:18.195 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.195 INFO:teuthology.orchestra.run.smithi134.stdout:2413 punch from 0xa073224 to 0xa0750d8, (0x1eb4 bytes) 2024-09-21T22:16:18.195 INFO:teuthology.orchestra.run.smithi134.stdout:2414 read 0x8e3f8b7 thru 0x8e40193 (0x8dd bytes) 2024-09-21T22:16:18.195 INFO:teuthology.orchestra.run.smithi134.stdout:2416 read 0x2c7cd41 thru 0x2c890a8 (0xc368 bytes) 2024-09-21T22:16:18.196 INFO:teuthology.orchestra.run.smithi134.stdout:2417 read 0x5952f80 thru 0x595322f (0x2b0 bytes) 2024-09-21T22:16:18.203 INFO:teuthology.orchestra.run.smithi134.stdout:2418 writesame 0xe382da7 thru 0xe383a53 data_size 0xb(0xcad bytes) 2024-09-21T22:16:18.205 INFO:teuthology.orchestra.run.smithi134.stdout:2419 read 0x5e28a6b thru 0x5e362ee (0xd884 bytes) 2024-09-21T22:16:18.210 INFO:teuthology.orchestra.run.smithi134.stdout:2420 trunc from 0xe383a54 to 0xaf9a388 2024-09-21T22:16:18.213 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:18.213 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:18.222 INFO:teuthology.orchestra.run.smithi134.stdout:2422 trunc from 0xaf9a388 to 0x9640076 2024-09-21T22:16:18.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:18.233 INFO:teuthology.orchestra.run.smithi134.stdout:2423 punch from 0x10fd46a to 0x1107e7a, (0xaa10 bytes) 2024-09-21T22:16:18.233 INFO:teuthology.orchestra.run.smithi134.stdout:2425 punch from 0x4b410e1 to 0x4b4eba5, (0xdac4 bytes) 2024-09-21T22:16:18.234 INFO:teuthology.orchestra.run.smithi134.stdout:2426 write 0x7a8b87a thru 0x7a9990a (0xe091 bytes) 2024-09-21T22:16:18.235 INFO:teuthology.orchestra.run.smithi134.stdout:2428 read 0x5cc8519 thru 0x5cc9b13 (0x15fb bytes) 2024-09-21T22:16:18.249 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:18.247+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:18.249 INFO:teuthology.orchestra.run.smithi134.stdout:2429 write 0xed0e1f5 thru 0xed0f3dc (0x11e8 bytes) 2024-09-21T22:16:18.250 INFO:teuthology.orchestra.run.smithi134.stdout:2430 writesame 0x7ffa1f3 thru 0x7fffc4f data_size 0xb(0x5a5d bytes) 2024-09-21T22:16:18.252 INFO:teuthology.orchestra.run.smithi134.stdout:2431 punch from 0x24887f7 to 0x248d7d5, (0x4fde bytes) 2024-09-21T22:16:18.273 INFO:teuthology.orchestra.run.smithi134.stdout:2432 trunc from 0xed0f3dd to 0xbfda85 2024-09-21T22:16:18.297 INFO:teuthology.orchestra.run.smithi134.stdout:2433 trunc from 0xbfda85 to 0xbf72600 2024-09-21T22:16:18.302 INFO:teuthology.orchestra.run.smithi134.stdout:2434 writesame 0x3d11680 thru 0x3d131c2 data_size 0x1(0x1b43 bytes) 2024-09-21T22:16:18.305 INFO:teuthology.orchestra.run.smithi134.stdout:2435 punch from 0x554cb4 to 0x55dfb8, (0x9304 bytes) 2024-09-21T22:16:18.305 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.305 INFO:teuthology.orchestra.run.smithi134.stdout:2437 read 0x61c5b5d thru 0x61cd9a5 (0x7e49 bytes) 2024-09-21T22:16:18.305 INFO:teuthology.orchestra.run.smithi134.stdout:2438 write 0x4741bdd thru 0x474243d (0x861 bytes) 2024-09-21T22:16:18.308 INFO:teuthology.orchestra.run.smithi134.stdout:2439 trunc from 0xbf72600 to 0xce3f6a8 2024-09-21T22:16:18.313 INFO:teuthology.orchestra.run.smithi134.stdout:2440 read 0x87c2fc2 thru 0x87cf0d7 (0xc116 bytes) 2024-09-21T22:16:18.314 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.314 INFO:teuthology.orchestra.run.smithi134.stdout:2442 read 0x2a0891a thru 0x2a0bf15 (0x35fc bytes) 2024-09-21T22:16:18.314 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.314 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.314 INFO:teuthology.orchestra.run.smithi134.stdout:2445 read 0x1af594a thru 0x1b00260 (0xa917 bytes) 2024-09-21T22:16:18.322 INFO:teuthology.orchestra.run.smithi134.stdout:2446 write 0xe02103b thru 0xe022cf9 (0x1cbf bytes) 2024-09-21T22:16:18.323 INFO:teuthology.orchestra.run.smithi134.stdout:2447 read 0x78eb1c2 thru 0x78f0483 (0x52c2 bytes) 2024-09-21T22:16:18.324 INFO:teuthology.orchestra.run.smithi134.stdout:2448 read 0x70f14d0 thru 0x70fb357 (0x9e88 bytes) 2024-09-21T22:16:18.324 INFO:teuthology.orchestra.run.smithi134.stdout:2451 write 0xaecd7e5 thru 0xaece687 (0xea3 bytes) 2024-09-21T22:16:18.325 INFO:teuthology.orchestra.run.smithi134.stdout:2452 write 0x89fdfac thru 0x8a06083 (0x80d8 bytes) 2024-09-21T22:16:18.327 INFO:teuthology.orchestra.run.smithi134.stdout:2454 writesame 0x2168038 thru 0x2169d02 data_size 0x1b(0x1ccb bytes) 2024-09-21T22:16:18.328 INFO:teuthology.orchestra.run.smithi134.stdout:2455 write 0xdc7d75a thru 0xdc8aa75 (0xd31c bytes) 2024-09-21T22:16:18.330 INFO:teuthology.orchestra.run.smithi134.stdout:2456 read 0xbe92e5b thru 0xbe97adc (0x4c82 bytes) 2024-09-21T22:16:18.341 INFO:teuthology.orchestra.run.smithi134.stdout:2457 trunc from 0xe022cfa to 0x4ad8322 2024-09-21T22:16:18.349 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:18.347+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:18.351 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.351 INFO:teuthology.orchestra.run.smithi134.stdout:2460 punch from 0x8f17cb to 0x8fc251, (0xaa86 bytes) 2024-09-21T22:16:18.352 INFO:teuthology.orchestra.run.smithi134.stdout:2461 trunc from 0x4ad8322 to 0x59fd92e 2024-09-21T22:16:18.359 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:18.359 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:18.362 INFO:teuthology.orchestra.run.smithi134.stdout:2462 trunc from 0x59fd92e to 0x976b3a4 2024-09-21T22:16:18.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:18.377 INFO:teuthology.orchestra.run.smithi134.stdout:2463 writesame 0xcc226d8 thru 0xcc29319 data_size 0x3e(0x6c42 bytes) 2024-09-21T22:16:18.385 INFO:teuthology.orchestra.run.smithi134.stdout:2464 trunc from 0xcc2931a to 0x70a53cb 2024-09-21T22:16:18.394 INFO:teuthology.orchestra.run.smithi134.stdout:2465 punch from 0x1ecc98 to 0x1fbd18, (0xf080 bytes) 2024-09-21T22:16:18.395 INFO:teuthology.orchestra.run.smithi134.stdout:2466 read 0x203b32c thru 0x203ce1c (0x1af1 bytes) 2024-09-21T22:16:18.395 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.397 INFO:teuthology.orchestra.run.smithi134.stdout:2470 trunc from 0x70a53cb to 0x90e3a18 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 62, 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:16:17.875300+0000", 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:59.900683+0000", 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:15:09.268171+0000", 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:16:18.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5804032, 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "nodeep-scrub", 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 5, 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 3, 2024-09-21T22:16:18.403 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "jewel", 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:16:18.404 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:16:18.405 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:16:18.406 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:16:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:16:18.408 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.409 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 8, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 8, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.25, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:16:18.410 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:16:18.411 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:16:18.413 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:16:18.414 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:16:18.415 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.9900000095367432, 2024-09-21T22:16:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.9900000095367432, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 1.75, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 1.75, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "pool_client.0", 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:34.502611+0000", 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:16:18.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 32, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 32, 2024-09-21T22:16:18.418 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 32, 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 32, 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 32, 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "62", 2024-09-21T22:16:18.419 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 20, 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 62, 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:16:18.420 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:16:18.421 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:16:18.422 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.5, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.5, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1, 2024-09-21T22:16:18.423 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 1.5, 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 1.5, 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:16:18.424 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 27, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:16:18.427 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.430 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:18.431 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 48, 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.434 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.436 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.437 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 45, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.439 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.440 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.440 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:16:18.440 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:18.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 13, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 26, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 45, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 48, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 27, 2024-09-21T22:16:18.445 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.447 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:16:18.449 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/704257458", 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/704257458", 2024-09-21T22:16:18.450 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/704257458", 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/704257458", 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 23, 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.452 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.454 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.455 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.456 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.457 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 45, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.458 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.461 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.463 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:18.464 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 47, 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:16:18.466 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.469 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:16:18.470 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 48, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.472 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.474 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:18.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:16:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:16:18.479 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 27 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.480 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.481 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.482 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:18.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [], 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:16:18.484 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [ 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 16, 2024-09-21T22:16:18.485 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 18, 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 20, 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.486 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [ 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 20, 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [], 2024-09-21T22:16:18.487 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:18.488 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:18.489 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.489 INFO:teuthology.orchestra.run.smithi134.stdout:2472 punch from 0x4668e4f to 0x4673214, (0xa3c5 bytes) 2024-09-21T22:16:18.489 INFO:teuthology.orchestra.run.smithi134.stdout:2473 read 0x3e4e62a thru 0x3e4f4f0 (0xec7 bytes) 2024-09-21T22:16:18.489 INFO:teuthology.orchestra.run.smithi134.stdout:2475 writesame 0x82bba84 thru 0x82cae47 data_size 0x2(0xf3c4 bytes) 2024-09-21T22:16:18.491 INFO:tasks.thrashosds.thrasher:j is {'epoch': 62, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:16:17.875300+0000', 'last_up_change': '2024-09-21T22:15:59.900683+0000', 'last_in_change': '2024-09-21T22:15:09.268171+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:15:34.502611+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 20, 'snap_epoch': 62, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 26, 'up_from': 45, 'up_thru': 48, 'down_at': 27, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 704257458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 704257458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 704257458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 704257458}]}, 'public_addr': '172.21.15.134:6809/704257458', 'cluster_addr': '172.21.15.134:6811/704257458', 'heartbeat_back_addr': '172.21.15.134:6815/704257458', 'heartbeat_front_addr': '172.21.15.134:6813/704257458', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 27}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 16, 'length': 1}, {'begin': 18, 'length': 1}, {'begin': 20, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 20, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:16:18.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:16:18.494 INFO:teuthology.orchestra.run.smithi134.stdout:2476 write 0xb2e7cbd thru 0xb2f0e13 (0x9157 bytes) 2024-09-21T22:16:18.494 INFO:teuthology.orchestra.run.smithi134.stdout:2477 punch from 0x4d9351d to 0x4d98ed6, (0x59b9 bytes) 2024-09-21T22:16:18.494 INFO:teuthology.orchestra.run.smithi134.stdout:2482 read 0x55d6b10 thru 0x55e43ef (0xd8e0 bytes) 2024-09-21T22:16:18.494 INFO:teuthology.orchestra.run.smithi134.stdout:2484 write 0xadfb259 thru 0xae052f9 (0xa0a1 bytes) 2024-09-21T22:16:18.494 INFO:teuthology.orchestra.run.smithi134.stdout:2485 read 0x3d379c2 thru 0x3d46e4a (0xf489 bytes) 2024-09-21T22:16:18.494 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.494 INFO:teuthology.orchestra.run.smithi134.stdout:2487 read 0x657cda thru 0x65d51b (0x5842 bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2489 read 0x170eb62 thru 0x170ee80 (0x31f bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2492 read 0x67303fb thru 0x6731027 (0xc2d bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2494 punch from 0x4fca1ff to 0x4fcb30b, (0x110c bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2497 read 0xdcd9fa thru 0xdda2b5 (0xc8bc bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2500 write 0xd6703a7 thru 0xd67a593 (0xa1ed bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2502 read 0x5174936 thru 0x517aa4a (0x6115 bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2503 write 0xcc93fe0 thru 0xcc99736 (0x5757 bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2504 trunc from 0xd67a594 to 0x49bdcd0 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2505 read 0x261276c thru 0x2621ade (0xf373 bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:2508 write 0x1dca491 thru 0x1dcfcde (0x584e bytes) 2024-09-21T22:16:18.495 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2512 trunc from 0x49bdcd0 to 0x1a188b6 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2513 writesame 0x8f74bf0 thru 0x8f83efc data_size 0x1(0xf30d bytes) 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2516 write 0x87a5c29 thru 0x87adf82 (0x835a bytes) 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2517 punch from 0x159f2d3 to 0x15a06ba, (0x13e7 bytes) 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2519 punch from 0x2cd0186 to 0x2cd5e9a, (0x5d14 bytes) 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2520 read 0x41cbebe thru 0x41cf4dc (0x361f bytes) 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2521 read 0x4dc6c6e thru 0x4dd34f9 (0xc88c bytes) 2024-09-21T22:16:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:2522 writesame 0x830529d thru 0x8313db9 data_size 0x1(0xeb1d bytes) 2024-09-21T22:16:18.496 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:18.492+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:18.498 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:18.498 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:18.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:18.518 INFO:teuthology.orchestra.run.smithi134.stdout:2523 read 0x6277df5 thru 0x6282828 (0xaa34 bytes) 2024-09-21T22:16:18.518 INFO:teuthology.orchestra.run.smithi134.stdout:2524 write 0x6f7669e thru 0x6f7fd76 (0x96d9 bytes) 2024-09-21T22:16:18.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:18.527 INFO:teuthology.orchestra.run.smithi134.stdout:2525 write 0xa3eac5b thru 0xa3eee53 (0x41f9 bytes) 2024-09-21T22:16:18.533 INFO:teuthology.orchestra.run.smithi134.stdout:2527 trunc from 0xa3eee54 to 0xdfc83be 2024-09-21T22:16:18.539 INFO:teuthology.orchestra.run.smithi134.stdout:2528 write 0x6678fc8 thru 0x6688031 (0xf06a bytes) 2024-09-21T22:16:18.541 INFO:teuthology.orchestra.run.smithi134.stdout:2529 writesame 0x5a3fbf8 thru 0x5a4c049 data_size 0xd(0xc452 bytes) 2024-09-21T22:16:18.544 INFO:teuthology.orchestra.run.smithi134.stdout:2530 punch from 0x797243b to 0x797c44f, (0xa014 bytes) 2024-09-21T22:16:18.544 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.544 INFO:teuthology.orchestra.run.smithi134.stdout:2532 write 0xd9e8ad4 thru 0xd9eca7b (0x3fa8 bytes) 2024-09-21T22:16:18.546 INFO:teuthology.orchestra.run.smithi134.stdout:2533 writesame 0x964884f thru 0x9651163 data_size 0x1(0x8915 bytes) 2024-09-21T22:16:18.563 INFO:teuthology.orchestra.run.smithi134.stdout:2534 read 0xc6e4446 thru 0xc6f3853 (0xf40e bytes) 2024-09-21T22:16:18.563 INFO:teuthology.orchestra.run.smithi134.stdout:2535 write 0x7a8a3c7 thru 0x7a96b8e (0xc7c8 bytes) 2024-09-21T22:16:18.565 INFO:teuthology.orchestra.run.smithi134.stdout:2538 write 0xaa11324 thru 0xaa135d3 (0x22b0 bytes) 2024-09-21T22:16:18.567 INFO:teuthology.orchestra.run.smithi134.stdout:2539 read 0x2088a0b thru 0x2096585 (0xdb7b bytes) 2024-09-21T22:16:18.567 INFO:teuthology.orchestra.run.smithi134.stdout:2540 read 0x997b9b1 thru 0x99817ba (0x5e0a bytes) 2024-09-21T22:16:18.568 INFO:teuthology.orchestra.run.smithi134.stdout:2541 write 0x3528625 thru 0x3535ca9 (0xd685 bytes) 2024-09-21T22:16:18.569 INFO:teuthology.orchestra.run.smithi134.stdout:2543 read 0x30510c3 thru 0x305f62d (0xe56b bytes) 2024-09-21T22:16:18.570 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.570 INFO:teuthology.orchestra.run.smithi134.stdout:2546 punch from 0x84373f4 to 0x843ea99, (0x76a5 bytes) 2024-09-21T22:16:18.570 INFO:teuthology.orchestra.run.smithi134.stdout:2547 write 0x6b65ea4 thru 0x6b6c255 (0x63b2 bytes) 2024-09-21T22:16:18.571 INFO:teuthology.orchestra.run.smithi134.stdout:2551 writesame 0x9ac27da thru 0x9ad020b data_size 0xb(0xda32 bytes) 2024-09-21T22:16:18.576 INFO:teuthology.orchestra.run.smithi134.stdout:2552 read 0x3457dd7 thru 0x345f1ec (0x7416 bytes) 2024-09-21T22:16:18.576 INFO:teuthology.orchestra.run.smithi134.stdout:2554 read 0x6ea6870 thru 0x6eb25dc (0xbd6d bytes) 2024-09-21T22:16:18.577 INFO:teuthology.orchestra.run.smithi134.stdout:2556 write 0xcfc17de thru 0xcfca0cc (0x88ef bytes) 2024-09-21T22:16:18.578 INFO:teuthology.orchestra.run.smithi134.stdout:2557 writesame 0x84f4161 thru 0x85003da data_size 0x1f(0xc27a bytes) 2024-09-21T22:16:18.581 INFO:teuthology.orchestra.run.smithi134.stdout:2558 punch from 0x3c8fd08 to 0x3c91832, (0x1b2a bytes) 2024-09-21T22:16:18.581 INFO:teuthology.orchestra.run.smithi134.stdout:2561 writesame 0x7f1795c thru 0x7f1a526 data_size 0x25(0x2bcb bytes) 2024-09-21T22:16:18.583 INFO:teuthology.orchestra.run.smithi134.stdout:2562 read 0xd07b8e5 thru 0xd08791f (0xc03b bytes) 2024-09-21T22:16:18.583 INFO:teuthology.orchestra.run.smithi134.stdout:2563 read 0x362a514 thru 0x3636daa (0xc897 bytes) 2024-09-21T22:16:18.585 INFO:teuthology.orchestra.run.smithi134.stdout:2564 trunc from 0xdfc83be to 0xe98ecd8 2024-09-21T22:16:18.590 INFO:teuthology.orchestra.run.smithi134.stdout:2567 read 0xb454539 thru 0xb457959 (0x3421 bytes) 2024-09-21T22:16:18.591 INFO:teuthology.orchestra.run.smithi134.stdout:2569 read 0x5f5bac2 thru 0x5f6a5f4 (0xeb33 bytes) 2024-09-21T22:16:18.591 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.591 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.591 INFO:teuthology.orchestra.run.smithi134.stdout:2572 writesame 0x3db1f39 thru 0x3dbf38d data_size 0x1(0xd455 bytes) 2024-09-21T22:16:18.595 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:18.593+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:18.614 INFO:teuthology.orchestra.run.smithi134.stdout:2573 write 0x4274ee7 thru 0x4279067 (0x4181 bytes) 2024-09-21T22:16:18.616 INFO:teuthology.orchestra.run.smithi134.stdout:2574 punch from 0x3a5ebe to 0x3a98ee, (0x3a30 bytes) 2024-09-21T22:16:18.625 INFO:teuthology.orchestra.run.smithi134.stdout:2577 trunc from 0xe98ecd8 to 0x69c57e0 2024-09-21T22:16:18.635 INFO:teuthology.orchestra.run.smithi134.stdout:2578 write 0x53711f6 thru 0x5378cca (0x7ad5 bytes) 2024-09-21T22:16:18.637 INFO:teuthology.orchestra.run.smithi134.stdout:2579 write 0x417bac0 thru 0x4180230 (0x4771 bytes) 2024-09-21T22:16:18.642 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:18.642 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:18.646 INFO:teuthology.orchestra.run.smithi134.stdout:2581 trunc from 0x69c57e0 to 0xd2eee23 2024-09-21T22:16:18.652 INFO:teuthology.orchestra.run.smithi134.stdout:2582 writesame 0xa67bdf9 thru 0xa67cfcc data_size 0xe(0x11d4 bytes) 2024-09-21T22:16:18.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:18.664 INFO:teuthology.orchestra.run.smithi134.stdout:2583 trunc from 0xd2eee23 to 0x545ac61 2024-09-21T22:16:18.674 INFO:teuthology.orchestra.run.smithi134.stdout:2584 punch from 0x17cd5c9 to 0x17d842a, (0xae61 bytes) 2024-09-21T22:16:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:2585 write 0x6d0592c thru 0x6d14d3c (0xf411 bytes) 2024-09-21T22:16:18.683 INFO:teuthology.orchestra.run.smithi134.stdout:2590 punch from 0x26d0978 to 0x26d8372, (0x79fa bytes) 2024-09-21T22:16:18.694 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:18.694 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:18.695 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:18.693+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:18.698 INFO:teuthology.orchestra.run.smithi134.stdout:2591 write 0xdf0ff88 thru 0xdf153be (0x5437 bytes) 2024-09-21T22:16:18.700 INFO:teuthology.orchestra.run.smithi134.stdout:2592 trunc from 0xdf153bf to 0xd850dd9 2024-09-21T22:16:18.714 INFO:teuthology.orchestra.run.smithi134.stdout:2593 writesame 0x58fab7f thru 0x590a29f data_size 0x1(0xf721 bytes) 2024-09-21T22:16:18.718 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:18.718 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:18.734 INFO:teuthology.orchestra.run.smithi134.stdout:2596 read 0x1041219 thru 0x104e670 (0xd458 bytes) 2024-09-21T22:16:18.735 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.735 INFO:teuthology.orchestra.run.smithi134.stdout:2599 read 0x98d585f thru 0x98e2aa9 (0xd24b bytes) 2024-09-21T22:16:18.737 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:18.737 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:18.737 INFO:teuthology.orchestra.run.smithi134.stdout:2600 trunc from 0xd850dd9 to 0xc6a8015 2024-09-21T22:16:18.749 INFO:teuthology.orchestra.run.smithi134.stdout:2601 write 0x9acf589 thru 0x9ad32ae (0x3d26 bytes) 2024-09-21T22:16:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.750 INFO:teuthology.orchestra.run.smithi134.stdout:2603 writesame 0x18620fc thru 0x186410f data_size 0x2(0x2014 bytes) 2024-09-21T22:16:18.753 INFO:teuthology.orchestra.run.smithi134.stdout:2604 writesame 0x4e485a7 thru 0x4e4cc6e data_size 0x3c(0x46c8 bytes) 2024-09-21T22:16:18.754 INFO:teuthology.orchestra.run.smithi134.stdout:2605 punch from 0xc1632af to 0xc171fae, (0xecff bytes) 2024-09-21T22:16:18.754 INFO:teuthology.orchestra.run.smithi134.stdout:2606 read 0x2305120 thru 0x2308b0f (0x39f0 bytes) 2024-09-21T22:16:18.761 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:18.761 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:18.769 INFO:teuthology.orchestra.run.smithi134.stdout:2607 trunc from 0xc6a8015 to 0x1acc56e 2024-09-21T22:16:18.781 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:18.781 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:18.782 INFO:teuthology.orchestra.run.smithi134.stdout:2608 read 0x17eafd1 thru 0x17f8f60 (0xdf90 bytes) 2024-09-21T22:16:18.782 INFO:teuthology.orchestra.run.smithi134.stdout:2609 read 0x71da50 thru 0x720bce (0x317f bytes) 2024-09-21T22:16:18.792 INFO:teuthology.orchestra.run.smithi134.stdout:2612 write 0x4f3ba33 thru 0x4f4599d (0x9f6b bytes) 2024-09-21T22:16:18.796 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:18.796 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:18.796 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:18.797 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:18.797 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:18.794+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:18.799 INFO:teuthology.orchestra.run.smithi134.stdout:2613 trunc from 0x4f4599e to 0x8e60d80 2024-09-21T22:16:18.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:18.802 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:18.805 INFO:teuthology.orchestra.run.smithi134.stdout:2614 writesame 0x7b2b708 thru 0x7b35ed3 data_size 0x2(0xa7cc bytes) 2024-09-21T22:16:18.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:18.817 INFO:teuthology.orchestra.run.smithi134.stdout:2615 read 0x3d451ad thru 0x3d46aed (0x1941 bytes) 2024-09-21T22:16:18.817 INFO:teuthology.orchestra.run.smithi134.stdout:2618 write 0x73f1a90 thru 0x73f3d69 (0x22da bytes) 2024-09-21T22:16:18.819 INFO:teuthology.orchestra.run.smithi134.stdout:2619 punch from 0xcb2ddf to 0xcb5f04, (0x3125 bytes) 2024-09-21T22:16:18.819 INFO:teuthology.orchestra.run.smithi134.stdout:2620 read 0x8179887 thru 0x8187fcf (0xe749 bytes) 2024-09-21T22:16:18.819 INFO:teuthology.orchestra.run.smithi134.stdout:2621 read 0x1bfb5cc thru 0x1c08fcf (0xda04 bytes) 2024-09-21T22:16:18.819 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.820 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:18.821 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:18.824 INFO:teuthology.orchestra.run.smithi134.stdout:2623 trunc from 0x8e60d80 to 0xd6016b3 2024-09-21T22:16:18.836 INFO:teuthology.orchestra.run.smithi134.stdout:2624 writesame 0xd7be6ee thru 0xd7c3bf8 data_size 0x3b(0x550b bytes) 2024-09-21T22:16:18.838 INFO:teuthology.orchestra.run.smithi134.stdout:2625 read 0x5b86c45 thru 0x5b90380 (0x973c bytes) 2024-09-21T22:16:18.838 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.838 INFO:teuthology.orchestra.run.smithi134.stdout:2627 write 0x9e2d8ce thru 0x9e3b9c5 (0xe0f8 bytes) 2024-09-21T22:16:18.840 INFO:teuthology.orchestra.run.smithi134.stdout:2628 read 0xc3f3d63 thru 0xc40396d (0xfc0b bytes) 2024-09-21T22:16:18.842 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:18.842 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:18.845 INFO:teuthology.orchestra.run.smithi134.stdout:2630 trunc from 0xd7c3bf9 to 0x9362364 2024-09-21T22:16:18.855 INFO:teuthology.orchestra.run.smithi134.stdout:2631 write 0x2c10ee thru 0x2c7221 (0x6134 bytes) 2024-09-21T22:16:18.857 INFO:teuthology.orchestra.run.smithi134.stdout:2632 writesame 0x5e01d6e thru 0x5e07019 data_size 0x4a(0x52ac bytes) 2024-09-21T22:16:18.868 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:18.869 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:16:18.869 INFO:teuthology.orchestra.run.smithi134.stdout:2633 trunc from 0x9362364 to 0x21ad45b 2024-09-21T22:16:18.875 INFO:teuthology.orchestra.run.smithi134.stdout:2636 read 0x1fb3566 thru 0x1fb7d3f (0x47da bytes) 2024-09-21T22:16:18.887 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-21T22:16:17.877403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":316903405,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":27394,"num_read_kb":297892,"num_write":7884,"num_write_kb":253583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":19591155,"num_keys_recovered":32,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4603,"ondisk_log_size":4603,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396996,"kb_used_data":133844,"kb_used_omap":15,"kb_used_meta":262896,"kb_avail":754577724,"statfs":{"total":773094113280,"available":772687589376,"internally_reserved":0,"allocated":137056256,"data_stored":133074950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":269206300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-49681040,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2836,"num_read_kb":26665,"num_write":761,"num_write_kb":10458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.696299"},"pg_stats":[{"pgid":"3.1f","version":"59'296","reported_seq":944,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.370389+0000","last_change":"2024-09-21T22:16:12.878153+0000","last_active":"2024-09-21T22:16:14.370389+0000","last_peered":"2024-09-21T22:16:14.370389+0000","last_clean":"2024-09-21T22:16:14.370389+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:16:14.370389+0000","last_undegraded":"2024-09-21T22:16:14.370389+0000","last_fullsized":"2024-09-21T22:16:14.370389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:06:12.392679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036130599999999999,"stat_sum":{"num_bytes":15445690,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1513,"num_read_kb":12428,"num_write":563,"num_write_kb":11042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.1e","version":"55'184","reported_seq":1484,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T22:16:12.879320+0000","last_change":"2024-09-21T22:16:12.879593+0000","last_active":"2024-09-21T22:16:12.879320+0000","last_peered":"2024-09-21T22:16:12.879320+0000","last_clean":"2024-09-21T22:16:12.879320+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:16:12.879320+0000","last_undegraded":"2024-09-21T22:16:12.879320+0000","last_fullsized":"2024-09-21T22:16:12.879320+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:54:48.495374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001064969,"stat_sum":{"num_bytes":11037222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2240,"num_read_kb":12260,"num_write":215,"num_write_kb":5784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.1d","version":"55'130","reported_seq":1304,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.014852+0000","last_change":"2024-09-21T22:16:12.939879+0000","last_active":"2024-09-21T22:16:14.014852+0000","last_peered":"2024-09-21T22:16:14.014852+0000","last_clean":"2024-09-21T22:16:14.014852+0000","last_became_active":"2024-09-21T22:15:36.449655+0000","last_became_peered":"2024-09-21T22:15:36.449655+0000","last_unstale":"2024-09-21T22:16:14.014852+0000","last_undegraded":"2024-09-21T22:16:14.014852+0000","last_fullsized":"2024-09-21T22:16:14.014852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:36:30.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033653099999999999,"stat_sum":{"num_bytes":20540651,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1370,"num_read_kb":22610,"num_write":254,"num_write_kb":13981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.1c","version":"59'132","reported_seq":633,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.315361+0000","last_change":"2024-09-21T22:16:12.940392+0000","last_active":"2024-09-21T22:16:14.315361+0000","last_peered":"2024-09-21T22:16:14.315361+0000","last_clean":"2024-09-21T22:16:14.315361+0000","last_became_active":"2024-09-21T22:15:36.449203+0000","last_became_peered":"2024-09-21T22:15:36.449203+0000","last_unstale":"2024-09-21T22:16:14.315361+0000","last_undegraded":"2024-09-21T22:16:14.315361+0000","last_fullsized":"2024-09-21T22:16:14.315361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:14.191740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074927900000000005,"stat_sum":{"num_bytes":13404218,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":417,"num_read_kb":9683,"num_write":246,"num_write_kb":12274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.1b","version":"52'86","reported_seq":452,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.980164+0000","last_change":"2024-09-21T22:16:12.878706+0000","last_active":"2024-09-21T22:16:13.980164+0000","last_peered":"2024-09-21T22:16:13.980164+0000","last_clean":"2024-09-21T22:16:13.980164+0000","last_became_active":"2024-09-21T22:15:36.451889+0000","last_became_peered":"2024-09-21T22:15:36.451889+0000","last_unstale":"2024-09-21T22:16:13.980164+0000","last_undegraded":"2024-09-21T22:16:13.980164+0000","last_fullsized":"2024-09-21T22:16:13.980164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:47:47.701103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083991899999999995,"stat_sum":{"num_bytes":5229636,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":8190,"num_write":179,"num_write_kb":6745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.1a","version":"55'53","reported_seq":699,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.397833+0000","last_change":"2024-09-21T22:16:12.878567+0000","last_active":"2024-09-21T22:16:14.397833+0000","last_peered":"2024-09-21T22:16:14.397833+0000","last_clean":"2024-09-21T22:16:14.397833+0000","last_became_active":"2024-09-21T22:15:36.445163+0000","last_became_peered":"2024-09-21T22:15:36.445163+0000","last_unstale":"2024-09-21T22:16:14.397833+0000","last_undegraded":"2024-09-21T22:16:14.397833+0000","last_fullsized":"2024-09-21T22:16:14.397833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:57.660682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054352399999999998,"stat_sum":{"num_bytes":3028076,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1762,"num_write":89,"num_write_kb":4442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.19","version":"55'178","reported_seq":1156,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.241534+0000","last_change":"2024-09-21T22:16:13.014870+0000","last_active":"2024-09-21T22:16:14.241534+0000","last_peered":"2024-09-21T22:16:14.241534+0000","last_clean":"2024-09-21T22:16:14.241534+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:16:14.241534+0000","last_undegraded":"2024-09-21T22:16:14.241534+0000","last_fullsized":"2024-09-21T22:16:14.241534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:09.882361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076462170000000003,"stat_sum":{"num_bytes":7733248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1842,"num_read_kb":8398,"num_write":265,"num_write_kb":7017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.18","version":"58'220","reported_seq":309,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.897991+0000","last_change":"2024-09-21T22:16:12.878847+0000","last_active":"2024-09-21T22:16:13.897991+0000","last_peered":"2024-09-21T22:16:13.897991+0000","last_clean":"2024-09-21T22:16:13.897991+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:16:13.897991+0000","last_undegraded":"2024-09-21T22:16:13.897991+0000","last_fullsized":"2024-09-21T22:16:13.897991+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:47:03.772864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059189699999999997,"stat_sum":{"num_bytes":10084402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":606,"num_read_kb":3413,"num_write":362,"num_write_kb":7888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.17","version":"59'96","reported_seq":930,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.246303+0000","last_change":"2024-09-21T22:16:12.878362+0000","last_active":"2024-09-21T22:16:14.246303+0000","last_peered":"2024-09-21T22:16:14.246303+0000","last_clean":"2024-09-21T22:16:14.246303+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:16:14.246303+0000","last_undegraded":"2024-09-21T22:16:14.246303+0000","last_fullsized":"2024-09-21T22:16:14.246303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:11:00.017743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051862100000000003,"stat_sum":{"num_bytes":7024128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1042,"num_read_kb":7476,"num_write":195,"num_write_kb":9433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.16","version":"59'81","reported_seq":838,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.350168+0000","last_change":"2024-09-21T22:16:12.939877+0000","last_active":"2024-09-21T22:16:14.350168+0000","last_peered":"2024-09-21T22:16:14.350168+0000","last_clean":"2024-09-21T22:16:14.350168+0000","last_became_active":"2024-09-21T22:15:36.451714+0000","last_became_peered":"2024-09-21T22:15:36.451714+0000","last_unstale":"2024-09-21T22:16:14.350168+0000","last_undegraded":"2024-09-21T22:16:14.350168+0000","last_fullsized":"2024-09-21T22:16:14.350168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:15:49.104419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037240400000000001,"stat_sum":{"num_bytes":11210453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":618,"num_read_kb":11307,"num_write":160,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.15","version":"56'194","reported_seq":937,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.999814+0000","last_change":"2024-09-21T22:16:12.929132+0000","last_active":"2024-09-21T22:16:13.999814+0000","last_peered":"2024-09-21T22:16:13.999814+0000","last_clean":"2024-09-21T22:16:13.999814+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:16:13.999814+0000","last_undegraded":"2024-09-21T22:16:13.999814+0000","last_fullsized":"2024-09-21T22:16:13.999814+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:24:31.328989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037311799999999997,"stat_sum":{"num_bytes":16142116,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1122,"num_read_kb":16898,"num_write":361,"num_write_kb":15953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.14","version":"59'123","reported_seq":687,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.303422+0000","last_change":"2024-09-21T22:16:12.878514+0000","last_active":"2024-09-21T22:16:14.303422+0000","last_peered":"2024-09-21T22:16:14.303422+0000","last_clean":"2024-09-21T22:16:14.303422+0000","last_became_active":"2024-09-21T22:15:36.448788+0000","last_became_peered":"2024-09-21T22:15:36.448788+0000","last_unstale":"2024-09-21T22:16:14.303422+0000","last_undegraded":"2024-09-21T22:16:14.303422+0000","last_fullsized":"2024-09-21T22:16:14.303422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:47:31.371451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064358199999999996,"stat_sum":{"num_bytes":20550558,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":429,"num_read_kb":7475,"num_write":195,"num_write_kb":8009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.273005+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:16:14.273005+0000","last_peered":"2024-09-21T22:16:14.273005+0000","last_clean":"2024-09-21T22:16:14.273005+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:16:14.273005+0000","last_undegraded":"2024-09-21T22:16:14.273005+0000","last_fullsized":"2024-09-21T22:16:14.273005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"55'76","reported_seq":665,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.980028+0000","last_change":"2024-09-21T22:16:12.878804+0000","last_active":"2024-09-21T22:16:13.980028+0000","last_peered":"2024-09-21T22:16:13.980028+0000","last_clean":"2024-09-21T22:16:13.980028+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:16:13.980028+0000","last_undegraded":"2024-09-21T22:16:13.980028+0000","last_fullsized":"2024-09-21T22:16:13.980028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:15:21.886172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085104199999999999,"stat_sum":{"num_bytes":14631025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":448,"num_read_kb":14836,"num_write":155,"num_write_kb":10472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.241699+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:16:14.241699+0000","last_peered":"2024-09-21T22:16:14.241699+0000","last_clean":"2024-09-21T22:16:14.241699+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:16:14.241699+0000","last_undegraded":"2024-09-21T22:16:14.241699+0000","last_fullsized":"2024-09-21T22:16:14.241699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"58'83","reported_seq":643,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.840924+0000","last_change":"2024-09-21T22:16:12.879612+0000","last_active":"2024-09-21T22:16:13.840924+0000","last_peered":"2024-09-21T22:16:13.840924+0000","last_clean":"2024-09-21T22:16:13.840924+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:16:13.840924+0000","last_undegraded":"2024-09-21T22:16:13.840924+0000","last_fullsized":"2024-09-21T22:16:13.840924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:14:34.065394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088670899999999996,"stat_sum":{"num_bytes":7113715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":8223,"num_write":154,"num_write_kb":5538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.999964+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:16:13.999964+0000","last_peered":"2024-09-21T22:16:13.999964+0000","last_clean":"2024-09-21T22:16:13.999964+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:16:13.999964+0000","last_undegraded":"2024-09-21T22:16:13.999964+0000","last_fullsized":"2024-09-21T22:16:13.999964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"53'74","reported_seq":634,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.241656+0000","last_change":"2024-09-21T22:16:13.012593+0000","last_active":"2024-09-21T22:16:14.241656+0000","last_peered":"2024-09-21T22:16:14.241656+0000","last_clean":"2024-09-21T22:16:14.241656+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:16:14.241656+0000","last_undegraded":"2024-09-21T22:16:14.241656+0000","last_fullsized":"2024-09-21T22:16:14.241656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:13:01.097094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056057090000000004,"stat_sum":{"num_bytes":11033826,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":421,"num_read_kb":14444,"num_write":130,"num_write_kb":9274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.241760+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:16:14.241760+0000","last_peered":"2024-09-21T22:16:14.241760+0000","last_clean":"2024-09-21T22:16:14.241760+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:16:14.241760+0000","last_undegraded":"2024-09-21T22:16:14.241760+0000","last_fullsized":"2024-09-21T22:16:14.241760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'91","reported_seq":1262,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.014865+0000","last_change":"2024-09-21T22:16:12.940388+0000","last_active":"2024-09-21T22:16:14.014865+0000","last_peered":"2024-09-21T22:16:14.014865+0000","last_clean":"2024-09-21T22:16:14.014865+0000","last_became_active":"2024-09-21T22:16:00.921655+0000","last_became_peered":"2024-09-21T22:16:00.921655+0000","last_unstale":"2024-09-21T22:16:14.014865+0000","last_undegraded":"2024-09-21T22:16:14.014865+0000","last_fullsized":"2024-09-21T22:16:14.014865+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:41:23.987570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073787099999999997,"stat_sum":{"num_bytes":16517271,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1004,"num_read_kb":15979,"num_write":206,"num_write_kb":7948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.3","version":"52'83","reported_seq":482,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.982628+0000","last_change":"2024-09-21T22:16:12.878320+0000","last_active":"2024-09-21T22:16:13.982628+0000","last_peered":"2024-09-21T22:16:13.982628+0000","last_clean":"2024-09-21T22:16:13.982628+0000","last_became_active":"2024-09-21T22:15:36.447748+0000","last_became_peered":"2024-09-21T22:15:36.447748+0000","last_unstale":"2024-09-21T22:16:13.982628+0000","last_undegraded":"2024-09-21T22:16:13.982628+0000","last_fullsized":"2024-09-21T22:16:13.982628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:10:14.799795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046994000000000002,"stat_sum":{"num_bytes":6498980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":390,"num_read_kb":8735,"num_write":137,"num_write_kb":7791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.014550+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:16:14.014550+0000","last_peered":"2024-09-21T22:16:14.014550+0000","last_clean":"2024-09-21T22:16:14.014550+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:16:14.014550+0000","last_undegraded":"2024-09-21T22:16:14.014550+0000","last_fullsized":"2024-09-21T22:16:14.014550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"59'288","reported_seq":827,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:15.156475+0000","last_change":"2024-09-21T22:16:13.014433+0000","last_active":"2024-09-21T22:16:15.156475+0000","last_peered":"2024-09-21T22:16:15.156475+0000","last_clean":"2024-09-21T22:16:15.156475+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:16:15.156475+0000","last_undegraded":"2024-09-21T22:16:15.156475+0000","last_fullsized":"2024-09-21T22:16:15.156475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:21:52.967593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075488220000000002,"stat_sum":{"num_bytes":11622286,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1321,"num_read_kb":16051,"num_write":459,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.243261+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:16:14.243261+0000","last_peered":"2024-09-21T22:16:14.243261+0000","last_clean":"2024-09-21T22:16:14.243261+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:16:14.243261+0000","last_undegraded":"2024-09-21T22:16:14.243261+0000","last_fullsized":"2024-09-21T22:16:14.243261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'80","reported_seq":449,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.979929+0000","last_change":"2024-09-21T22:16:12.877792+0000","last_active":"2024-09-21T22:16:13.979929+0000","last_peered":"2024-09-21T22:16:13.979929+0000","last_clean":"2024-09-21T22:16:13.979929+0000","last_became_active":"2024-09-21T22:15:36.451816+0000","last_became_peered":"2024-09-21T22:15:36.451816+0000","last_unstale":"2024-09-21T22:16:13.979929+0000","last_undegraded":"2024-09-21T22:16:13.979929+0000","last_fullsized":"2024-09-21T22:16:13.979929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:40.744223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194499999999999,"stat_sum":{"num_bytes":4670338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":342,"num_read_kb":5953,"num_write":163,"num_write_kb":7558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.999779+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:16:13.999779+0000","last_peered":"2024-09-21T22:16:13.999779+0000","last_clean":"2024-09-21T22:16:13.999779+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:16:13.999779+0000","last_undegraded":"2024-09-21T22:16:13.999779+0000","last_fullsized":"2024-09-21T22:16:13.999779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"58'86","reported_seq":220,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.840396+0000","last_change":"2024-09-21T22:16:12.878843+0000","last_active":"2024-09-21T22:16:13.840396+0000","last_peered":"2024-09-21T22:16:13.840396+0000","last_clean":"2024-09-21T22:16:13.840396+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:16:13.840396+0000","last_undegraded":"2024-09-21T22:16:13.840396+0000","last_fullsized":"2024-09-21T22:16:13.840396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:48:47.108527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054336399999999996,"stat_sum":{"num_bytes":9120931,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":5485,"num_write":159,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.014569+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:16:14.014569+0000","last_peered":"2024-09-21T22:16:14.014569+0000","last_clean":"2024-09-21T22:16:14.014569+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:16:14.014569+0000","last_undegraded":"2024-09-21T22:16:14.014569+0000","last_fullsized":"2024-09-21T22:16:14.014569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.999790+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:16:13.999790+0000","last_peered":"2024-09-21T22:16:13.999790+0000","last_clean":"2024-09-21T22:16:13.999790+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:16:13.999790+0000","last_undegraded":"2024-09-21T22:16:13.999790+0000","last_fullsized":"2024-09-21T22:16:13.999790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"55'162","reported_seq":540,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.001867+0000","last_change":"2024-09-21T22:16:12.879262+0000","last_active":"2024-09-21T22:16:13.001867+0000","last_peered":"2024-09-21T22:16:13.001867+0000","last_clean":"2024-09-21T22:16:13.001867+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:16:13.001867+0000","last_undegraded":"2024-09-21T22:16:13.001867+0000","last_fullsized":"2024-09-21T22:16:13.001867+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:25:31.995938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074509900000000004,"stat_sum":{"num_bytes":7725144,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":4891,"num_write":277,"num_write_kb":8093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.9","version":"55'110","reported_seq":838,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.982463+0000","last_change":"2024-09-21T22:16:12.878296+0000","last_active":"2024-09-21T22:16:13.982463+0000","last_peered":"2024-09-21T22:16:13.982463+0000","last_clean":"2024-09-21T22:16:13.982463+0000","last_became_active":"2024-09-21T22:15:36.554061+0000","last_became_peered":"2024-09-21T22:15:36.554061+0000","last_unstale":"2024-09-21T22:16:13.982463+0000","last_undegraded":"2024-09-21T22:16:13.982463+0000","last_fullsized":"2024-09-21T22:16:13.982463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:22:53.057712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052192600000000003,"stat_sum":{"num_bytes":9755265,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1127,"num_read_kb":8660,"num_write":207,"num_write_kb":8121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.a","version":"58'87","reported_seq":648,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.272968+0000","last_change":"2024-09-21T22:16:12.924358+0000","last_active":"2024-09-21T22:16:14.272968+0000","last_peered":"2024-09-21T22:16:14.272968+0000","last_clean":"2024-09-21T22:16:14.272968+0000","last_became_active":"2024-09-21T22:15:36.449394+0000","last_became_peered":"2024-09-21T22:15:36.449394+0000","last_unstale":"2024-09-21T22:16:14.272968+0000","last_undegraded":"2024-09-21T22:16:14.272968+0000","last_fullsized":"2024-09-21T22:16:14.272968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:53:40.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009842169999999999,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":2791,"num_write":117,"num_write_kb":2976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.b","version":"58'456","reported_seq":849,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.900857+0000","last_change":"2024-09-21T22:16:12.879320+0000","last_active":"2024-09-21T22:16:13.900857+0000","last_peered":"2024-09-21T22:16:13.900857+0000","last_clean":"2024-09-21T22:16:13.900857+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:16:13.900857+0000","last_undegraded":"2024-09-21T22:16:13.900857+0000","last_fullsized":"2024-09-21T22:16:13.900857+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:52:27.529120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083054099999999996,"stat_sum":{"num_bytes":7543047,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2507,"num_read_kb":5908,"num_write":725,"num_write_kb":6790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.c","version":"52'20","reported_seq":336,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.014680+0000","last_change":"2024-09-21T22:16:12.940330+0000","last_active":"2024-09-21T22:16:14.014680+0000","last_peered":"2024-09-21T22:16:14.014680+0000","last_clean":"2024-09-21T22:16:14.014680+0000","last_became_active":"2024-09-21T22:16:00.921657+0000","last_became_peered":"2024-09-21T22:16:00.921657+0000","last_unstale":"2024-09-21T22:16:14.014680+0000","last_undegraded":"2024-09-21T22:16:14.014680+0000","last_fullsized":"2024-09-21T22:16:14.014680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:56:51.152331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053793700000000005,"stat_sum":{"num_bytes":4111397,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":4076,"num_write":21,"num_write_kb":1717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.d","version":"55'125","reported_seq":494,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.999906+0000","last_change":"2024-09-21T22:16:12.929647+0000","last_active":"2024-09-21T22:16:13.999906+0000","last_peered":"2024-09-21T22:16:13.999906+0000","last_clean":"2024-09-21T22:16:13.999906+0000","last_became_active":"2024-09-21T22:15:36.450576+0000","last_became_peered":"2024-09-21T22:15:36.450576+0000","last_unstale":"2024-09-21T22:16:13.999906+0000","last_undegraded":"2024-09-21T22:16:13.999906+0000","last_fullsized":"2024-09-21T22:16:13.999906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:36:18.419132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084448599999999998,"stat_sum":{"num_bytes":6389760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":7783,"num_write":237,"num_write_kb":7386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.e","version":"55'53","reported_seq":314,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.999956+0000","last_change":"2024-09-21T22:16:12.929686+0000","last_active":"2024-09-21T22:16:13.999956+0000","last_peered":"2024-09-21T22:16:13.999956+0000","last_clean":"2024-09-21T22:16:13.999956+0000","last_became_active":"2024-09-21T22:15:36.452314+0000","last_became_peered":"2024-09-21T22:15:36.452314+0000","last_unstale":"2024-09-21T22:16:13.999956+0000","last_undegraded":"2024-09-21T22:16:13.999956+0000","last_fullsized":"2024-09-21T22:16:13.999956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:29:30.314555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068383699999999996,"stat_sum":{"num_bytes":2064346,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":3051,"num_write":127,"num_write_kb":4668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.f","version":"59'139","reported_seq":522,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.303811+0000","last_change":"2024-09-21T22:16:12.929398+0000","last_active":"2024-09-21T22:16:14.303811+0000","last_peered":"2024-09-21T22:16:14.303811+0000","last_clean":"2024-09-21T22:16:14.303811+0000","last_became_active":"2024-09-21T22:15:36.452701+0000","last_became_peered":"2024-09-21T22:15:36.452701+0000","last_unstale":"2024-09-21T22:16:14.303811+0000","last_undegraded":"2024-09-21T22:16:14.303811+0000","last_fullsized":"2024-09-21T22:16:14.303811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:27:43.288445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063361899999999998,"stat_sum":{"num_bytes":12135745,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":381,"num_read_kb":7229,"num_write":243,"num_write_kb":9760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.10","version":"52'67","reported_seq":605,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.272968+0000","last_change":"2024-09-21T22:16:12.923637+0000","last_active":"2024-09-21T22:16:14.272968+0000","last_peered":"2024-09-21T22:16:14.272968+0000","last_clean":"2024-09-21T22:16:14.272968+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:16:14.272968+0000","last_undegraded":"2024-09-21T22:16:14.272968+0000","last_fullsized":"2024-09-21T22:16:14.272968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:47.889938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027932500000000003,"stat_sum":{"num_bytes":10377952,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":401,"num_read_kb":9406,"num_write":112,"num_write_kb":3421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.11","version":"52'49","reported_seq":628,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.999783+0000","last_change":"2024-09-21T22:16:12.929164+0000","last_active":"2024-09-21T22:16:13.999783+0000","last_peered":"2024-09-21T22:16:13.999783+0000","last_clean":"2024-09-21T22:16:13.999783+0000","last_became_active":"2024-09-21T22:15:36.451421+0000","last_became_peered":"2024-09-21T22:15:36.451421+0000","last_unstale":"2024-09-21T22:16:13.999783+0000","last_undegraded":"2024-09-21T22:16:13.999783+0000","last_fullsized":"2024-09-21T22:16:13.999783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:16.640528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000480598,"stat_sum":{"num_bytes":9045077,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":438,"num_read_kb":9918,"num_write":72,"num_write_kb":7189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.12","version":"59'224","reported_seq":847,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:13.980010+0000","last_change":"2024-09-21T22:16:12.877977+0000","last_active":"2024-09-21T22:16:13.980010+0000","last_peered":"2024-09-21T22:16:13.980010+0000","last_clean":"2024-09-21T22:16:13.980010+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:16:13.980010+0000","last_undegraded":"2024-09-21T22:16:13.980010+0000","last_fullsized":"2024-09-21T22:16:13.980010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:11:49.497913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054290299999999996,"stat_sum":{"num_bytes":7367717,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1303,"num_read_kb":3816,"num_write":350,"num_write_kb":8844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.13","version":"59'357","reported_seq":1025,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-21T22:16:14.189811+0000","last_change":"2024-09-21T22:16:12.929366+0000","last_active":"2024-09-21T22:16:14.189811+0000","last_peered":"2024-09-21T22:16:14.189811+0000","last_clean":"2024-09-21T22:16:14.189811+0000","last_became_active":"2024-09-21T22:15:36.450372+0000","last_became_peered":"2024-09-21T22:15:36.450372+0000","last_unstale":"2024-09-21T22:16:14.189811+0000","last_undegraded":"2024-09-21T22:16:14.189811+0000","last_fullsized":"2024-09-21T22:16:14.189811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:19:27.891444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060503800000000002,"stat_sum":{"num_bytes":15061646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2110,"num_read_kb":18657,"num_write":588,"num_write_kb":6011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":316313018,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":27278,"num_read_kb":297792,"num_write":7723,"num_write_kb":251165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":19591155,"num_keys_recovered":32,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130453504,"data_stored":129460960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4483,"ondisk_log_size":4483,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":19740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":20213760,"data_stored":19700117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1662976,"data_stored":1251153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48532,"kb_used_data":17344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323308,"statfs":{"total":96636764160,"available":96587067392,"internally_reserved":0,"allocated":17760256,"data_stored":17233130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63028,"kb_used_data":27616,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94308812,"statfs":{"total":96636764160,"available":96572223488,"internally_reserved":0,"allocated":28278784,"data_stored":27739036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528324,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48224,"kb_used_data":15944,"kb_used_omap":4,"kb_used_meta":32251,"kb_avail":94323616,"statfs":{"total":96636764160,"available":96587382784,"internally_reserved":0,"allocated":16326656,"data_stored":15744470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":33025714},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42420,"kb_used_data":11232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329420,"statfs":{"total":96636764160,"available":96593326080,"internally_reserved":0,"allocated":11501568,"data_stored":11077539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51064,"kb_used_data":19876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94320776,"statfs":{"total":96636764160,"available":96584474624,"internally_reserved":0,"allocated":20353024,"data_stored":19879243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55812,"kb_used_data":20468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94316028,"statfs":{"total":96636764160,"available":96579612672,"internally_reserved":0,"allocated":20959232,"data_stored":20450262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19689472,"data_stored":19552973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19664896,"data_stored":19571443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10797056,"data_stored":10751361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15654912,"data_stored":15442520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27570176,"data_stored":27404445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17137664,"data_stored":16981212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":991232,"data_stored":949205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18948096,"data_stored":18807801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:16:18.889 INFO:tasks.thrashosds.thrasher:Setting 3.16 to [1, 2] 2024-09-21T22:16:18.889 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.16', '1', '2'] 2024-09-21T22:16:18.889 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.16 1 2 2024-09-21T22:16:18.890 INFO:teuthology.orchestra.run.smithi134.stdout:2637 writesame 0x6feabf4 thru 0x6ffa883 data_size 0x24(0xfc90 bytes) 2024-09-21T22:16:18.891 INFO:teuthology.orchestra.run.smithi134.stdout:2638 read 0x35c67f9 thru 0x35c6a55 (0x25d bytes) 2024-09-21T22:16:18.891 INFO:teuthology.orchestra.run.smithi134.stdout:2639 write 0x4465355 thru 0x44689b9 (0x3665 bytes) 2024-09-21T22:16:18.891 INFO:teuthology.orchestra.run.smithi134.stdout:2643 read 0x50cea5 thru 0x511ccd (0x4e29 bytes) 2024-09-21T22:16:18.892 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.892 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:16:18.905 INFO:teuthology.orchestra.run.smithi134.stdout:2646 write 0xd79793b thru 0xd7a61bc (0xe882 bytes) 2024-09-21T22:16:18.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:18.903+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:18.907 INFO:teuthology.orchestra.run.smithi134.stdout:2647 read 0x1674574 thru 0x167b39a (0x6e27 bytes) 2024-09-21T22:16:18.907 INFO:teuthology.orchestra.run.smithi134.stdout:2648 read 0xa61f0b2 thru 0xa620362 (0x12b1 bytes) 2024-09-21T22:16:18.907 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.907 INFO:teuthology.orchestra.run.smithi134.stdout:2650 read 0x15d75e6 thru 0x15d7e2f (0x84a bytes) 2024-09-21T22:16:18.907 INFO:teuthology.orchestra.run.smithi134.stdout:2651 punch from 0xcbbfaee to 0xcbbfebc, (0x3ce bytes) 2024-09-21T22:16:18.922 INFO:teuthology.orchestra.run.smithi134.stdout:2652 trunc from 0xd7a61bd to 0x4170416 2024-09-21T22:16:18.936 INFO:teuthology.orchestra.run.smithi134.stdout:2654 write 0x55693dd thru 0x55769b3 (0xd5d7 bytes) 2024-09-21T22:16:18.938 INFO:teuthology.orchestra.run.smithi134.stdout:2655 write 0x27280b9 thru 0x2730bd3 (0x8b1b bytes) 2024-09-21T22:16:18.939 INFO:teuthology.orchestra.run.smithi134.stdout:2657 read 0x2091620 thru 0x209e82e (0xd20f bytes) 2024-09-21T22:16:18.940 INFO:teuthology.orchestra.run.smithi134.stdout:2659 read 0x226452c thru 0x22656f5 (0x11ca bytes) 2024-09-21T22:16:18.940 INFO:teuthology.orchestra.run.smithi134.stdout:2660 read 0x77e34d thru 0x78bda2 (0xda56 bytes) 2024-09-21T22:16:18.941 INFO:teuthology.orchestra.run.smithi134.stdout:2661 read 0x5d47b0 thru 0x5d51af (0xa00 bytes) 2024-09-21T22:16:18.954 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:18.954 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:18.954 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:18.954 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:18.954 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:18.956 INFO:teuthology.orchestra.run.smithi134.stdout:2662 write 0xc55958f thru 0xc55c4a2 (0x2f14 bytes) 2024-09-21T22:16:18.957 INFO:teuthology.orchestra.run.smithi134.stdout:2663 punch from 0x6db3a44 to 0x6db3c37, (0x1f3 bytes) 2024-09-21T22:16:18.958 INFO:teuthology.orchestra.run.smithi134.stdout:2664 write 0x66292ef thru 0x6632f08 (0x9c1a bytes) 2024-09-21T22:16:18.959 INFO:teuthology.orchestra.run.smithi134.stdout:2665 writesame 0x407d7b0 thru 0x407fcf9 data_size 0x2b(0x254a bytes) 2024-09-21T22:16:18.961 INFO:teuthology.orchestra.run.smithi134.stdout:2666 read 0x5e732f1 thru 0x5e7d44b (0xa15b bytes) 2024-09-21T22:16:18.962 INFO:teuthology.orchestra.run.smithi134.stdout:2668 trunc from 0xc55c4a3 to 0xcf93715 2024-09-21T22:16:18.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:18.968 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.970 INFO:teuthology.orchestra.run.smithi134.stdout:2670 trunc from 0xcf93715 to 0xebb5428 2024-09-21T22:16:18.975 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.975 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:18.975 INFO:teuthology.orchestra.run.smithi134.stdout:2674 write 0xd3e6b21 thru 0xd3eed74 (0x8254 bytes) 2024-09-21T22:16:18.977 INFO:teuthology.orchestra.run.smithi134.stdout:2675 read 0xa439ea9 thru 0xa4415d3 (0x772b bytes) 2024-09-21T22:16:18.980 INFO:teuthology.orchestra.run.smithi134.stdout:2676 trunc from 0xebb5428 to 0xcbb6046 2024-09-21T22:16:18.990 INFO:teuthology.orchestra.run.smithi134.stdout:2677 write 0xb680af7 thru 0xb682f8c (0x2496 bytes) 2024-09-21T22:16:18.992 INFO:teuthology.orchestra.run.smithi134.stdout:2678 read 0x2d19e2f thru 0x2d26f4f (0xd121 bytes) 2024-09-21T22:16:18.992 INFO:teuthology.orchestra.run.smithi134.stdout:2679 write 0x2ef32f0 thru 0x2efec37 (0xb948 bytes) 2024-09-21T22:16:18.994 INFO:teuthology.orchestra.run.smithi134.stdout:2682 read 0xca2c84b thru 0xca3ba39 (0xf1ef bytes) 2024-09-21T22:16:18.995 INFO:teuthology.orchestra.run.smithi134.stdout:2683 writesame 0x2dd61f2 thru 0x2de5267 data_size 0x7(0xf076 bytes) 2024-09-21T22:16:18.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:18.996+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:19.000 INFO:teuthology.orchestra.run.smithi134.stdout:2685 punch from 0xae1d2a1 to 0xae2be10, (0xeb6f bytes) 2024-09-21T22:16:19.000 INFO:teuthology.orchestra.run.smithi134.stdout:2689 write 0x52bdeb4 thru 0x52bf927 (0x1a74 bytes) 2024-09-21T22:16:19.001 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:19.001 INFO:teuthology.orchestra.run.smithi134.stdout:2691 read 0x80e32b8 thru 0x80e9cf4 (0x6a3d bytes) 2024-09-21T22:16:19.002 INFO:teuthology.orchestra.run.smithi134.stdout:2693 read 0xbc65362 thru 0xbc7115b (0xbdfa bytes) 2024-09-21T22:16:19.002 INFO:teuthology.orchestra.run.smithi134.stdout:2694 punch from 0x67d9106 to 0x67e2b2a, (0x9a24 bytes) 2024-09-21T22:16:19.002 INFO:teuthology.orchestra.run.smithi134.stdout:2695 read 0xc4e868b thru 0xc4edfaf (0x5925 bytes) 2024-09-21T22:16:19.003 INFO:teuthology.orchestra.run.smithi134.stdout:2698 writesame 0x7c364a4 thru 0x7c36519 data_size 0x2(0x76 bytes) 2024-09-21T22:16:19.004 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:19.004 INFO:teuthology.orchestra.run.smithi134.stdout:2702 read 0x675b02d thru 0x6769be9 (0xebbd bytes) 2024-09-21T22:16:19.017 INFO:teuthology.orchestra.run.smithi134.stdout:2704 trunc from 0xcbb6046 to 0x3866b43 2024-09-21T22:16:19.046 INFO:teuthology.orchestra.run.smithi134.stdout:2705 writesame 0xdb6ed0a thru 0xdb7cb67 data_size 0x1(0xde5e bytes) 2024-09-21T22:16:19.047 INFO:teuthology.orchestra.run.smithi134.stdout:2710 read 0x5f28620 thru 0x5f2dfdd (0x59be bytes) 2024-09-21T22:16:19.059 INFO:teuthology.orchestra.run.smithi134.stdout:2711 trunc from 0xdb7cb68 to 0x3b97b50 2024-09-21T22:16:19.088 INFO:teuthology.orchestra.run.smithi134.stdout:2712 write 0xe8e0ea6 thru 0xe8ebf78 (0xb0d3 bytes) 2024-09-21T22:16:19.089 INFO:teuthology.orchestra.run.smithi134.stdout:2715 punch from 0xad9932c to 0xad9d531, (0x4205 bytes) 2024-09-21T22:16:19.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:19.096+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:19.108 INFO:teuthology.orchestra.run.smithi134.stdout:2716 trunc from 0xe8ebf79 to 0x1a773a3 2024-09-21T22:16:19.117 INFO:teuthology.orchestra.run.smithi134.stdout:2717 read 0xd00deb thru 0xd08586 (0x779c bytes) 2024-09-21T22:16:19.133 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:19.133 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:956 3.6 e30/23 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.634551571000003, 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091893070000000007, 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497369+0000", 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001336804 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497387+0000", 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8014999999999999e-05 2024-09-21T22:16:19.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497398+0000", 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1581e-05 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497480+0000", 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1874999999999998e-05 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497511+0000", 2024-09-21T22:16:19.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1103999999999999e-05 2024-09-21T22:16:19.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505165+0000", 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076536219999999997 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505221+0000", 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6026000000000002e-05 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.139 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:960 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.632618020000002, 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084308620000000008, 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 960 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:19.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497968+0000", 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.429e-06 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498743+0000", 2024-09-21T22:16:19.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077512399999999997 2024-09-21T22:16:19.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498766+0000", 2024-09-21T22:16:19.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2983999999999999e-05 2024-09-21T22:16:19.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498790+0000", 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389e-05 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498881+0000", 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0780999999999997e-05 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498890+0000", 2024-09-21T22:16:19.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7579999999999998e-06 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500819+0000", 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929491 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500968+0000", 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014854199999999999 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501114+0000", 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146298 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505622+0000", 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045081649999999997 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506247+0000", 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062455099999999999 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506353+0000", 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010586699999999999 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506396+0000", 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3482999999999997e-05 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.148 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2346 3.0 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:19.148 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:19.148 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.615581226000003, 2024-09-21T22:16:19.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083135759999999996, 2024-09-21T22:16:19.148 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.148 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.148 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2346 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515003+0000", 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-06 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515950+0000", 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094629499999999999 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515967+0000", 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7554000000000002e-05 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515974+0000", 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516038+0000", 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3176999999999995e-05 2024-09-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516167+0000", 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012979800000000001 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516306+0000", 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138887 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522280+0000", 2024-09-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059732750000000001 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523229+0000", 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094895000000000005 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523280+0000", 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1554999999999997e-05 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523316+0000", 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5602999999999998e-05 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2364 3.0 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head [write 0~983607 [fadvise_sequential+fadvise_nocache],write 1048576~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.603455672999999, 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077052980000000002, 2024-09-21T22:16:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2364 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527129+0000", 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527492+0000", 2024-09-21T22:16:19.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036298100000000001 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527504+0000", 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1814000000000001e-05 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527510+0000", 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4649999999999999e-06 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527564+0000", 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3893000000000001e-05 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527665+0000", 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101468 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527817+0000", 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015177100000000001 2024-09-21T22:16:19.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534445+0000", 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066276169999999997 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534752+0000", 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030757499999999998 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534799+0000", 2024-09-21T22:16:19.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6310000000000002e-05 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534833+0000", 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341999999999997e-05 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7887 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.726674501000002, 2024-09-21T22:16:19.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019112581, 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7887 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403910+0000", 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3300000000000001e-07 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403914+0000", 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1370000000000004e-06 2024-09-21T22:16:19.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403924+0000", 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0365e-05 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403929+0000", 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403979+0000", 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0420000000000002e-05 2024-09-21T22:16:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.404033+0000", 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3489999999999998e-05 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.407250+0000", 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003216975 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422946+0000", 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015696266 2024-09-21T22:16:19.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422957+0000", 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0608000000000001e-05 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422987+0000", 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0552999999999997e-05 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.423021+0000", 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4056000000000001e-05 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:7887 3.4 e41/23 ondisk, result = 0)", 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.714370930000001, 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067395329999999998, 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416213+0000", 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416216+0000", 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0989999999999999e-06 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416227+0000", 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0604e-05 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416232+0000", 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.938e-06 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422936+0000", 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067038089999999998 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422942+0000", 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5939999999999999e-06 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422952+0000", 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8090000000000004e-06 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.169 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7981 3.0 3:03cb8c30:::rbd_data.1185acca6c1f.000000000000001b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.617241234000002, 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015150808999999999, 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.170 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7981 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513343+0000", 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6000000000000003e-07 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513347+0000", 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9910000000000004e-06 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513358+0000", 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0772e-05 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513363+0000", 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1490000000000002e-06 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513403+0000", 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0290000000000002e-05 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513450+0000", 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7349999999999999e-05 2024-09-21T22:16:19.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.515475+0000", 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020249640000000002 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528357+0000", 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012881782 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528396+0000", 2024-09-21T22:16:19.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8674000000000003e-05 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528438+0000", 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2006999999999999e-05 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528493+0000", 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.507e-05 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8534 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.968338259999999, 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013031713, 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.176 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8534 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162246+0000", 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162250+0000", 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9550000000000002e-06 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162259+0000", 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5780000000000005e-06 2024-09-21T22:16:19.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162264+0000", 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162312+0000", 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7361000000000003e-05 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162368+0000", 2024-09-21T22:16:19.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6104999999999999e-05 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.164384+0000", 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020158120000000001 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175199+0000", 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010815455 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175212+0000", 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2422000000000001e-05 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175243+0000", 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1142000000000001e-05 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175277+0000", 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4057999999999998e-05 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.216078896999999, 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:19.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13497 3.0 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head [write 0~49152 [fadvise_sequential+fadvise_nocache],write 98304~98304 [fadvise_sequential+fadvise_nocache],write 262144~98304 [fadvise_sequential+fadvise_nocache],write 409600~114688 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.132525+0000", 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.998057949, 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050977899999999996, 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13497 2024-09-21T22:16:19.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132525+0000", 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132525+0000", 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132527+0000", 2024-09-21T22:16:19.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3799999999999999e-06 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132632+0000", 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105326 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132646+0000", 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3929e-05 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132652+0000", 2024-09-21T22:16:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1680000000000001e-06 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132694+0000", 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2239e-05 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132816+0000", 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012131800000000001 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.132938+0000", 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012274200000000001 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.134020+0000", 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010819600000000001 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137464+0000", 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003443776 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137559+0000", 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4481000000000006e-05 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137623+0000", 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4471e-05 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16577 3.0 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.726822347000001, 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056490309999999997, 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16577 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403762+0000", 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403773+0000", 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0584999999999999e-05 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403787+0000", 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4630999999999999e-05 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403796+0000", 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4500000000000004e-06 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403921+0000", 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012577000000000001 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404002+0000", 2024-09-21T22:16:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0626999999999999e-05 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404115+0000", 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113169 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.405859+0000", 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017439809999999999 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408749+0000", 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028899479999999998 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409367+0000", 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000617872 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409410+0000", 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2942999999999999e-05 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16593 3.4 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.721860065, 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051936209999999998, 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16593 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408724+0000", 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4099999999999997e-07 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408728+0000", 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9879999999999998e-06 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408737+0000", 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9760000000000001e-06 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408744+0000", 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7270000000000001e-06 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408800+0000", 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6351000000000003e-05 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408893+0000", 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3158999999999994e-05 2024-09-21T22:16:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409022+0000", 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915499999999999 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413621+0000", 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00459868 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413809+0000", 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018772299999999999 2024-09-21T22:16:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413868+0000", 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9611000000000002e-05 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413917+0000", 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8409999999999999e-05 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16618 3.4 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.713665797000001, 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085534029999999994, 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16618 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7599999999999996e-07 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416923+0000", 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.634e-06 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416935+0000", 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416943+0000", 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5860000000000005e-06 2024-09-21T22:16:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417028+0000", 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4352999999999997e-05 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417137+0000", 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109226 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417259+0000", 2024-09-21T22:16:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012192 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417821+0000", 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056199500000000003 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425374+0000", 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075528499999999998 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425426+0000", 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2179000000000003e-05 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425471+0000", 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5244000000000003e-05 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16629 3.19 3:9e091eba:::rbd_data.1185fc79843.00000000000000cf:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.710336905, 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053360919999999997, 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16629 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420247+0000", 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3099999999999996e-07 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420252+0000", 2024-09-21T22:16:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5249999999999999e-06 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420264+0000", 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2473999999999999e-05 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420271+0000", 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.64e-06 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420322+0000", 2024-09-21T22:16:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1354000000000003e-05 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420382+0000", 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9367999999999998e-05 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420451+0000", 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9521000000000001e-05 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425286+0000", 2024-09-21T22:16:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048351119999999999 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425478+0000", 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019156500000000001 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425536+0000", 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479e-05 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425583+0000", 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6223000000000001e-05 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16861 3.19 3:9ed45132:::rbd_data.1185fc79843.00000000000000fd:head [set-alloc-hint object_size 524288 write_size 524288,write 180224~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.578116+0000", 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.552467325, 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050333870000000003, 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16861 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578116+0000", 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578116+0000", 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578118+0000", 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6279999999999999e-06 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578133+0000", 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4881e-05 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578145+0000", 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2218000000000001e-05 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578151+0000", 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8109999999999999e-06 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578210+0000", 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9277999999999997e-05 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578294+0000", 2024-09-21T22:16:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4276000000000004e-05 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.578456+0000", 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000161426 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.580673+0000", 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022175799999999998 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.583082+0000", 2024-09-21T22:16:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024093589999999998 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.583120+0000", 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7866e-05 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.583149+0000", 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9064000000000002e-05 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16942 3.19 3:9cb4a31c:::rbd_data.1185fc79843.0000000000000160:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.470863286, 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005348022, 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16942 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659722+0000", 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9479999999999998e-06 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659731+0000", 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8619999999999992e-06 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659751+0000", 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0275000000000002e-05 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659761+0000", 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8530000000000004e-06 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659833+0000", 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2504999999999998e-05 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659932+0000", 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8164000000000004e-05 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.660693+0000", 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076168099999999995 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.663320+0000", 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026266140000000002 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.664952+0000", 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016316589999999999 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.665011+0000", 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9710999999999998e-05 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.665068+0000", 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6749999999999997e-05 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16959 3.19 3:9c0b7e71:::rbd_data.1185fc79843.000000000000006a:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.451021927999999, 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054482150000000002, 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16959 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679563+0000", 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2860000000000001e-06 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679568+0000", 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9799999999999998e-06 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679581+0000", 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3434999999999999e-05 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679588+0000", 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2110000000000001e-06 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679640+0000", 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2086999999999998e-05 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679753+0000", 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112991 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.680669+0000", 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00091544800000000002 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684899+0000", 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004229984 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684932+0000", 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3522999999999997e-05 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684966+0000", 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3735999999999997e-05 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.685010+0000", 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3534e-05 2024-09-21T22:16:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17128 3.19 3:9889dc56:::rbd_data.1185fc79843.0000000000000063:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.274059479, 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051858959999999997, 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17128 2024-09-21T22:16:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856526+0000", 2024-09-21T22:16:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.928e-06 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856533+0000", 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6070000000000002e-06 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856555+0000", 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1209e-05 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856564+0000", 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8179999999999999e-06 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856639+0000", 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4604999999999995e-05 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856738+0000", 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9291999999999997e-05 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856889+0000", 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015028599999999999 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.857493+0000", 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000604025 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861598+0000", 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041055880000000003 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861659+0000", 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0529999999999998e-05 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861710+0000", 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1007999999999997e-05 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17226 3.19 3:9e091eba:::rbd_data.1185fc79843.00000000000000cf:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.194442944, 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062013320000000004, 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17226 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936142+0000", 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3680000000000001e-06 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936148+0000", 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3840000000000002e-06 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936161+0000", 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2522e-05 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936169+0000", 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4149999999999999e-06 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936218+0000", 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9128999999999997e-05 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936277+0000", 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8832000000000002e-05 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.937245+0000", 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00096821899999999998 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.941109+0000", 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038635430000000001 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942246+0000", 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011373760000000001 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942294+0000", 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7478000000000002e-05 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942342+0000", 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8065999999999997e-05 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:26837 3.19 3:9ddb6656:::rbd_data.118527d5458b.0000000000000012:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7179795210000002, 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055045679999999996, 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26837 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412606+0000", 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0260000000000002e-06 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412613+0000", 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4100000000000002e-06 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412632+0000", 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8309e-05 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412641+0000", 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-06 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412719+0000", 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7086e-05 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412828+0000", 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010985 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412962+0000", 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013390799999999999 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.414950+0000", 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019879479999999998 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.417992+0000", 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030417339999999999 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.418053+0000", 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0572999999999998e-05 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.418108+0000", 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5804000000000003e-05 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.249 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:19.250 INFO:teuthology.orchestra.run.smithi134.stdout:2719 write 0xb8fe74d thru 0xb901377 (0x2c2b bytes) 2024-09-21T22:16:19.250 INFO:teuthology.orchestra.run.smithi134.stdout:2720 trunc from 0xb901378 to 0x69a09dc 2024-09-21T22:16:19.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2721 read 0x2cf7c55 thru 0x2d01809 (0x9bb5 bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2722 punch from 0x148fdbe to 0x14959bd, (0x5bff bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2723 read 0x6935b80 thru 0x6940067 (0xa4e8 bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2724 read 0x925c4a thru 0x92a9ae (0x4d65 bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2726 writesame 0x51501a6 thru 0x515ca26 data_size 0x1(0xc881 bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2727 read 0xa24f91 thru 0xa2f564 (0xa5d4 bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2728 write 0x59ab7e1 thru 0x59af902 (0x4122 bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2730 write 0xc672edc thru 0xc68106a (0xe18f bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2731 read 0x311bc52 thru 0x311f60b (0x39ba bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2732 read 0x716c944 thru 0x717b132 (0xe7ef bytes) 2024-09-21T22:16:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:2733 read 0x9952398 thru 0x9960816 (0xe47f bytes) 2024-09-21T22:16:19.254 INFO:teuthology.orchestra.run.smithi134.stdout:2734 punch from 0x429ebac to 0x429f8d4, (0xd28 bytes) 2024-09-21T22:16:19.254 INFO:teuthology.orchestra.run.smithi134.stdout:2735 read 0x8630a27 thru 0x863649e (0x5a78 bytes) 2024-09-21T22:16:19.254 INFO:teuthology.orchestra.run.smithi134.stdout:2736 clone 10 order 18 su 65536 sc 10 2024-09-21T22:16:19.254 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:19.249+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:19.352 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:19.350+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:19.396 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:19.396 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:19.396 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:19.396 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:19.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:19.453 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:19.452+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:19.547 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:19.548 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:19.554 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:19.552+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:19.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:19.655 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:19.654+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:19.701 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.198008201999997, 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:16:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.182824742999998, 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:16:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.171378304999998, 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:16:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2603 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'36, mlcod=34'34)", 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.700175287, 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032135610000000002, 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999129+0000", 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999139+0000", 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5300000000000002e-06 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999143+0000", 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999184+0000", 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999198+0000", 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3971999999999999e-05 2024-09-21T22:16:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002303+0000", 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031052179999999999 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002337+0000", 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3992000000000003e-05 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.651471965999999, 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:16:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2636 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'42, mlcod=34'40)", 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.640280738000001, 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033367480000000001, 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059019+0000", 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-06 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059029+0000", 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4509999999999998e-06 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059044+0000", 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5218000000000001e-05 2024-09-21T22:16:19.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059052+0000", 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059114+0000", 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2094999999999994e-05 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059139+0000", 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-05 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062305+0000", 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031661020000000001 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062355+0000", 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0129000000000001e-05 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.489537160000001, 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:16:19.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:16:19.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:8183 3.9 e41/23 3:915aea64:::rbd_data.1185acca6c1f.0000000000000012:head v 41'72, mlcod=41'69)", 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.9326778, 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031809400000000002, 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:19.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766622+0000", 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0500000000000003e-07 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766627+0000", 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9899999999999997e-06 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766634+0000", 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3669999999999999e-06 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766639+0000", 2024-09-21T22:16:19.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4070000000000001e-06 2024-09-21T22:16:19.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766677+0000", 2024-09-21T22:16:19.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7242e-05 2024-09-21T22:16:19.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766695+0000", 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8694000000000001e-05 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769713+0000", 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030172060000000001 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769802+0000", 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9429e-05 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9185 3.4 e42/23 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head v 42'42, mlcod=42'40)", 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.754079059999999, 2024-09-21T22:16:19.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033010399999999999, 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945221+0000", 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199999999999998e-07 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945226+0000", 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3449999999999996e-06 2024-09-21T22:16:19.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945236+0000", 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044e-05 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945241+0000", 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1499999999999998e-06 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945289+0000", 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7142999999999999e-05 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945310+0000", 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1314e-05 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948453+0000", 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031435539999999998 2024-09-21T22:16:19.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948521+0000", 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7422000000000006e-05 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9187 3.0 e42/23 3:057833b6:::rbd_data.1185acca6c1f.0000000000000004:head v 42'223, mlcod=42'221)", 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:19.748 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.754045374, 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003477997, 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7100000000000001e-07 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945256+0000", 2024-09-21T22:16:19.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5610000000000001e-06 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945261+0000", 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5290000000000002e-06 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945264+0000", 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.078e-06 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945304+0000", 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0345000000000001e-05 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945326+0000", 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1733999999999999e-05 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948698+0000", 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033719520000000001 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948732+0000", 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3627000000000002e-05 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.621291076999999, 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:19.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:16:19.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:12256 3.4 e50/23 3:22ba8708:::rbd_data.1185fc79843.0000000000000007:head v 50'45, mlcod=42'43)", 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.712579326, 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034474280000000002, 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986721+0000", 2024-09-21T22:16:19.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.178e-06 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987147+0000", 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042672899999999999 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987162+0000", 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4619e-05 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987171+0000", 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7900000000000005e-06 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987229+0000", 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8338000000000003e-05 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987251+0000", 2024-09-21T22:16:19.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2140000000000001e-05 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990117+0000", 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028654069999999999 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990167+0000", 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0226999999999999e-05 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.566203313999999, 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.295110625, 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:16:19.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16591 3.0 e51/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 51'238, mlcod=50'235)", 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.29134842, 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032416879999999999, 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407951+0000", 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8899999999999998e-07 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407957+0000", 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407971+0000", 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4246e-05 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407977+0000", 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5489999999999997e-06 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408027+0000", 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0488999999999997e-05 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408060+0000", 2024-09-21T22:16:19.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2595000000000002e-05 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.411148+0000", 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030882940000000001 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.411192+0000", 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3778e-05 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.290204051, 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:16:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.286993452000001, 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:16:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:16:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16615 3.0 e51/23 3:01d11d11:::rbd_data.1185fc79843.00000000000000c1:head v 51'239, mlcod=51'237)", 2024-09-21T22:16:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.282506578, 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031352709999999998, 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416793+0000", 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4300000000000002e-07 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416799+0000", 2024-09-21T22:16:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8969999999999996e-06 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416813+0000", 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4372000000000001e-05 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416820+0000", 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416868+0000", 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7376000000000002e-05 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416887+0000", 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9233e-05 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419885+0000", 2024-09-21T22:16:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029975929999999998 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419928+0000", 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2982999999999998e-05 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:16:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.281971755000001, 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.279984423, 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:16:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:19.804 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:19.806 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:19.807 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:19.804+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:19.886 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:16:19.890 INFO:teuthology.orchestra.run.smithi134.stderr:set 3.16 pg_upmap mapping to [1,2] 2024-09-21T22:16:19.906 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:19.904+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:19.914 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:19.914 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:19.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.914 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:32041 3.1c e63/23 3:3831950c:::rbd_directory:head v 63'155, mlcod=59'153)", 2024-09-21T22:16:19.914 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:19.913261+0000", 2024-09-21T22:16:19.914 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.00051184899999999998, 2024-09-21T22:16:19.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053156199999999996, 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913261+0000", 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913261+0000", 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:19.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913261+0000", 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.85e-07 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913265+0000", 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.489e-06 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913274+0000", 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4800000000000007e-06 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:19.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913280+0000", 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2279999999999998e-06 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913330+0000", 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9996e-05 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.913351+0000", 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0863e-05 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:19.917 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:19.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:19.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:19.918 INFO:teuthology.orchestra.run.smithi149.stdout: ], 2024-09-21T22:16:19.918 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 1 2024-09-21T22:16:19.918 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:19.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:20.009 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:20.007+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:20.069 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:20.070 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:20.070 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:20.070 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:20.070 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:20.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:20.121 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:20.119+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:20.208 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:20.207+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1598 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658810643000002, 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010531304999999999, 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1598 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564163+0000", 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4799999999999999e-07 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564165+0000", 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564171+0000", 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564176+0000", 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:16:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574511+0000", 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010335075000000001 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574600+0000", 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9220000000000003e-05 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574694+0000", 2024-09-21T22:16:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3848e-05 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1599 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1671168~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658791573000002, 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010750302, 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1599 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564182+0000", 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564184+0000", 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9539999999999998e-06 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564190+0000", 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.494e-06 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564195+0000", 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999999e-06 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574732+0000", 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010537556999999999 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574816+0000", 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4146000000000004e-05 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574932+0000", 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011539099999999999 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658771135999999, 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658729131000001, 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:16:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:16:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658631669000002, 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:16:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658576613000001, 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:16:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658534607, 2024-09-21T22:16:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658474009000003, 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:16:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.658451816000003, 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:16:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:16:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:16:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.657547008999998, 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:16:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:16:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.702112276999998, 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:16:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.698973035000002, 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:16:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:16:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2737 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 31.995942556999999, 2024-09-21T22:16:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010753749, 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2737 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0999999999999997e-07 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227036+0000", 2024-09-21T22:16:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227046+0000", 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227051+0000", 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000004e-06 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227099+0000", 2024-09-21T22:16:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7920000000000002e-05 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227152+0000", 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2753000000000001e-05 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.228909+0000", 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017568519999999999 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237712+0000", 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088031670000000006 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237722+0000", 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0478e-05 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237750+0000", 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7885000000000002e-05 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237784+0000", 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4186000000000001e-05 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.605959410000001, 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:16:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.650094117999998, 2024-09-21T22:16:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:16:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.544255568000001, 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:16:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.543238992999999, 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.308 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.542871226999999, 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:16:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.0245289279999996, 2024-09-21T22:16:20.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:16:20.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:16:20.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.0226530470000004, 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.324 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:20.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:20.326 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:20.324+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:20.426 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:20.424+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:20.429 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:20.429 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:20.429 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:20.429 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:20.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:20.527 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:20.526+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:20.583 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:20.583 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:20.583 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:20.583 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:20.583 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:20.592 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:20.636 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:20.634+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12142 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1802240~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:20.698 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748681157, 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030639835000000001, 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12142 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.05e-07 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947122+0000", 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.091e-06 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947125+0000", 2024-09-21T22:16:20.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.96e-06 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947128+0000", 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977404+0000", 2024-09-21T22:16:20.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030275976 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977491+0000", 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7390000000000002e-05 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977761+0000", 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026966300000000001 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.703 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12165 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1064960~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748609476, 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032863673000000003, 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.704 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12165 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1600000000000001e-07 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947196+0000", 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9040000000000001e-06 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947208+0000", 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1744e-05 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947214+0000", 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5779999999999998e-06 2024-09-21T22:16:20.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977797+0000", 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030583744999999999 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977874+0000", 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6417999999999999e-05 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980057+0000", 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002182668 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12166 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1146880~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748575186, 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033274597000000003, 2024-09-21T22:16:20.709 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12166 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:20.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947228+0000", 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9299999999999998e-07 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947233+0000", 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3700000000000003e-06 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947240+0000", 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.849e-06 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947245+0000", 2024-09-21T22:16:20.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0669999999999999e-06 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980090+0000", 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032845234000000001 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980172+0000", 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2191e-05 2024-09-21T22:16:20.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980502+0000", 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032939299999999998 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12167 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1228800~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748540833, 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035568130000000003, 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12167 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947262+0000", 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7899999999999998e-07 2024-09-21T22:16:20.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947264+0000", 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1969999999999999e-06 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947270+0000", 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2440000000000001e-06 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947274+0000", 2024-09-21T22:16:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6460000000000001e-06 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980550+0000", 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033275603000000001 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980646+0000", 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6144999999999995e-05 2024-09-21T22:16:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982830+0000", 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002183716 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12168 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1359872~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748521155000001, 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038517607000000002, 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12168 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947282+0000", 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947284+0000", 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0090000000000002e-06 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947289+0000", 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947301+0000", 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1661999999999999e-05 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982948+0000", 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035647146999999997 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.983078+0000", 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012943199999999999 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985799+0000", 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002721106 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12169 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1441792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748494235999999, 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039735563000000002, 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12169 2024-09-21T22:16:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947309+0000", 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947318+0000", 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4159999999999993e-06 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947326+0000", 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7989999999999994e-06 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947332+0000", 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3080000000000004e-06 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985831+0000", 2024-09-21T22:16:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038498917000000001 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985917+0000", 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6178000000000001e-05 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987044+0000", 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011264859999999999 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748462605, 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748442433999999, 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:16:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748423488, 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:16:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:16:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:16:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748404125, 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748371476999999, 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:16:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:16:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.74832031, 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:16:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748293638, 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:16:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:16:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:16:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748268839, 2024-09-21T22:16:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:16:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748237891, 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:16:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:16:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748213673, 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:16:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748189321, 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748165078, 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:16:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:16:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748135343, 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:16:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.748099872999999, 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:16:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:16:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:16:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:16:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.801 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:20.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:20.803 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:20.800+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:20.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:20.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:20.901+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:20.964 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:32499 3.10 3.9594bf30 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:20.964063+0000", 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.1709999999999998e-05, 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1476999999999993e-05, 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:20.965 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 32499 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:20.964063+0000", 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:20.964063+0000", 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:20.964063+0000", 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:20.964066+0000", 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9859999999999999e-06 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:20.964073+0000", 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:20.964077+0000", 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9360000000000001e-06 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:20.964122+0000", 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5092000000000001e-05 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: ], 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 1 2024-09-21T22:16:20.968 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:20.976 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:21.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:21.001+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:21.053 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:21.053 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:21.080 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:21.080 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:21.103 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:21.103 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:21.103 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:21.103 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:21.103 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:21.104 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:21.104 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:21.104 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:21.102+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:21.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:21.131 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:21.156 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:21.156 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:21.182 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:21.183 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:21.205 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:21.203+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:21.205 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:21.205 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:21.231 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:21.231 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:21.241 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:21.241 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:21.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:21.306 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:21.304+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:21.385 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:21.385 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:21.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:21.437 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:21.435+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:21.508 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:21.506+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:21.541 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:21.542 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:21.550 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:21.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:21.607+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:21.694 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:21.694 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:21.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:21.747 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:21.746+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:21.808 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:21.808 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:21.809 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:21.808+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:21.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:21.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:16:21.945 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:21.944+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:21.969 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:21.969 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:21.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:22.011 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:22.009+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:22.079 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-21T22:16:22.111 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:22.110+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:22.145 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:22.146 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:22.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:22.212 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:22.210+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:22.221 INFO:teuthology.orchestra.run.smithi134.stdout:2737 write 0xbdea298 thru 0xbdefb54 (0x58bd bytes) 2024-09-21T22:16:22.227 INFO:teuthology.orchestra.run.smithi134.stdout:2739 write 0x6f6816a thru 0x6f7136f (0x9206 bytes) 2024-09-21T22:16:22.231 INFO:teuthology.orchestra.run.smithi134.stdout:2741 read 0x9b9b0d4 thru 0x9ba351c (0x8449 bytes) 2024-09-21T22:16:22.231 INFO:teuthology.orchestra.run.smithi134.stdout:2743 punch from 0xcd50d6 to 0xcd5315, (0x23f bytes) 2024-09-21T22:16:22.231 INFO:teuthology.orchestra.run.smithi134.stdout:2744 read 0x224e4d8 thru 0x2258e47 (0xa970 bytes) 2024-09-21T22:16:22.232 INFO:teuthology.orchestra.run.smithi134.stdout:2745 write 0xe3667d thru 0xe37855 (0x11d9 bytes) 2024-09-21T22:16:22.234 INFO:teuthology.orchestra.run.smithi134.stdout:2746 writesame 0x9ecfc00 thru 0x9edd97d data_size 0x1(0xdd7e bytes) 2024-09-21T22:16:22.264 INFO:teuthology.orchestra.run.smithi134.stdout:2747 write 0x6281265 thru 0x628d82a (0xc5c6 bytes) 2024-09-21T22:16:22.268 INFO:teuthology.orchestra.run.smithi134.stdout:2748 write 0xc28e5f9 thru 0xc29d788 (0xf190 bytes) 2024-09-21T22:16:22.279 INFO:teuthology.orchestra.run.smithi134.stdout:2749 writesame 0xe05f1fb thru 0xe060ee9 data_size 0x3(0x1cef bytes) 2024-09-21T22:16:22.279 INFO:teuthology.orchestra.run.smithi134.stdout:2754 write 0x5b2db07 thru 0x5b2f014 (0x150e bytes) 2024-09-21T22:16:22.295 INFO:teuthology.orchestra.run.smithi134.stdout:2756 trunc from 0xe060eea to 0x3670e75 2024-09-21T22:16:22.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:22.312+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:22.321 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:22.321 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:22.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:22.382 INFO:teuthology.orchestra.run.smithi134.stdout:2757 trunc from 0x3670e75 to 0x316c180 2024-09-21T22:16:22.408 INFO:teuthology.orchestra.run.smithi134.stdout:2759 trunc from 0x316c180 to 0x2734dbe 2024-09-21T22:16:22.414 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:22.412+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:22.441 INFO:teuthology.orchestra.run.smithi134.stdout:2760 clone 11 order 24 su 1048576 sc 5 2024-09-21T22:16:22.488 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:22.488 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:22.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:22.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:22.537+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:22.616 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:22.615+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:22.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:22.734 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:22.733+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:22.794 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:22.794 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:22.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:22.818 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:22.816+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:16:22.918 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:22.917+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:22.953 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:22.954 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:22.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:23.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:23.018+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:23.066 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:23.066 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:23.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:23.120 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:23.118+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:23.219 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:23.219 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:23.220 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:23.218+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:23.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:23.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:23.321 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:23.320+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:23.332 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:23.332 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:23.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:23.392 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:23.409 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:23.409 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:23.421 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:23.420+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:23.425 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:23.458 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:23.458 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:23.466 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:23.466 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.963321096000001, 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:23.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.948137637000002, 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:16:23.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:16:23.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.936691199000002, 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:16:23.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:16:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2603 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'36, mlcod=34'34)", 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.465488180999998, 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032135610000000002, 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999124+0000", 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999129+0000", 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999139+0000", 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5300000000000002e-06 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999143+0000", 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999184+0000", 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:16:23.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:47.999198+0000", 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3971999999999999e-05 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002303+0000", 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031052179999999999 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.002337+0000", 2024-09-21T22:16:23.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3992000000000003e-05 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.41678486, 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:16:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:16:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2636 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'42, mlcod=34'40)", 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.405593631999999, 2024-09-21T22:16:23.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033367480000000001, 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059018+0000", 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059019+0000", 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-06 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059029+0000", 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4509999999999998e-06 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059044+0000", 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5218000000000001e-05 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059052+0000", 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0390000000000005e-06 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059114+0000", 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2094999999999994e-05 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.059139+0000", 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-05 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062305+0000", 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031661020000000001 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.062355+0000", 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0129000000000001e-05 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.254850054000002, 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:8183 3.9 e41/23 3:915aea64:::rbd_data.1185acca6c1f.0000000000000012:head v 41'72, mlcod=41'69)", 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.697990694000001, 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031809400000000002, 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766621+0000", 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766622+0000", 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0500000000000003e-07 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766627+0000", 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9899999999999997e-06 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766634+0000", 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3669999999999999e-06 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766639+0000", 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4070000000000001e-06 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766677+0000", 2024-09-21T22:16:23.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7242e-05 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.766695+0000", 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8694000000000001e-05 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769713+0000", 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030172060000000001 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.769802+0000", 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9429e-05 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9185 3.4 e42/23 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head v 42'42, mlcod=42'40)", 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.519391954, 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033010399999999999, 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945220+0000", 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945221+0000", 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199999999999998e-07 2024-09-21T22:16:23.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945226+0000", 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3449999999999996e-06 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945236+0000", 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044e-05 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945241+0000", 2024-09-21T22:16:23.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1499999999999998e-06 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945289+0000", 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7142999999999999e-05 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945310+0000", 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1314e-05 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948453+0000", 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031435539999999998 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948521+0000", 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7422000000000006e-05 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9187 3.0 e42/23 3:057833b6:::rbd_data.1185acca6c1f.0000000000000004:head v 42'223, mlcod=42'221)", 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.519358268000001, 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003477997, 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:23.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7100000000000001e-07 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945256+0000", 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5610000000000001e-06 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945261+0000", 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5290000000000002e-06 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945264+0000", 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.078e-06 2024-09-21T22:16:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945304+0000", 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0345000000000001e-05 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945326+0000", 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1733999999999999e-05 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948698+0000", 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033719520000000001 2024-09-21T22:16:23.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948732+0000", 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3627000000000002e-05 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.386603971, 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:16:23.509 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:12256 3.4 e50/23 3:22ba8708:::rbd_data.1185fc79843.0000000000000007:head v 50'45, mlcod=42'43)", 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.477892220000001, 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034474280000000002, 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986721+0000", 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.178e-06 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987147+0000", 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042672899999999999 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987162+0000", 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4619e-05 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987171+0000", 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7900000000000005e-06 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987229+0000", 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8338000000000003e-05 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987251+0000", 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2140000000000001e-05 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990117+0000", 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028654069999999999 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990167+0000", 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0226999999999999e-05 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.331516208, 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:16:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:16:23.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.060423519, 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:16:23.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:16:23.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:16:23.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16591 3.0 e51/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 51'238, mlcod=50'235)", 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.056661313999999, 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032416879999999999, 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407950+0000", 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407951+0000", 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8899999999999998e-07 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407957+0000", 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407971+0000", 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4246e-05 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.407977+0000", 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5489999999999997e-06 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408027+0000", 2024-09-21T22:16:23.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0488999999999997e-05 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408060+0000", 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2595000000000002e-05 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.411148+0000", 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030882940000000001 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.411192+0000", 2024-09-21T22:16:23.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3778e-05 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.055516945000001, 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:16:23.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:16:23.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.052306346000002, 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:16:23.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16615 3.0 e51/23 3:01d11d11:::rbd_data.1185fc79843.00000000000000c1:head v 51'239, mlcod=51'237)", 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.047819472, 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031352709999999998, 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416792+0000", 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416793+0000", 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4300000000000002e-07 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416799+0000", 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8969999999999996e-06 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416813+0000", 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4372000000000001e-05 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416820+0000", 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416868+0000", 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7376000000000002e-05 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416887+0000", 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9233e-05 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419885+0000", 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029975929999999998 2024-09-21T22:16:23.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419928+0000", 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2982999999999998e-05 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.047284649000002, 2024-09-21T22:16:23.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:16:23.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.045297316999999, 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:23.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:23.552 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:23.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:23.553 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:23.554 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:23.555 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:23.555 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:23.556 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:23.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:23.552+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:23.654 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:23.653+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:23.668 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:23.668 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:23.668 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:23.668 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:23.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:23.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:23.754+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:23.780 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:23.780 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:23.780 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:23.780 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:23.780 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:23.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:23.856 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:23.855+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1598 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327671205000001, 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010531304999999999, 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1598 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564162+0000", 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564163+0000", 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4799999999999999e-07 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564165+0000", 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564171+0000", 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564176+0000", 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7010000000000004e-06 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574511+0000", 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010335075000000001 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574600+0000", 2024-09-21T22:16:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9220000000000003e-05 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574694+0000", 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3848e-05 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1599 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1671168~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327652135000001, 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010750302, 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1599 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564181+0000", 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564182+0000", 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564184+0000", 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9539999999999998e-06 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564190+0000", 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.494e-06 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564195+0000", 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999999e-06 2024-09-21T22:16:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574732+0000", 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010537556999999999 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574816+0000", 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4146000000000004e-05 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574932+0000", 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011539099999999999 2024-09-21T22:16:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327631697999998, 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327589693, 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:16:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327492231000001, 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:16:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:16:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327437175, 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:16:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327395168999999, 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:16:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:16:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327334571000002, 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.327312378000002, 2024-09-21T22:16:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:16:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:16:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 40.326407570999997, 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:16:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.370972838999997, 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:16:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.367833597000001, 2024-09-21T22:16:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2737 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 35.664803118999998, 2024-09-21T22:16:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010753749, 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2737 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0999999999999997e-07 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227036+0000", 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227046+0000", 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227051+0000", 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000004e-06 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227099+0000", 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7920000000000002e-05 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227152+0000", 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2753000000000001e-05 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.228909+0000", 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017568519999999999 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237712+0000", 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088031670000000006 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237722+0000", 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0478e-05 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237750+0000", 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7885000000000002e-05 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237784+0000", 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4186000000000001e-05 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.274819972, 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:16:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.318954680000001, 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:16:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:16:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:16:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 17.21311613, 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:16:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:16:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 17.212099555000002, 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:16:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 17.211731789000002, 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:16:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:16:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:16:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.6933894899999995, 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:16:23.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.6915136089999994, 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:16:23.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:16:23.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:16:23.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:16:23.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.990 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:23.990 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:23.990 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:23.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:23.992 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:23.989+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:24.092 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:24.091+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:24.137 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:24.137 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:24.137 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:24.137 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:24.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:24.193 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:24.191+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:24.248 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:24.249 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:24.249 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:24.249 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:24.249 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:24.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:24.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:24.293+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:24.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:24.394+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:24.401 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12142 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1802240~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452703545999999, 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030639835000000001, 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12142 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947121+0000", 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.05e-07 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947122+0000", 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.091e-06 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947125+0000", 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.96e-06 2024-09-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947128+0000", 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977404+0000", 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030275976 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977491+0000", 2024-09-21T22:16:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7390000000000002e-05 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977761+0000", 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026966300000000001 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12165 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1064960~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452631865000001, 2024-09-21T22:16:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032863673000000003, 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12165 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947193+0000", 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1600000000000001e-07 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947196+0000", 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9040000000000001e-06 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947208+0000", 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1744e-05 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947214+0000", 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5779999999999998e-06 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977797+0000", 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.030583744999999999 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.977874+0000", 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6417999999999999e-05 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980057+0000", 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002182668 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12166 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1146880~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452597574999999, 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033274597000000003, 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12166 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947227+0000", 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947228+0000", 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9299999999999998e-07 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947233+0000", 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3700000000000003e-06 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947240+0000", 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.849e-06 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947245+0000", 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0669999999999999e-06 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980090+0000", 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.032845234000000001 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980172+0000", 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2191e-05 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980502+0000", 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032939299999999998 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12167 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1228800~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452563221999998, 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035568130000000003, 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12167 2024-09-21T22:16:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947261+0000", 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947262+0000", 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7899999999999998e-07 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947264+0000", 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1969999999999999e-06 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947270+0000", 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2440000000000001e-06 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947274+0000", 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6460000000000001e-06 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980550+0000", 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.033275603000000001 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.980646+0000", 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6144999999999995e-05 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982830+0000", 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002183716 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12168 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1359872~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452543544000001, 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038517607000000002, 2024-09-21T22:16:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12168 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947281+0000", 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947282+0000", 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947284+0000", 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0090000000000002e-06 2024-09-21T22:16:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947289+0000", 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947301+0000", 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1661999999999999e-05 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.982948+0000", 2024-09-21T22:16:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.035647146999999997 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.983078+0000", 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012943199999999999 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985799+0000", 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002721106 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12169 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1441792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452516625000001, 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039735563000000002, 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12169 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947308+0000", 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947309+0000", 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947318+0000", 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4159999999999993e-06 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947326+0000", 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7989999999999994e-06 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947332+0000", 2024-09-21T22:16:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3080000000000004e-06 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985831+0000", 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.038498917000000001 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.985917+0000", 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6178000000000001e-05 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987044+0000", 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011264859999999999 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452484993999999, 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452464823, 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:16:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:16:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:16:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452445876999999, 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:16:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452426513999999, 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:16:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452393866000001, 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:16:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:16:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452342698999999, 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:16:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452316026999998, 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452291228, 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:16:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:16:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452260280000001, 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:16:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:16:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452236062000001, 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:16:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.45221171, 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:16:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:16:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452187467000002, 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:16:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:16:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:16:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452157732, 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:16:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:16:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.452122262, 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:16:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:16:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:16:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.490 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:24.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:24.496 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:24.495+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:24.594 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:24.594 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:24.594 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:24.595 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:24.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:24.597+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:24.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:24.699 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:24.698+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:24.704 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:24.704 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:24.705 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:24.705 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:24.705 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:24.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:24.800 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:24.799+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.684999474000001, 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.818 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:16:24.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:16:24.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.655939652999997, 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.825 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:16:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:16:24.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.455725907000001, 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:24.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:16:24.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.304487090999999, 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:24.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:16:24.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:24.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:16:24.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:24.843 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.901544787999999, 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:16:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:16:24.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:24.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.901481932999999, 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.851 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:16:24.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:16:24.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15913 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427992516, 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011391615000000001, 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.857 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15913 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387909+0000", 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.16e-07 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387910+0000", 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8899999999999998e-07 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387914+0000", 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1559999999999999e-06 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387920+0000", 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399193+0000", 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011272262 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399239+0000", 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149000000000001e-05 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399301+0000", 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2042e-05 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.861 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427977954999999, 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:16:24.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:16:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427955700999998, 2024-09-21T22:16:24.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427931287, 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:16:24.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427901821999999, 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:24.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427874677999998, 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:16:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427855575999999, 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427831424000001, 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:16:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:16:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427807646000002, 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427788670999998, 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:16:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427769920999999, 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:16:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427737837999999, 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:16:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427724851000001, 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:16:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:16:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.427714602000002, 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:16:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:24.919 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:24.920 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:16:24.920 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:16:24.920 INFO:tasks.thrashosds.thrasher:Reweighting osd 2 to 0.985831336803633 2024-09-21T22:16:24.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 0.985831336803633 2024-09-21T22:16:24.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:16:24.923 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:24.923 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:24.919+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:24.969 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-21T22:16:25.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:25.021+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:25.070 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:25.071 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:25.071 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:25.071 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:25.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:25.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:25.121+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:25.182 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:25.182 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:25.182 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:25.182 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:25.182 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:25.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:25.233 INFO:teuthology.orchestra.run.smithi134.stdout:2762 clone 12 order 18 su 16384 sc 7 2024-09-21T22:16:25.235 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:25.233+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:25.297 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:25.297 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:25.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:25.297 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1018 3.15 3:ae013215:::rbd_data.1185ff358907.0000000000000002:head [write 0~1016375 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.787145580999997, 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019909570000000001, 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1018 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0399999999999996e-07 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509915+0000", 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018678049999999999 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509926+0000", 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0729e-05 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509937+0000", 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1447999999999999e-05 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522027+0000", 2024-09-21T22:16:25.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012089379000000001 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522161+0000", 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134525 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527828+0000", 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056671430000000004 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527880+0000", 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1329000000000003e-05 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527956+0000", 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6607999999999996e-05 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1139 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.769283870000002, 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017975142999999999, 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1139 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.304 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525911+0000", 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525917+0000", 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8599999999999998e-06 2024-09-21T22:16:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525921+0000", 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540743+0000", 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014821166 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540833+0000", 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0853000000000006e-05 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543884+0000", 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030503219999999998 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12419 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2375680~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.298093609999999, 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017663772000000001, 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.309 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12419 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997100+0000", 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.238e-06 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997103+0000", 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0089999999999999e-06 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997106+0000", 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4789999999999999e-06 2024-09-21T22:16:25.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014499+0000", 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017392764000000002 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014543+0000", 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4947000000000002e-05 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014763+0000", 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000219127 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12420 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2457600~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.298083602999998, 2024-09-21T22:16:25.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017934450000000001, 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12420 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:25.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:16:25.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997110+0000", 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0389999999999999e-06 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997113+0000", 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1250000000000001e-06 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997116+0000", 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.481e-06 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014801+0000", 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017685482999999998 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014850+0000", 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9107999999999998e-05 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015043+0000", 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000192991 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.319 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12421 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2539520~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.298073864999999, 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018190212000000001, 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12421 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.320 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997120+0000", 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0160000000000001e-06 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997124+0000", 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0300000000000004e-06 2024-09-21T22:16:25.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997128+0000", 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8689999999999997e-06 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015060+0000", 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017932303 2024-09-21T22:16:25.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015104+0000", 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3766000000000001e-05 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015309+0000", 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00020502399999999999 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12440 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2686976~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.298037835999999, 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562981999999999, 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12440 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.325 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997157+0000", 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7600000000000001e-06 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997161+0000", 2024-09-21T22:16:25.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6630000000000001e-06 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997165+0000", 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3270000000000001e-06 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015348+0000", 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018183263000000002 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015444+0000", 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5798999999999995e-05 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015718+0000", 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027377 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12441 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2768896~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.29802265, 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018855137000000001, 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12441 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0600000000000001e-07 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997172+0000", 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.708e-06 2024-09-21T22:16:25.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997177+0000", 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4729999999999999e-06 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997180+0000", 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015743+0000", 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562498 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015791+0000", 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8294000000000002e-05 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016025+0000", 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000234109 2024-09-21T22:16:25.334 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12442 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2850816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.298008857999999, 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019142308, 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.335 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12442 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997185+0000", 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.195e-06 2024-09-21T22:16:25.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997188+0000", 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2600000000000001e-06 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997192+0000", 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.968e-06 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016060+0000", 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018867816999999999 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016112+0000", 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1518999999999999e-05 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016326+0000", 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00021432800000000001 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12450 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2621440~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297930854000001, 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019490774999999998, 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12450 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2799999999999995e-07 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997266+0000", 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4429999999999999e-06 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997275+0000", 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5750000000000007e-06 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997281+0000", 2024-09-21T22:16:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.003e-06 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016367+0000", 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019085536 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016467+0000", 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9747000000000006e-05 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016752+0000", 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028574299999999998 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12451 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297901252999999, 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019832520999999999, 2024-09-21T22:16:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12451 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997292+0000", 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.13e-07 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997294+0000", 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2740000000000002e-06 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997307+0000", 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3281e-05 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997313+0000", 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9909999999999999e-06 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016783+0000", 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019469455 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016832+0000", 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9261999999999997e-05 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017124+0000", 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00029164499999999999 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12452 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297871480000001, 2024-09-21T22:16:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020179939000000001, 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12452 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.63e-07 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997324+0000", 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2819999999999999e-06 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997335+0000", 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1497e-05 2024-09-21T22:16:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997341+0000", 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5740000000000003e-06 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017162+0000", 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019821709 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017214+0000", 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1542000000000002e-05 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017501+0000", 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028687199999999997 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12453 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297843981, 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020570432, 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12453 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997349+0000", 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997351+0000", 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0650000000000001e-06 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997357+0000", 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3010000000000003e-06 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997366+0000", 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3979999999999999e-06 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017547+0000", 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020181706000000001 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017640+0000", 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2868000000000006e-05 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017919+0000", 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027868400000000002 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12461 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297816065999999, 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020883003000000001, 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12461 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997377+0000", 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9699999999999996e-07 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997379+0000", 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997386+0000", 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9190000000000002e-06 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997391+0000", 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7230000000000004e-06 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017963+0000", 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020572277 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018055+0000", 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1842000000000006e-05 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018259+0000", 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000204386 2024-09-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12462 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297794816, 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021171724999999999, 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12462 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8900000000000001e-07 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997399+0000", 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.432e-06 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997404+0000", 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8740000000000003e-06 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997407+0000", 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8040000000000002e-06 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018290+0000", 2024-09-21T22:16:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020882670999999998 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018347+0000", 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6972000000000003e-05 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018569+0000", 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000222683 2024-09-21T22:16:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12463 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297782125000001, 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02155197, 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12463 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997411+0000", 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997412+0000", 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.127e-06 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997415+0000", 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.174e-06 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997417+0000", 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018613+0000", 2024-09-21T22:16:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021195611999999999 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018698+0000", 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5158e-05 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018962+0000", 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000264071 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12473 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2654208~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.29731512, 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02139957, 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12473 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997878+0000", 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997882+0000", 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.048e-06 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997894+0000", 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1839e-05 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997905+0000", 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1015e-05 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018998+0000", 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02109248 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019046+0000", 2024-09-21T22:16:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8093000000000002e-05 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019277+0000", 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023115200000000001 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12474 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2736128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297268983999999, 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021670372, 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12474 2024-09-21T22:16:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997924+0000", 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6499999999999999e-07 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997927+0000", 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.644e-06 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997935+0000", 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.49e-06 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997940+0000", 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0860000000000001e-06 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019314+0000", 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021373601999999998 2024-09-21T22:16:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019360+0000", 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6260000000000001e-05 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019594+0000", 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000233725 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12475 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2818048~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.297243427000002, 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022017721000000001, 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12475 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997951+0000", 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997959+0000", 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2620000000000001e-06 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019633+0000", 2024-09-21T22:16:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021669000000000001 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019700+0000", 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7769999999999997e-05 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019967+0000", 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000266223 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12481 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.294012357, 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018906626999999999, 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12481 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001181+0000", 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1999999999999998e-07 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001185+0000", 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1570000000000002e-06 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001195+0000", 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0121e-05 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001202+0000", 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.041e-06 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019994+0000", 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018791233000000001 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020036+0000", 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2567000000000001e-05 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020087+0000", 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0587999999999997e-05 2024-09-21T22:16:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:31987 3.15 3:a8b34b27:::rbd_data.11858d872ed9.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:19.156035+0000", 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.1391574599999998, 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020325414999999999, 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 31987 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156035+0000", 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156035+0000", 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156037+0000", 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156048+0000", 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0796e-05 2024-09-21T22:16:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156075+0000", 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.741e-05 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156089+0000", 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3546e-05 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156167+0000", 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8399000000000006e-05 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156290+0000", 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000122581 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.160015+0000", 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037254469999999998 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176209+0000", 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016194292999999998 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176284+0000", 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4448000000000003e-05 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176322+0000", 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.854e-05 2024-09-21T22:16:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176360+0000", 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7994999999999998e-05 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:25.403 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:25.405 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:25.405 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:25.403+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:25.505 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:25.504+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:25.509 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:25.509 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:25.518 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:25.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:25.606 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:25.605+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:25.623 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:25.623 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:25.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:25.707 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:25.706+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:25.737 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:25.737 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 25.825193185, 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:25.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:25.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:25.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 25.822571111999999, 2024-09-21T22:16:25.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:25.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14147 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1867776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.537120050999999, 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015400951, 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14147 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198260+0000", 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.576e-06 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198266+0000", 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198270+0000", 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.42e-06 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213525+0000", 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015254304 2024-09-21T22:16:25.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213593+0000", 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8192e-05 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213658+0000", 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-05 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14148 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1949696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.537100436999999, 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015536743, 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14148 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198279+0000", 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198285+0000", 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198290+0000", 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5759999999999999e-06 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213689+0000", 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015398719999999999 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213735+0000", 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6873999999999999e-05 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213813+0000", 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8047999999999995e-05 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14149 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2031616~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.537082016999999, 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015749758999999999, 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14149 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198297+0000", 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198303+0000", 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198317+0000", 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-05 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213846+0000", 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015529685 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213929+0000", 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2341000000000003e-05 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214045+0000", 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116208 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.762 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.537053312000001, 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.537034418000001, 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:25.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.537011304, 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.536337116999999, 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14285 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3751936~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.515933643, 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015470901, 2024-09-21T22:16:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14285 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219444+0000", 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3099999999999999e-07 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219445+0000", 2024-09-21T22:16:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1349999999999999e-06 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219449+0000", 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9360000000000001e-06 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219453+0000", 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1629999999999998e-06 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234705+0000", 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015251740999999999 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234797+0000", 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2108000000000006e-05 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234914+0000", 2024-09-21T22:16:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117587 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14286 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3833856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.515918506999999, 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015717103999999999, 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14286 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219461+0000", 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219467+0000", 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219471+0000", 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2640000000000002e-06 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234983+0000", 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015511680999999999 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235069+0000", 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5778000000000004e-05 2024-09-21T22:16:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235176+0000", 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107092 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14287 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.515902122, 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015894090999999999, 2024-09-21T22:16:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14287 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6800000000000002e-07 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219477+0000", 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.362e-06 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219480+0000", 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1700000000000001e-06 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219482+0000", 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.475e-06 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235247+0000", 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015765000000000001 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235298+0000", 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0577e-05 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235369+0000", 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1239e-05 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.515891863, 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.515876754000001, 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.51585846, 2024-09-21T22:16:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.515201725000001, 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.534718428, 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.06725851, 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:16:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.367528478000001, 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:16:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.367481953, 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:16:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:25.834 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:25.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:25.836 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:25.834+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:25.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:16:25.861+0000 7f26d62fb640 0 --2- 172.21.15.134:0/1309815460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26bc003b40 0x7f26bc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-21T22:16:25.887 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:25.887 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:25.904 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:25.904 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 0.985831 (fc5f) 2024-09-21T22:16:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:16:25.927 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:25.935 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:25.933+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:25.946 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:25.947 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:25.958 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:25.958 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:25.964 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:25.965 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:25.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:25.982 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:25.998 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:26.016 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:26.016 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:26.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:26.068+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:26.086 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:26.086 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:26.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:26.137 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:26.136+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:26.238 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:26.238 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:26.238 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:26.237+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:26.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:26.339 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:26.337+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:26.349 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:26.349 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:26.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:26.440 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:26.439+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:26.459 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:26.460 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:26.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:26.541 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:26.540+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:26.570 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:26.570 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:26.579 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:26.642 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:26.641+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:26.682 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:26.682 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:26.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:26.775 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:26.774+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:26.834 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:26.834 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:26.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:26.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:26.883+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:26.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:26.943+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:27.025 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.025 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:27.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:27.074+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:27.138 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.138 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:27.145+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:27.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:27.247 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:27.245+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:27.251 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.251 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:27.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:27.347+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:27.403 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.403 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:27.456 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:27.454+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:27.515 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.515 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.524 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:27.565 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:27.563+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:27.652 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:27.651+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:27.668 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.668 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.677 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:27.753 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:27.751+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:27.781 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.781 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:27.874 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:27.872+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:27.938 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:27.938 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:27.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:16:27.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:27.989 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:27.987+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:27.990 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-21T22:16:28.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:28.055 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:28.054+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:28.070 INFO:teuthology.orchestra.run.smithi134.stdout:2763 writesame 0xc837f7d thru 0xc83c7a4 data_size 0x4(0x4828 bytes) 2024-09-21T22:16:28.081 INFO:teuthology.orchestra.run.smithi134.stdout:2764 trunc from 0xc83c7a5 to 0x49ba274 2024-09-21T22:16:28.092 INFO:teuthology.orchestra.run.smithi134.stdout:2765 trunc from 0x49ba274 to 0x16101c6 2024-09-21T22:16:28.099 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:28.099 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:28.102 INFO:teuthology.orchestra.run.smithi134.stdout:2766 write 0x729d8c thru 0x72b318 (0x158d bytes) 2024-09-21T22:16:28.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:28.113 INFO:teuthology.orchestra.run.smithi134.stdout:2767 writesame 0x334b5ae thru 0x33588ef data_size 0x7(0xd342 bytes) 2024-09-21T22:16:28.129 INFO:teuthology.orchestra.run.smithi134.stdout:2768 write 0xa78970a thru 0xa795840 (0xc137 bytes) 2024-09-21T22:16:28.134 INFO:teuthology.orchestra.run.smithi134.stdout:2769 write 0x4b1aef2 thru 0x4b22aff (0x7c0e bytes) 2024-09-21T22:16:28.150 INFO:teuthology.orchestra.run.smithi134.stdout:2770 trunc from 0xa795841 to 0x763d34 2024-09-21T22:16:28.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:28.156+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:28.178 INFO:teuthology.orchestra.run.smithi134.stdout:2772 write 0x1f5ac0f thru 0x1f65317 (0xa709 bytes) 2024-09-21T22:16:28.184 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:28.184 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.203 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:28.203 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:28.203 INFO:teuthology.orchestra.run.smithi134.stdout:2774 write 0xbc4b786 thru 0xbc52d23 (0x759e bytes) 2024-09-21T22:16:28.208 INFO:teuthology.orchestra.run.smithi134.stdout:2775 punch from 0x47020cd to 0x4704a5d, (0x2990 bytes) 2024-09-21T22:16:28.208 INFO:teuthology.orchestra.run.smithi134.stdout:2776 write 0x586917c thru 0x5878659 (0xf4de bytes) 2024-09-21T22:16:28.214 INFO:teuthology.orchestra.run.smithi134.stdout:2777 read 0x9c173cb thru 0x9c1efb6 (0x7bec bytes) 2024-09-21T22:16:28.214 INFO:teuthology.orchestra.run.smithi134.stdout:2778 punch from 0xb025a83 to 0xb02a161, (0x46de bytes) 2024-09-21T22:16:28.214 INFO:teuthology.orchestra.run.smithi134.stdout:2779 write 0x44b5e9d thru 0x44c1be6 (0xbd4a bytes) 2024-09-21T22:16:28.223 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:28.223 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:28.224 INFO:teuthology.orchestra.run.smithi134.stdout:2780 read 0x8169c83 thru 0x8173d34 (0xa0b2 bytes) 2024-09-21T22:16:28.224 INFO:teuthology.orchestra.run.smithi134.stdout:2781 punch from 0x86ca523 to 0x86d0fde, (0x6abb bytes) 2024-09-21T22:16:28.224 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.224 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.224 INFO:teuthology.orchestra.run.smithi134.stdout:2784 write 0x6b3056a thru 0x6b36bd7 (0x666e bytes) 2024-09-21T22:16:28.230 INFO:teuthology.orchestra.run.smithi134.stdout:2785 write 0xa0a3260 thru 0xa0ac847 (0x95e8 bytes) 2024-09-21T22:16:28.238 INFO:teuthology.orchestra.run.smithi134.stdout:2786 read 0x7f34c08 thru 0x7f3e9d7 (0x9dd0 bytes) 2024-09-21T22:16:28.243 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:28.243 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:28.245 INFO:teuthology.orchestra.run.smithi134.stdout:2787 write 0xc6c80c2 thru 0xc6cde2a (0x5d69 bytes) 2024-09-21T22:16:28.250 INFO:teuthology.orchestra.run.smithi134.stdout:2788 write 0x1678516 thru 0x167fda2 (0x788d bytes) 2024-09-21T22:16:28.256 INFO:teuthology.orchestra.run.smithi134.stdout:2789 punch from 0x9f5f655 to 0x9f62b37, (0x34e2 bytes) 2024-09-21T22:16:28.256 INFO:teuthology.orchestra.run.smithi134.stdout:2790 read 0x8ca2125 thru 0x8cafe1b (0xdcf7 bytes) 2024-09-21T22:16:28.256 INFO:teuthology.orchestra.run.smithi134.stdout:2792 write 0xa357dcc thru 0xa35d702 (0x5937 bytes) 2024-09-21T22:16:28.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:28.256+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:28.261 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:28.262 INFO:teuthology.orchestra.run.smithi134.stdout:2793 punch from 0x5c10c95 to 0x5c168b8, (0x5c23 bytes) 2024-09-21T22:16:28.263 INFO:teuthology.orchestra.run.smithi134.stdout:2794 write 0xbf05dc3 thru 0xbf0ae70 (0x50ae bytes) 2024-09-21T22:16:28.266 INFO:teuthology.orchestra.run.smithi134.stdout:2795 write 0x2274dd4 thru 0x22758c4 (0xaf1 bytes) 2024-09-21T22:16:28.270 INFO:teuthology.orchestra.run.smithi134.stdout:2796 write 0x65eb767 thru 0x65f5625 (0x9ebf bytes) 2024-09-21T22:16:28.272 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:28.272 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:28.276 INFO:teuthology.orchestra.run.smithi134.stdout:2798 trunc from 0xc6cde2b to 0xd6ba4c1 2024-09-21T22:16:28.280 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:28.280 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:28.283 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:28.296 INFO:teuthology.orchestra.run.smithi134.stdout:2799 trunc from 0xd6ba4c1 to 0x234a478 2024-09-21T22:16:28.298 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:2800 read 0x1be04a7 thru 0x1be91d2 (0x8d2c bytes) 2024-09-21T22:16:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:2801 punch from 0x1eddb16 to 0x1eecd23, (0xf20d bytes) 2024-09-21T22:16:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:2803 punch from 0x1c421e5 to 0x1c4cca7, (0xaac2 bytes) 2024-09-21T22:16:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:2806 read 0x107bf3d thru 0x10876db (0xb79f bytes) 2024-09-21T22:16:28.315 INFO:teuthology.orchestra.run.smithi134.stdout:2807 trunc from 0x234a478 to 0x99f91 2024-09-21T22:16:28.319 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:28.319 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:28.350 INFO:teuthology.orchestra.run.smithi134.stdout:2808 write 0x652590a thru 0x652e9a0 (0x9097 bytes) 2024-09-21T22:16:28.356 INFO:teuthology.orchestra.run.smithi134.stdout:2809 trunc from 0x652e9a1 to 0x57e45e4 2024-09-21T22:16:28.358 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:28.357+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:28.371 INFO:teuthology.orchestra.run.smithi134.stdout:2810 trunc from 0x57e45e4 to 0x185ff08 2024-09-21T22:16:28.376 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.376 INFO:teuthology.orchestra.run.smithi134.stdout:2813 read 0x175bc63 thru 0x176b24c (0xf5ea bytes) 2024-09-21T22:16:28.376 INFO:teuthology.orchestra.run.smithi134.stdout:2815 read 0xabaeb4 thru 0xac7f56 (0xd0a3 bytes) 2024-09-21T22:16:28.383 INFO:teuthology.orchestra.run.smithi134.stdout:2816 trunc from 0x185ff08 to 0x74a527c 2024-09-21T22:16:28.389 INFO:teuthology.orchestra.run.smithi134.stdout:2817 read 0x18ed476 thru 0x18fd06a (0xfbf5 bytes) 2024-09-21T22:16:28.392 INFO:teuthology.orchestra.run.smithi134.stdout:2818 trunc from 0x74a527c to 0x93f5518 2024-09-21T22:16:28.398 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.398 INFO:teuthology.orchestra.run.smithi134.stdout:2820 read 0x8812af9 thru 0x88164a6 (0x39ae bytes) 2024-09-21T22:16:28.398 INFO:teuthology.orchestra.run.smithi134.stdout:2821 punch from 0x48c7cb5 to 0x48ce5bc, (0x6907 bytes) 2024-09-21T22:16:28.398 INFO:teuthology.orchestra.run.smithi134.stdout:2825 write 0x863ca20 thru 0x8642da7 (0x6388 bytes) 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40437 3.15 3:ad5a3175:::rbd_data.118542b14bcd.0000000000000216:head [set-alloc-hint object_size 262144 write_size 262144,write 182816~13792 in=13792b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.399557+0000", 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.001136637, 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0011545920000000001, 2024-09-21T22:16:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "waiting for sub ops", 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40437 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399557+0000", 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399557+0000", 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399557+0000", 2024-09-21T22:16:28.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2200000000000004e-07 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399571+0000", 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3358e-05 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399579+0000", 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4100000000000008e-06 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399584+0000", 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7400000000000004e-06 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399638+0000", 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399782+0000", 2024-09-21T22:16:28.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014388399999999999 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.399942+0000", 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015994699999999999 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.400626+0000", 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00068468100000000003 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.406 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40436 3.15 3:aee7b1d0:::rbd_object_map.118542b14bcd:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.397900+0000", 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0027938329999999999, 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0028611489999999999, 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "waiting for sub ops", 2024-09-21T22:16:28.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40436 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.397900+0000", 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.397900+0000", 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.397900+0000", 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.397903+0000", 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9960000000000002e-06 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.397909+0000", 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3899999999999998e-06 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.397913+0000", 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.715e-06 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.398577+0000", 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00066360099999999999 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.398665+0000", 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8040000000000004e-05 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.398966+0000", 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00030132299999999999 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.400499+0000", 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001533005 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: ], 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 2 2024-09-21T22:16:28.412 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:28.413 INFO:teuthology.orchestra.run.smithi134.stdout:2826 writesame 0x548be6d thru 0x5499551 data_size 0x1d(0xd6e5 bytes) 2024-09-21T22:16:28.413 INFO:teuthology.orchestra.run.smithi134.stdout:2827 writesame 0x2744ab9 thru 0x2746df9 data_size 0x19(0x2341 bytes) 2024-09-21T22:16:28.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:28.416 INFO:teuthology.orchestra.run.smithi134.stdout:2828 trunc from 0x93f5518 to 0x6f018ae 2024-09-21T22:16:28.426 INFO:teuthology.orchestra.run.smithi134.stdout:2829 write 0x28b4518 thru 0x28c2796 (0xe27f bytes) 2024-09-21T22:16:28.432 INFO:teuthology.orchestra.run.smithi134.stdout:2830 writesame 0x4a15bd1 thru 0x4a16567 data_size 0x1(0x997 bytes) 2024-09-21T22:16:28.435 INFO:teuthology.orchestra.run.smithi134.stdout:2831 writesame 0x2b2eb9d thru 0x2b37352 data_size 0x1d(0x87b6 bytes) 2024-09-21T22:16:28.454 INFO:teuthology.orchestra.run.smithi134.stdout:2832 write 0xbd42781 thru 0xbd47dfb (0x567b bytes) 2024-09-21T22:16:28.459 INFO:teuthology.orchestra.run.smithi134.stdout:2833 read 0xab1a75f thru 0xab254cf (0xad71 bytes) 2024-09-21T22:16:28.459 INFO:teuthology.orchestra.run.smithi134.stdout:2835 read 0xaee559a thru 0xaeeb85f (0x62c6 bytes) 2024-09-21T22:16:28.459 INFO:teuthology.orchestra.run.smithi134.stdout:2837 writesame 0x4c66cc4 thru 0x4c68a3e data_size 0x1(0x1d7b bytes) 2024-09-21T22:16:28.459 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:28.457+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:28.464 INFO:teuthology.orchestra.run.smithi134.stdout:2840 punch from 0x22e9152 to 0x22f8158, (0xf006 bytes) 2024-09-21T22:16:28.465 INFO:teuthology.orchestra.run.smithi134.stdout:2841 punch from 0xb53dacf to 0xb5459bd, (0x7eee bytes) 2024-09-21T22:16:28.465 INFO:teuthology.orchestra.run.smithi134.stdout:2842 writesame 0xa4aacb5 thru 0xa4b671d data_size 0x1(0xba69 bytes) 2024-09-21T22:16:28.486 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.491 INFO:teuthology.orchestra.run.smithi134.stdout:2844 trunc from 0xbd47dfc to 0x755c3c5 2024-09-21T22:16:28.511 INFO:teuthology.orchestra.run.smithi134.stdout:2846 write 0x860b96b thru 0x860d010 (0x16a6 bytes) 2024-09-21T22:16:28.515 INFO:teuthology.orchestra.run.smithi134.stdout:2847 punch from 0x711b7c0 to 0x7125c43, (0xa483 bytes) 2024-09-21T22:16:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:2849 write 0xbaa65ea thru 0xbab2830 (0xc247 bytes) 2024-09-21T22:16:28.531 INFO:teuthology.orchestra.run.smithi134.stdout:2851 punch from 0x1b64668 to 0x1b72a97, (0xe42f bytes) 2024-09-21T22:16:28.531 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.531 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.531 INFO:teuthology.orchestra.run.smithi134.stdout:2854 read 0xb488d58 thru 0xb48f8a7 (0x6b50 bytes) 2024-09-21T22:16:28.531 INFO:teuthology.orchestra.run.smithi134.stdout:2855 writesame 0xa1f26cb thru 0xa20126a data_size 0xa0(0xeba0 bytes) 2024-09-21T22:16:28.533 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:28.534 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:28.534 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:28.534 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:28.534 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:2857 writesame 0x736ae1b thru 0x736ffba data_size 0x10(0x51a0 bytes) 2024-09-21T22:16:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:2858 read 0x1908d97 thru 0x19107c3 (0x7a2d bytes) 2024-09-21T22:16:28.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:28.546 INFO:teuthology.orchestra.run.smithi134.stdout:2859 trunc from 0xbab2831 to 0x93e8a6d 2024-09-21T22:16:28.560 INFO:teuthology.orchestra.run.smithi134.stdout:2860 writesame 0x14363e1 thru 0x1440b6d data_size 0x1(0xa78d bytes) 2024-09-21T22:16:28.576 INFO:teuthology.orchestra.run.smithi134.stdout:2861 write 0x1fa1c0e thru 0x1fa951d (0x7910 bytes) 2024-09-21T22:16:28.582 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.582 INFO:teuthology.orchestra.run.smithi134.stdout:2865 read 0x4dd4a63 thru 0x4dd7cd7 (0x3275 bytes) 2024-09-21T22:16:28.582 INFO:teuthology.orchestra.run.smithi134.stdout:2866 read 0x81261b0 thru 0x81294ac (0x32fd bytes) 2024-09-21T22:16:28.583 INFO:teuthology.orchestra.run.smithi134.stdout:2867 writesame 0x4177d6b thru 0x41831f4 data_size 0x1(0xb48a bytes) 2024-09-21T22:16:28.587 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:28.585+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:2869 writesame 0x241fbc8 thru 0x2423a21 data_size 0x2e(0x3e5a bytes) 2024-09-21T22:16:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:2870 write 0xcfa81ba thru 0xcfaec90 (0x6ad7 bytes) 2024-09-21T22:16:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:2873 writesame 0xad10ede thru 0xad13578 data_size 0x1(0x269b bytes) 2024-09-21T22:16:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:2876 read 0x78b8fd3 thru 0x78c09a1 (0x79cf bytes) 2024-09-21T22:16:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:2877 read 0x4bc4209 thru 0x4bcf696 (0xb48e bytes) 2024-09-21T22:16:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:2878 clone 13 order 24 su 1048576 sc 3 2024-09-21T22:16:28.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:28.659+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:28.694 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:28.694 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:28.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1018 3.15 3:ae013215:::rbd_data.1185ff358907.0000000000000002:head [write 0~1016375 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 45.184567573000002, 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019909570000000001, 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.695 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.696 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1018 2024-09-21T22:16:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:28.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.508047+0000", 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0399999999999996e-07 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509915+0000", 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0018678049999999999 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509926+0000", 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0729e-05 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.509937+0000", 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1447999999999999e-05 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522027+0000", 2024-09-21T22:16:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012089379000000001 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.522161+0000", 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134525 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527828+0000", 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0056671430000000004 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:28.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527880+0000", 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1329000000000003e-05 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.527956+0000", 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6607999999999996e-05 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1139 3.15 3:a9b19bfb:::rbd_data.11856a5cf33b.000000000000000a:3 [read 1605632~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:28.702 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 45.166705862000001, 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017975142999999999, 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1139 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:28.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525909+0000", 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525911+0000", 2024-09-21T22:16:28.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525917+0000", 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8599999999999998e-06 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.525921+0000", 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540743+0000", 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014821166 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.540833+0000", 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0853000000000006e-05 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.543884+0000", 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030503219999999998 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.706 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12419 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2375680~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695515602, 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017663772000000001, 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12419 2024-09-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997099+0000", 2024-09-21T22:16:28.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997100+0000", 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.238e-06 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997103+0000", 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0089999999999999e-06 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997106+0000", 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4789999999999999e-06 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014499+0000", 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017392764000000002 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014543+0000", 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4947000000000002e-05 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014763+0000", 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000219127 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12420 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2457600~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695505595, 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017934450000000001, 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.711 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12420 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997109+0000", 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997110+0000", 2024-09-21T22:16:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0389999999999999e-06 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997113+0000", 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1250000000000001e-06 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997116+0000", 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.481e-06 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014801+0000", 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017685482999999998 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.014850+0000", 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9107999999999998e-05 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015043+0000", 2024-09-21T22:16:28.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000192991 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12421 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2539520~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695495857000001, 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018190212000000001, 2024-09-21T22:16:28.716 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12421 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997119+0000", 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.04e-07 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997120+0000", 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0160000000000001e-06 2024-09-21T22:16:28.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997124+0000", 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0300000000000004e-06 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997128+0000", 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8689999999999997e-06 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015060+0000", 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017932303 2024-09-21T22:16:28.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015104+0000", 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3766000000000001e-05 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015309+0000", 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00020502399999999999 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.720 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12440 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2686976~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695459828000001, 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562981999999999, 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12440 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997155+0000", 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:28.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997157+0000", 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7600000000000001e-06 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997161+0000", 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6630000000000001e-06 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997165+0000", 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3270000000000001e-06 2024-09-21T22:16:28.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015348+0000", 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018183263000000002 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015444+0000", 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5798999999999995e-05 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015718+0000", 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027377 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12441 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2768896~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695444641999998, 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018855137000000001, 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.725 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12441 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997170+0000", 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0600000000000001e-07 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997172+0000", 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.708e-06 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997177+0000", 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4729999999999999e-06 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997180+0000", 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015743+0000", 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018562498 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.015791+0000", 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8294000000000002e-05 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016025+0000", 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000234109 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12442 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2850816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695430850000001, 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019142308, 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12442 2024-09-21T22:16:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997184+0000", 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997185+0000", 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.195e-06 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997188+0000", 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2600000000000001e-06 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997192+0000", 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.968e-06 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016060+0000", 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018867816999999999 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016112+0000", 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1518999999999999e-05 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016326+0000", 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00021432800000000001 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12450 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2621440~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695352845999999, 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019490774999999998, 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12450 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997262+0000", 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2799999999999995e-07 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997266+0000", 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4429999999999999e-06 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997275+0000", 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.5750000000000007e-06 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997281+0000", 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.003e-06 2024-09-21T22:16:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016367+0000", 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019085536 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016467+0000", 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9747000000000006e-05 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016752+0000", 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028574299999999998 2024-09-21T22:16:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12451 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695323245000001, 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019832520999999999, 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12451 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997291+0000", 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997292+0000", 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.13e-07 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997294+0000", 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2740000000000002e-06 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997307+0000", 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3281e-05 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997313+0000", 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9909999999999999e-06 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016783+0000", 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019469455 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.016832+0000", 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9261999999999997e-05 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017124+0000", 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00029164499999999999 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12452 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695293471999999, 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020179939000000001, 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12452 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997321+0000", 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.63e-07 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997324+0000", 2024-09-21T22:16:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2819999999999999e-06 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997335+0000", 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1497e-05 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997341+0000", 2024-09-21T22:16:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5740000000000003e-06 2024-09-21T22:16:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017162+0000", 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019821709 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017214+0000", 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1542000000000002e-05 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017501+0000", 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028687199999999997 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12453 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695265973000001, 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020570432, 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12453 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997348+0000", 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997349+0000", 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997351+0000", 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0650000000000001e-06 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997357+0000", 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3010000000000003e-06 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997366+0000", 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3979999999999999e-06 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017547+0000", 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020181706000000001 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017640+0000", 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2868000000000006e-05 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017919+0000", 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027868400000000002 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12461 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695238058000001, 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020883003000000001, 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12461 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997376+0000", 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997377+0000", 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9699999999999996e-07 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997379+0000", 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997386+0000", 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9190000000000002e-06 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997391+0000", 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7230000000000004e-06 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.017963+0000", 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020572277 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018055+0000", 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1842000000000006e-05 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018259+0000", 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000204386 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12462 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695216808000001, 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021171724999999999, 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12462 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997398+0000", 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8900000000000001e-07 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997399+0000", 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.432e-06 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997404+0000", 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8740000000000003e-06 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997407+0000", 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8040000000000002e-06 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018290+0000", 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020882670999999998 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018347+0000", 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6972000000000003e-05 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018569+0000", 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000222683 2024-09-21T22:16:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12463 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.695204116999999, 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02155197, 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12463 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997410+0000", 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997411+0000", 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997412+0000", 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.127e-06 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997415+0000", 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.174e-06 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997417+0000", 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018613+0000", 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021195611999999999 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018698+0000", 2024-09-21T22:16:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5158e-05 2024-09-21T22:16:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018962+0000", 2024-09-21T22:16:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000264071 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12473 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2654208~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.694737111999999, 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02139957, 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12473 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997877+0000", 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997878+0000", 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997882+0000", 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.048e-06 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997894+0000", 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1839e-05 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997905+0000", 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1015e-05 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.018998+0000", 2024-09-21T22:16:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02109248 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019046+0000", 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8093000000000002e-05 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019277+0000", 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023115200000000001 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12474 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2736128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.694690976, 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021670372, 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12474 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997923+0000", 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997924+0000", 2024-09-21T22:16:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6499999999999999e-07 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997927+0000", 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.644e-06 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997935+0000", 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.49e-06 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997940+0000", 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0860000000000001e-06 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019314+0000", 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021373601999999998 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019360+0000", 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6260000000000001e-05 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019594+0000", 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000233725 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12475 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:d [read 2818048~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.694665419, 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022017721000000001, 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12475 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997949+0000", 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997951+0000", 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997959+0000", 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2620000000000001e-06 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0189999999999997e-06 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019633+0000", 2024-09-21T22:16:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021669000000000001 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019700+0000", 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7769999999999997e-05 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019967+0000", 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000266223 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12481 3.11 3:8df0eacb:::rbd_data.11854f79dd7.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.691434349000001, 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018906626999999999, 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12481 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001180+0000", 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001181+0000", 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1999999999999998e-07 2024-09-21T22:16:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001185+0000", 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1570000000000002e-06 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001195+0000", 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0121e-05 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.001202+0000", 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.041e-06 2024-09-21T22:16:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.019994+0000", 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018791233000000001 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020036+0000", 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2567000000000001e-05 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.020087+0000", 2024-09-21T22:16:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0587999999999997e-05 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:31987 3.15 3:a8b34b27:::rbd_data.11858d872ed9.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:19.156035+0000", 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.5365794519999998, 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020325414999999999, 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 31987 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156035+0000", 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156035+0000", 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156037+0000", 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156048+0000", 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0796e-05 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156075+0000", 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.741e-05 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156089+0000", 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3546e-05 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156167+0000", 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8399000000000006e-05 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.156290+0000", 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000122581 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.160015+0000", 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037254469999999998 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176209+0000", 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016194292999999998 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176284+0000", 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4448000000000003e-05 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176322+0000", 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.854e-05 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:19.176360+0000", 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7994999999999998e-05 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:28.792 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:28.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:28.794 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:28.792+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:28.895 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:28.893+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:28.897 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:28.897 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:28.897 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:28.897 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:28.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:16:28.995 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:28.993+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:29.090 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:29.090 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:29.096 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:29.094+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:29.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:29.197 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:29.196+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:29.205 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:29.205 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:29.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:29.205 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:29.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.205 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.293057069, 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:29.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:29.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:29.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:29.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:29.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:29.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:29.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:29.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:29.214 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.290434995999998, 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:29.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.219 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14147 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1867776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.220 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:29.220 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.004983934999998, 2024-09-21T22:16:29.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015400951, 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14147 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198260+0000", 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.576e-06 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198266+0000", 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198270+0000", 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.42e-06 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213525+0000", 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015254304 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213593+0000", 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8192e-05 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213658+0000", 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-05 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14148 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1949696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.004964320999999, 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015536743, 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.225 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14148 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198279+0000", 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198285+0000", 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198290+0000", 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5759999999999999e-06 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213689+0000", 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015398719999999999 2024-09-21T22:16:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213735+0000", 2024-09-21T22:16:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6873999999999999e-05 2024-09-21T22:16:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213813+0000", 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8047999999999995e-05 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.230 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14149 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2031616~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.004945900999999, 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015749758999999999, 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14149 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.231 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198297+0000", 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198303+0000", 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198317+0000", 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-05 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213846+0000", 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015529685 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213929+0000", 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2341000000000003e-05 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214045+0000", 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116208 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.004917196000001, 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:29.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.004898302000001, 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.004875188, 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.004201000999998, 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14285 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3751936~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.983797527, 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015470901, 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14285 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219444+0000", 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3099999999999999e-07 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219445+0000", 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1349999999999999e-06 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219449+0000", 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9360000000000001e-06 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219453+0000", 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1629999999999998e-06 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234705+0000", 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015251740999999999 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234797+0000", 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2108000000000006e-05 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234914+0000", 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117587 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14286 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3833856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.983782390999998, 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015717103999999999, 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14286 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219461+0000", 2024-09-21T22:16:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219467+0000", 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219471+0000", 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2640000000000002e-06 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234983+0000", 2024-09-21T22:16:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015511680999999999 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235069+0000", 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5778000000000004e-05 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235176+0000", 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107092 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14287 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.983766006, 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015894090999999999, 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14287 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6800000000000002e-07 2024-09-21T22:16:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219477+0000", 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.362e-06 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219480+0000", 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1700000000000001e-06 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219482+0000", 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.475e-06 2024-09-21T22:16:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235247+0000", 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015765000000000001 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235298+0000", 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0577e-05 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235369+0000", 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1239e-05 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.983755747, 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.983740638, 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.983722344, 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.983065609000001, 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.002582311999999, 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.535122394, 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:16:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:16:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:16:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.835392362, 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:16:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:16:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.835345837, 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:16:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:16:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.304 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:29.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:29.307 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:29.304+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:29.406 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:29.405+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:29.409 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:29.410 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:29.410 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:29.410 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:29.418 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:29.507 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:29.506+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:29.561 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:29.562 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:29.562 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:29.562 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:29.562 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:29.570 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:29.614 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:29.613+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12194 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1327104~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725239259999999, 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024432683, 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12194 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947443+0000", 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.102e-06 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947446+0000", 2024-09-21T22:16:29.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0359999999999998e-06 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947449+0000", 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.357e-06 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971629+0000", 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024180103000000001 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971669+0000", 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0457999999999998e-05 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971875+0000", 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020541299999999999 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12195 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1409024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.679 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725226777, 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024694972999999999, 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12195 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947455+0000", 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.16e-07 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947456+0000", 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1650000000000001e-06 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947460+0000", 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1250000000000003e-06 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947464+0000", 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971900+0000", 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024436198999999999 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971941+0000", 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0914999999999997e-05 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972149+0000", 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000208581 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12196 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1490944~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725211864999999, 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024916424999999999, 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12196 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947470+0000", 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947472+0000", 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.894e-06 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947479+0000", 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.182e-06 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4669999999999998e-06 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972175+0000", 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024691870000000001 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972216+0000", 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0747000000000001e-05 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972386+0000", 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169875 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12219 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 835584~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725164611, 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025132278000000001, 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12219 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947525+0000", 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2549999999999997e-06 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947535+0000", 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5400000000000001e-06 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947547+0000", 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1721e-05 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972410+0000", 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024863703000000001 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972450+0000", 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9440999999999997e-05 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972649+0000", 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000199044 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12220 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 917504~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:29.692 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725101350999999, 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025318852999999999, 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12220 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0447e-05 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947600+0000", 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3649999999999993e-06 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8660000000000002e-06 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972675+0000", 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025069168999999999 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972719+0000", 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3757999999999997e-05 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972899+0000", 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017969899999999999 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12221 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 999424~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725065278999999, 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025531113000000001, 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12221 2024-09-21T22:16:29.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:29.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947619+0000", 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947629+0000", 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0325e-05 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947634+0000", 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1760000000000001e-06 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972923+0000", 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025289282999999999 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972964+0000", 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0225000000000002e-05 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973147+0000", 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183365 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12222 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1048576~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725040012000001, 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02581663, 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12222 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947642+0000", 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947649+0000", 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999999e-06 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947659+0000", 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0023e-05 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947664+0000", 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2399999999999998e-06 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973181+0000", 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025516975000000001 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973232+0000", 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1538e-05 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973458+0000", 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225405 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12223 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1130496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.725010035, 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026051338, 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12223 2024-09-21T22:16:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947672+0000", 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947674+0000", 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1880000000000001e-06 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947680+0000", 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2149999999999998e-06 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947689+0000", 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6889999999999993e-06 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973492+0000", 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025803362 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973543+0000", 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378000000000002e-05 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973723+0000", 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017904499999999999 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12224 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1212416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.724984615, 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026304080000000001, 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12224 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6899999999999998e-07 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947699+0000", 2024-09-21T22:16:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947710+0000", 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5210000000000004e-06 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973748+0000", 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026037801999999999 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973795+0000", 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6866999999999997e-05 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974001+0000", 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020599600000000001 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12225 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1294336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.724964873000001, 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026580894000000001, 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12225 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947717+0000", 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947719+0000", 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.885e-06 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947724+0000", 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7180000000000001e-06 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947729+0000", 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974025+0000", 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026295888999999999 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974066+0000", 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1458999999999997e-05 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974297+0000", 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023100900000000001 2024-09-21T22:16:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12226 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1343488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.724946760999998, 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026843615000000001, 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12226 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947735+0000", 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947737+0000", 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.812e-06 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947744+0000", 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9500000000000004e-06 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947748+0000", 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974323+0000", 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026574644000000001 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974385+0000", 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2318999999999997e-05 2024-09-21T22:16:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974578+0000", 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192864 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12227 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1425408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.724926916000001, 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027110875999999999, 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12227 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947755+0000", 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947757+0000", 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0099999999999998e-06 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947766+0000", 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4089999999999992e-06 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947792+0000", 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6367999999999999e-05 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974604+0000", 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026811181 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974646+0000", 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2694000000000002e-05 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974865+0000", 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021881900000000001 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12228 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1507328~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.724882632, 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027303377, 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12228 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7700000000000001e-07 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947800+0000", 2024-09-21T22:16:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6220000000000001e-06 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947813+0000", 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2833999999999999e-05 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947816+0000", 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1030000000000002e-06 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974890+0000", 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027073904999999999 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974931+0000", 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0194000000000002e-05 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975102+0000", 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171442 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12229 3.1f 3:f99fee0f:::rbd_object_map.1185fc79843.000000000000000e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.721567597, 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026242102, 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12229 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951121+0000", 2024-09-21T22:16:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0559999999999999e-06 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951129+0000", 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951137+0000", 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4600000000000003e-06 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951143+0000", 2024-09-21T22:16:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9989999999999997e-06 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975127+0000", 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023983563999999999 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975176+0000", 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9753000000000003e-05 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975510+0000", 2024-09-21T22:16:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033344700000000001 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977251+0000", 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017413859999999999 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977283+0000", 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2261000000000002e-05 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977317+0000", 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3463999999999997e-05 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977356+0000", 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8859000000000002e-05 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12465 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.675059888, 2024-09-21T22:16:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024627518000000001, 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12465 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997622+0000", 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5600000000000002e-07 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997624+0000", 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997630+0000", 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.392e-06 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997634+0000", 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3810000000000001e-06 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021905+0000", 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024270242000000001 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021988+0000", 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3836000000000002e-05 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022249+0000", 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026042300000000002 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12466 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.675042067, 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025061416, 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12466 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.53e-07 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997641+0000", 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6700000000000001e-06 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997647+0000", 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.942e-06 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997652+0000", 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7639999999999996e-06 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022294+0000", 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024641880000000001 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022385+0000", 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1324999999999997e-05 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022701+0000", 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031558200000000002 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12467 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.675021433000001, 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02537503, 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12467 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-07 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997662+0000", 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9039999999999999e-06 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997668+0000", 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997673+0000", 2024-09-21T22:16:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022728+0000", 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025054937999999999 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022814+0000", 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6520000000000005e-05 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023035+0000", 2024-09-21T22:16:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022056699999999999 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12476 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.674764753000002, 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025528713000000001, 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12476 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997917+0000", 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9199999999999999e-07 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997922+0000", 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6589999999999998e-06 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997934+0000", 2024-09-21T22:16:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.224e-05 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997941+0000", 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8669999999999996e-06 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023079+0000", 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025137836 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023169+0000", 2024-09-21T22:16:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0457999999999993e-05 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023445+0000", 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027576100000000002 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12477 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.674717764, 2024-09-21T22:16:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025850773000000001, 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12477 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2099999999999996e-07 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997967+0000", 2024-09-21T22:16:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1089999999999998e-06 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997976+0000", 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.524e-06 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997979+0000", 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7589999999999999e-06 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023470+0000", 2024-09-21T22:16:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025490777999999999 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023552+0000", 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1893999999999999e-05 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023814+0000", 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262088 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12478 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.674694463000002, 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026321787999999999, 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12478 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8799999999999998e-07 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997992+0000", 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.045e-06 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997996+0000", 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3939999999999998e-06 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997999+0000", 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.937e-06 2024-09-21T22:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023857+0000", 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025858069000000001 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023951+0000", 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3226999999999994e-05 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.024309+0000", 2024-09-21T22:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035782799999999998 2024-09-21T22:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:29.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:29.765 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:29.762+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:29.865 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:29.864+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:29.909 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:29.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:29.909 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:29.909 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:29.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:29.966 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:29.964+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:30.054 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:30.054 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:30.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:30.067 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:30.066+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:30.169 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:30.169 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:30.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:30.169 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:30.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.169 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:956 3.6 e30/23 3:61b78b45:::rbd_data.1185ff358907.0000000000000000:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:30.169 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.670648204000003, 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091893070000000007, 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:30.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:30.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.496032+0000", 2024-09-21T22:16:30.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:16:30.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497369+0000", 2024-09-21T22:16:30.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001336804 2024-09-21T22:16:30.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497387+0000", 2024-09-21T22:16:30.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8014999999999999e-05 2024-09-21T22:16:30.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497398+0000", 2024-09-21T22:16:30.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1581e-05 2024-09-21T22:16:30.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497480+0000", 2024-09-21T22:16:30.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1874999999999998e-05 2024-09-21T22:16:30.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497511+0000", 2024-09-21T22:16:30.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1103999999999999e-05 2024-09-21T22:16:30.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505165+0000", 2024-09-21T22:16:30.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076536219999999997 2024-09-21T22:16:30.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505221+0000", 2024-09-21T22:16:30.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6026000000000002e-05 2024-09-21T22:16:30.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.178 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.178 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:960 3.4 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head [write 0~1048576 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:30.178 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:30.179 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.668714653000002, 2024-09-21T22:16:30.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084308620000000008, 2024-09-21T22:16:30.179 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.179 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.179 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 960 2024-09-21T22:16:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497965+0000", 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.497968+0000", 2024-09-21T22:16:30.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.429e-06 2024-09-21T22:16:30.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498743+0000", 2024-09-21T22:16:30.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077512399999999997 2024-09-21T22:16:30.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498766+0000", 2024-09-21T22:16:30.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2983999999999999e-05 2024-09-21T22:16:30.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498790+0000", 2024-09-21T22:16:30.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389e-05 2024-09-21T22:16:30.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498881+0000", 2024-09-21T22:16:30.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0780999999999997e-05 2024-09-21T22:16:30.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:30.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.498890+0000", 2024-09-21T22:16:30.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7579999999999998e-06 2024-09-21T22:16:30.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500819+0000", 2024-09-21T22:16:30.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929491 2024-09-21T22:16:30.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.500968+0000", 2024-09-21T22:16:30.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014854199999999999 2024-09-21T22:16:30.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501114+0000", 2024-09-21T22:16:30.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146298 2024-09-21T22:16:30.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505622+0000", 2024-09-21T22:16:30.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045081649999999997 2024-09-21T22:16:30.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506247+0000", 2024-09-21T22:16:30.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062455099999999999 2024-09-21T22:16:30.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506353+0000", 2024-09-21T22:16:30.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010586699999999999 2024-09-21T22:16:30.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.506396+0000", 2024-09-21T22:16:30.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3482999999999997e-05 2024-09-21T22:16:30.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.194 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2346 3.0 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:30.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:30.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.651677859000003, 2024-09-21T22:16:30.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083135759999999996, 2024-09-21T22:16:30.195 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.195 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2346 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515002+0000", 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515003+0000", 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-06 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515950+0000", 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094629499999999999 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515967+0000", 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7554000000000002e-05 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.515974+0000", 2024-09-21T22:16:30.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516038+0000", 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3176999999999995e-05 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516167+0000", 2024-09-21T22:16:30.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012979800000000001 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516306+0000", 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138887 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522280+0000", 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059732750000000001 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523229+0000", 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00094895000000000005 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523280+0000", 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1554999999999997e-05 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523316+0000", 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5602999999999998e-05 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2364 3.0 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head [write 0~983607 [fadvise_sequential+fadvise_nocache],write 1048576~786432 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.639552305999999, 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077052980000000002, 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2364 2024-09-21T22:16:30.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527128+0000", 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527129+0000", 2024-09-21T22:16:30.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527492+0000", 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036298100000000001 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527504+0000", 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1814000000000001e-05 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527510+0000", 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4649999999999999e-06 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527564+0000", 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3893000000000001e-05 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527665+0000", 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101468 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527817+0000", 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015177100000000001 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534445+0000", 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066276169999999997 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534752+0000", 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030757499999999998 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534799+0000", 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6310000000000002e-05 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534833+0000", 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341999999999997e-05 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.208 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7887 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.762771133999998, 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019112581, 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7887 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403909+0000", 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403910+0000", 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3300000000000001e-07 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403914+0000", 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1370000000000004e-06 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403924+0000", 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0365e-05 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403929+0000", 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.403979+0000", 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0420000000000002e-05 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.404033+0000", 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3489999999999998e-05 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.407250+0000", 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003216975 2024-09-21T22:16:30.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422946+0000", 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015696266 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422957+0000", 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0608000000000001e-05 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422987+0000", 2024-09-21T22:16:30.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0552999999999997e-05 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.423021+0000", 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4056000000000001e-05 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4485.0:7887 3.4 e41/23 ondisk, result = 0)", 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.750467563000001, 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067395329999999998, 2024-09-21T22:16:30.214 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416212+0000", 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416213+0000", 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416216+0000", 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0989999999999999e-06 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416227+0000", 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0604e-05 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.416232+0000", 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.938e-06 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422936+0000", 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067038089999999998 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422942+0000", 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5939999999999999e-06 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.422952+0000", 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8090000000000004e-06 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.218 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7981 3.0 3:03cb8c30:::rbd_data.1185acca6c1f.000000000000001b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.653337866999998, 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015150808999999999, 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7981 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513342+0000", 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513343+0000", 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6000000000000003e-07 2024-09-21T22:16:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513347+0000", 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9910000000000004e-06 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513358+0000", 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0772e-05 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513363+0000", 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1490000000000002e-06 2024-09-21T22:16:30.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513403+0000", 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0290000000000002e-05 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.513450+0000", 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7349999999999999e-05 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.515475+0000", 2024-09-21T22:16:30.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020249640000000002 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528357+0000", 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012881782 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528396+0000", 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8674000000000003e-05 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528438+0000", 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2006999999999999e-05 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:55.528493+0000", 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.507e-05 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:8534 3.4 3:21b19723:::rbd_data.1185acca6c1f.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.004434893000003, 2024-09-21T22:16:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013031713, 2024-09-21T22:16:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.226 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 8534 2024-09-21T22:16:30.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:30.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162245+0000", 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162246+0000", 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:30.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162250+0000", 2024-09-21T22:16:30.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9550000000000002e-06 2024-09-21T22:16:30.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162259+0000", 2024-09-21T22:16:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5780000000000005e-06 2024-09-21T22:16:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162264+0000", 2024-09-21T22:16:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1580000000000004e-06 2024-09-21T22:16:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162312+0000", 2024-09-21T22:16:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7361000000000003e-05 2024-09-21T22:16:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.162368+0000", 2024-09-21T22:16:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6104999999999999e-05 2024-09-21T22:16:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.164384+0000", 2024-09-21T22:16:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020158120000000001 2024-09-21T22:16:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175199+0000", 2024-09-21T22:16:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010815455 2024-09-21T22:16:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175212+0000", 2024-09-21T22:16:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2422000000000001e-05 2024-09-21T22:16:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175243+0000", 2024-09-21T22:16:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1142000000000001e-05 2024-09-21T22:16:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.175277+0000", 2024-09-21T22:16:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4057999999999998e-05 2024-09-21T22:16:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.252175529999999, 2024-09-21T22:16:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16577 3.0 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.762918979999998, 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056490309999999997, 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16577 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403761+0000", 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403762+0000", 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403773+0000", 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0584999999999999e-05 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403787+0000", 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4630999999999999e-05 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403796+0000", 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4500000000000004e-06 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.403921+0000", 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012577000000000001 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404002+0000", 2024-09-21T22:16:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0626999999999999e-05 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404115+0000", 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113169 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.405859+0000", 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017439809999999999 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408749+0000", 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028899479999999998 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409367+0000", 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000617872 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409410+0000", 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2942999999999999e-05 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16593 3.4 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.757956698000001, 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051936209999999998, 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16593 2024-09-21T22:16:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408723+0000", 2024-09-21T22:16:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408724+0000", 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4099999999999997e-07 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408728+0000", 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9879999999999998e-06 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408737+0000", 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9760000000000001e-06 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408744+0000", 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7270000000000001e-06 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408800+0000", 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6351000000000003e-05 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408893+0000", 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3158999999999994e-05 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409022+0000", 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915499999999999 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413621+0000", 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00459868 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413809+0000", 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018772299999999999 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413868+0000", 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9611000000000002e-05 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413917+0000", 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8409999999999999e-05 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16618 3.4 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.749762430000001, 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085534029999999994, 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16618 2024-09-21T22:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416918+0000", 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7599999999999996e-07 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416923+0000", 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.634e-06 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416935+0000", 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416943+0000", 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5860000000000005e-06 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417028+0000", 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4352999999999997e-05 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417137+0000", 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109226 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417259+0000", 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012192 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417821+0000", 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056199500000000003 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425374+0000", 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075528499999999998 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425426+0000", 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2179000000000003e-05 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425471+0000", 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5244000000000003e-05 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16629 3.19 3:9e091eba:::rbd_data.1185fc79843.00000000000000cf:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.746433538000002, 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053360919999999997, 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16629 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420246+0000", 2024-09-21T22:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420247+0000", 2024-09-21T22:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3099999999999996e-07 2024-09-21T22:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420252+0000", 2024-09-21T22:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5249999999999999e-06 2024-09-21T22:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420264+0000", 2024-09-21T22:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2473999999999999e-05 2024-09-21T22:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420271+0000", 2024-09-21T22:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.64e-06 2024-09-21T22:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420322+0000", 2024-09-21T22:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1354000000000003e-05 2024-09-21T22:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420382+0000", 2024-09-21T22:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9367999999999998e-05 2024-09-21T22:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.420451+0000", 2024-09-21T22:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9521000000000001e-05 2024-09-21T22:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425286+0000", 2024-09-21T22:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048351119999999999 2024-09-21T22:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425478+0000", 2024-09-21T22:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019156500000000001 2024-09-21T22:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425536+0000", 2024-09-21T22:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479e-05 2024-09-21T22:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425583+0000", 2024-09-21T22:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6223000000000001e-05 2024-09-21T22:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16942 3.19 3:9cb4a31c:::rbd_data.1185fc79843.0000000000000160:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.506959919, 2024-09-21T22:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005348022, 2024-09-21T22:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16942 2024-09-21T22:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659720+0000", 2024-09-21T22:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659722+0000", 2024-09-21T22:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9479999999999998e-06 2024-09-21T22:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659731+0000", 2024-09-21T22:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8619999999999992e-06 2024-09-21T22:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659751+0000", 2024-09-21T22:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0275000000000002e-05 2024-09-21T22:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659761+0000", 2024-09-21T22:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8530000000000004e-06 2024-09-21T22:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659833+0000", 2024-09-21T22:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2504999999999998e-05 2024-09-21T22:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.659932+0000", 2024-09-21T22:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8164000000000004e-05 2024-09-21T22:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.660693+0000", 2024-09-21T22:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076168099999999995 2024-09-21T22:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.663320+0000", 2024-09-21T22:16:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026266140000000002 2024-09-21T22:16:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.664952+0000", 2024-09-21T22:16:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016316589999999999 2024-09-21T22:16:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.665011+0000", 2024-09-21T22:16:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9710999999999998e-05 2024-09-21T22:16:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.665068+0000", 2024-09-21T22:16:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6749999999999997e-05 2024-09-21T22:16:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:16959 3.19 3:9c0b7e71:::rbd_data.1185fc79843.000000000000006a:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.487118560999999, 2024-09-21T22:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054482150000000002, 2024-09-21T22:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16959 2024-09-21T22:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679561+0000", 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679563+0000", 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2860000000000001e-06 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679568+0000", 2024-09-21T22:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9799999999999998e-06 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679581+0000", 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3434999999999999e-05 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679588+0000", 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2110000000000001e-06 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679640+0000", 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2086999999999998e-05 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.679753+0000", 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112991 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.680669+0000", 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00091544800000000002 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684899+0000", 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004229984 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684932+0000", 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3522999999999997e-05 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.684966+0000", 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3735999999999997e-05 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.685010+0000", 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3534e-05 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17128 3.19 3:9889dc56:::rbd_data.1185fc79843.0000000000000063:head [delete] snapc e=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.310156112000001, 2024-09-21T22:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051858959999999997, 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17128 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856524+0000", 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856526+0000", 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.928e-06 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856533+0000", 2024-09-21T22:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6070000000000002e-06 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856555+0000", 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1209e-05 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856564+0000", 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8179999999999999e-06 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856639+0000", 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4604999999999995e-05 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856738+0000", 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9291999999999997e-05 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.856889+0000", 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015028599999999999 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.857493+0000", 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000604025 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861598+0000", 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041055880000000003 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861659+0000", 2024-09-21T22:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0529999999999998e-05 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.861710+0000", 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1007999999999997e-05 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:17226 3.19 3:9e091eba:::rbd_data.1185fc79843.00000000000000cf:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.230539576999998, 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062013320000000004, 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 17226 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936140+0000", 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936142+0000", 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3680000000000001e-06 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936148+0000", 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3840000000000002e-06 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936161+0000", 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2522e-05 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936169+0000", 2024-09-21T22:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4149999999999999e-06 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936218+0000", 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9128999999999997e-05 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.936277+0000", 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8832000000000002e-05 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.937245+0000", 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00096821899999999998 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.941109+0000", 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038635430000000001 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942246+0000", 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011373760000000001 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942294+0000", 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7478000000000002e-05 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.942342+0000", 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8065999999999997e-05 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:26837 3.19 3:9ddb6656:::rbd_data.118527d5458b.0000000000000012:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.754076154, 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055045679999999996, 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26837 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412604+0000", 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412606+0000", 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0260000000000002e-06 2024-09-21T22:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412613+0000", 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4100000000000002e-06 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412632+0000", 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8309e-05 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412641+0000", 2024-09-21T22:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-06 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412719+0000", 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7086e-05 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412828+0000", 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010985 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.412962+0000", 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013390799999999999 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.414950+0000", 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019879479999999998 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.417992+0000", 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030417339999999999 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.418053+0000", 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0572999999999998e-05 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:10.418108+0000", 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5804000000000003e-05 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:38596 3.4 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head [write 0~1091115 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.941476+0000", 2024-09-21T22:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.2252039440000004, 2024-09-21T22:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076611589999999999, 2024-09-21T22:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 38596 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.941476+0000", 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.941476+0000", 2024-09-21T22:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.941477+0000", 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.274e-06 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.942591+0000", 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001113394 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.942614+0000", 2024-09-21T22:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3141000000000001e-05 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.942626+0000", 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1926999999999999e-05 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.942701+0000", 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5715000000000003e-05 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.942828+0000", 2024-09-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012651200000000001 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.942959+0000", 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013057699999999999 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.946037+0000", 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030789210000000001 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.949069+0000", 2024-09-21T22:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030314600000000001 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.949107+0000", 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8321999999999997e-05 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.949137+0000", 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9916e-05 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:42372 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head [write 0~630673 [fadvise_sequential+fadvise_nocache],write 12582912~32768 [fadvise_sequential+fadvise_nocache],write 12697600~31266 [fadvise_sequential+fadvise_nocache],write 13680640~16384 [fadvise_sequential+fadvise_nocache],write 13795328~16384 [fadvise_sequential+fadvise_nocache],write 13910016~11770 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986035+0000", 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.180645323, 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063058599999999999, 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 42372 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986035+0000", 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986035+0000", 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986037+0000", 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1459999999999999e-06 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986971+0000", 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00093406700000000001 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986992+0000", 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0798999999999999e-05 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987047+0000", 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4911000000000003e-05 2024-09-21T22:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987124+0000", 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7748000000000002e-05 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987298+0000", 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173945 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987580+0000", 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028180799999999998 2024-09-21T22:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.991376+0000", 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037957659999999999 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992215+0000", 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00083911299999999995 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992282+0000", 2024-09-21T22:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7244999999999997e-05 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992341+0000", 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8312e-05 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:30.330 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:30.167+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:30.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:30.331 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:30.329+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:30.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:30.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:30.430+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:30.438 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:30.438 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:30.439 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:30.439 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:30.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:30.454 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:30.454 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:30.471 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:30.532 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:30.531+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:30.556 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:30.556 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:30.556 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:30.556 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:30.556 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:30.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:30.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:30.648+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:30.689 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:30.689 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:30.706 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:30.707 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:30.712 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:30.712 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:30.721 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:30.724 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:30.741 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:30.741 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:30.758 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:30.758 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:30.765 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:30.763+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:30.775 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:30.775 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:30.835 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:30.834+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:30.836 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:30.836 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:30.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:30.936 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:30.934+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:30.941 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:16:30.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:16:30.941 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:16:30.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:16:30.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:16:30.993 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:30.993 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:31.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:31.037 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:31.036+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:31.093 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-21T22:16:31.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:31.136+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:31.145 INFO:teuthology.orchestra.run.smithi134.stdout:2879 write 0x6e2137e thru 0x6e2aa77 (0x96fa bytes) 2024-09-21T22:16:31.149 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:31.150 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:31.150 INFO:teuthology.orchestra.run.smithi134.stdout:2880 write 0x6832c78 thru 0x6832d5b (0xe4 bytes) 2024-09-21T22:16:31.151 INFO:teuthology.orchestra.run.smithi134.stdout:2881 write 0xb825b4 thru 0xb844d9 (0x1f26 bytes) 2024-09-21T22:16:31.153 INFO:teuthology.orchestra.run.smithi134.stdout:2882 writesame 0x2b2b thru 0xf1b5 data_size 0x35(0xc68b bytes) 2024-09-21T22:16:31.158 INFO:teuthology.orchestra.run.smithi134.stdout:2883 write 0x92577f1 thru 0x925c007 (0x4817 bytes) 2024-09-21T22:16:31.159 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:31.160 INFO:teuthology.orchestra.run.smithi134.stdout:2885 read 0x724423b thru 0x724da13 (0x97d9 bytes) 2024-09-21T22:16:31.167 INFO:teuthology.orchestra.run.smithi134.stdout:2887 writesame 0xd9b1903 thru 0xd9bc349 data_size 0x1(0xaa47 bytes) 2024-09-21T22:16:31.167 INFO:teuthology.orchestra.run.smithi134.stdout:2888 write 0x86ce15 thru 0x873b29 (0x6d15 bytes) 2024-09-21T22:16:31.169 INFO:teuthology.orchestra.run.smithi134.stdout:2890 write 0xcc647a thru 0xcca832 (0x43b9 bytes) 2024-09-21T22:16:31.171 INFO:teuthology.orchestra.run.smithi134.stdout:2891 punch from 0xa1b20d5 to 0xa1b295c, (0x887 bytes) 2024-09-21T22:16:31.171 INFO:teuthology.orchestra.run.smithi134.stdout:2892 write 0x4921224 thru 0x4929453 (0x8230 bytes) 2024-09-21T22:16:31.179 INFO:teuthology.orchestra.run.smithi134.stdout:2893 trunc from 0xd9bc34a to 0x6ffbb1f 2024-09-21T22:16:31.198 INFO:teuthology.orchestra.run.smithi134.stdout:2894 read 0x652a2ca thru 0x6534392 (0xa0c9 bytes) 2024-09-21T22:16:31.198 INFO:teuthology.orchestra.run.smithi134.stdout:2895 writesame 0x33986fa thru 0x33a1b97 data_size 0x33(0x949e bytes) 2024-09-21T22:16:31.199 INFO:teuthology.orchestra.run.smithi134.stdout:2896 write 0x5a85f5b thru 0x5a8709a (0x1140 bytes) 2024-09-21T22:16:31.201 INFO:teuthology.orchestra.run.smithi134.stdout:2897 read 0x44f1521 thru 0x44fb49b (0x9f7b bytes) 2024-09-21T22:16:31.201 INFO:teuthology.orchestra.run.smithi134.stdout:2898 read 0x5f9af64 thru 0x5fa489e (0x993b bytes) 2024-09-21T22:16:31.202 INFO:teuthology.orchestra.run.smithi134.stdout:2899 punch from 0x106c4a6 to 0x106ccbc, (0x816 bytes) 2024-09-21T22:16:31.202 INFO:teuthology.orchestra.run.smithi134.stdout:2900 punch from 0x4406a7 to 0x4476eb, (0x7044 bytes) 2024-09-21T22:16:31.202 INFO:teuthology.orchestra.run.smithi134.stdout:2901 punch from 0x21eb2e1 to 0x21f5f7c, (0xac9b bytes) 2024-09-21T22:16:31.202 INFO:teuthology.orchestra.run.smithi134.stdout:2903 read 0x95ddae thru 0x96b62a (0xd87d bytes) 2024-09-21T22:16:31.202 INFO:teuthology.orchestra.run.smithi134.stdout:2904 punch from 0x1fc2509 to 0x1fc4902, (0x23f9 bytes) 2024-09-21T22:16:31.202 INFO:teuthology.orchestra.run.smithi134.stdout:2905 writesame 0x660587f thru 0x66148b1 data_size 0x67(0xf033 bytes) 2024-09-21T22:16:31.204 INFO:teuthology.orchestra.run.smithi134.stdout:2907 punch from 0x124d308 to 0x125ac58, (0xd950 bytes) 2024-09-21T22:16:31.204 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.204 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.204 INFO:teuthology.orchestra.run.smithi134.stdout:2910 write 0x4c61c51 thru 0x4c62350 (0x700 bytes) 2024-09-21T22:16:31.220 INFO:teuthology.orchestra.run.smithi134.stdout:2911 write 0xe384e71 thru 0xe38c6d4 (0x7864 bytes) 2024-09-21T22:16:31.223 INFO:teuthology.orchestra.run.smithi134.stdout:2912 write 0xa988499 thru 0xa99577a (0xd2e2 bytes) 2024-09-21T22:16:31.226 INFO:teuthology.orchestra.run.smithi134.stdout:2913 punch from 0xb7193ec to 0xb728cd6, (0xf8ea bytes) 2024-09-21T22:16:31.226 INFO:teuthology.orchestra.run.smithi134.stdout:2914 punch from 0x89c43f7 to 0x89cd307, (0x8f10 bytes) 2024-09-21T22:16:31.226 INFO:teuthology.orchestra.run.smithi134.stdout:2915 write 0xbcba80f thru 0xbcca127 (0xf919 bytes) 2024-09-21T22:16:31.232 INFO:teuthology.orchestra.run.smithi134.stdout:2916 punch from 0x408dfbe to 0x4096777, (0x87b9 bytes) 2024-09-21T22:16:31.232 INFO:teuthology.orchestra.run.smithi134.stdout:2917 write 0xc46c9d7 thru 0xc4717b4 (0x4dde bytes) 2024-09-21T22:16:31.235 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.235 INFO:teuthology.orchestra.run.smithi134.stdout:2919 punch from 0x54f2141 to 0x54f675c, (0x461b bytes) 2024-09-21T22:16:31.235 INFO:teuthology.orchestra.run.smithi134.stdout:2920 write 0x7eb55b6 thru 0x7ec02d5 (0xad20 bytes) 2024-09-21T22:16:31.236 INFO:teuthology.orchestra.run.smithi134.stdout:2922 writesame 0x8f2f233 thru 0x8f3423f data_size 0x51(0x500d bytes) 2024-09-21T22:16:31.238 INFO:teuthology.orchestra.run.smithi134.stdout:2923 write 0xcbdef81 thru 0xcbe29e0 (0x3a60 bytes) 2024-09-21T22:16:31.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:31.237+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:31.239 INFO:teuthology.orchestra.run.smithi134.stdout:2927 read 0xb0b9bff thru 0xb0c1790 (0x7b92 bytes) 2024-09-21T22:16:31.240 INFO:teuthology.orchestra.run.smithi134.stdout:2928 write 0x129774c thru 0x129caa8 (0x535d bytes) 2024-09-21T22:16:31.241 INFO:teuthology.orchestra.run.smithi134.stdout:2929 punch from 0x7eed721 to 0x7ef51ee, (0x7acd bytes) 2024-09-21T22:16:31.241 INFO:teuthology.orchestra.run.smithi134.stdout:2930 write 0xd682bb2 thru 0xd688fa3 (0x63f2 bytes) 2024-09-21T22:16:31.243 INFO:teuthology.orchestra.run.smithi134.stdout:2931 punch from 0x875a9be to 0x8766cd0, (0xc312 bytes) 2024-09-21T22:16:31.243 INFO:teuthology.orchestra.run.smithi134.stdout:2932 punch from 0x4eb9e09 to 0x4ebe55b, (0x4752 bytes) 2024-09-21T22:16:31.243 INFO:teuthology.orchestra.run.smithi134.stdout:2933 write 0x4d779f4 thru 0x4d77b7f (0x18c bytes) 2024-09-21T22:16:31.244 INFO:teuthology.orchestra.run.smithi134.stdout:2934 read 0x6679754 thru 0x667d80f (0x40bc bytes) 2024-09-21T22:16:31.245 INFO:teuthology.orchestra.run.smithi134.stdout:2936 write 0xe35df14 thru 0xe3617fe (0x38eb bytes) 2024-09-21T22:16:31.246 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.246 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.246 INFO:teuthology.orchestra.run.smithi134.stdout:2941 writesame 0x39da474 thru 0x39e82f6 data_size 0x1(0xde83 bytes) 2024-09-21T22:16:31.263 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 74, 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:16:30.938207+0000", 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:59.900683+0000", 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:15:09.268171+0000", 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5804032, 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "nodeep-scrub", 2024-09-21T22:16:31.264 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 5, 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 3, 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:16:31.265 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "luminous", 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:16:31.266 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:16:31.267 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:16:31.268 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:16:31.269 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:16:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 8, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 8, 2024-09-21T22:16:31.271 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.25, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:16:31.272 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:16:31.273 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:16:31.274 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:16:31.275 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:16:31.276 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.9900000095367432, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.9900000095367432, 2024-09-21T22:16:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 1.75, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 1.75, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "pool_client.0", 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:34.502611+0000", 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:16:31.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 32, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 32, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 32, 2024-09-21T22:16:31.279 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 32, 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 32, 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "74", 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:16:31.280 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 28, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 74, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:16:31.281 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:16:31.282 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:16:31.283 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.5, 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.5, 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1, 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 1.5, 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 1.5, 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 1, 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 1 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.284 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 27, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.285 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.287 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:16:31.288 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.289 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:31.290 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 63, 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:16:31.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:16:31.295 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 0.9858245849609375, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 45, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:16:31.296 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:16:31.297 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:16:31.298 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:16:31.299 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 13, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 26, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 45, 2024-09-21T22:16:31.301 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 48, 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 27, 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:16:31.303 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:16:31.304 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/704257458", 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/704257458", 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/704257458", 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/704257458", 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.306 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 23, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.307 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.308 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.309 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.310 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.311 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.312 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 45, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 47, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:31.318 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.321 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.322 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:16:31.323 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 48, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.327 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:16:31.329 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.330 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 27 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.332 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:16:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [ 2024-09-21T22:16:31.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.16", 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: 2 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:16:31.335 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [ 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 22, 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:31.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 24, 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 26, 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 28, 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [ 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 28, 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [], 2024-09-21T22:16:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:31.339 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:31.341 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:31.341 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:31.342 INFO:tasks.thrashosds.thrasher:j is {'epoch': 74, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:16:30.938207+0000', 'last_up_change': '2024-09-21T22:15:59.900683+0000', 'last_in_change': '2024-09-21T22:15:09.268171+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:15:34.502611+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 28, 'snap_epoch': 74, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 0.9858245849609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 26, 'up_from': 45, 'up_thru': 48, 'down_at': 27, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 704257458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 704257458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 704257458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 704257458}]}, 'public_addr': '172.21.15.134:6809/704257458', 'cluster_addr': '172.21.15.134:6811/704257458', 'heartbeat_back_addr': '172.21.15.134:6815/704257458', 'heartbeat_front_addr': '172.21.15.134:6813/704257458', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 27}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.16', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 22, 'length': 1}, {'begin': 24, 'length': 1}, {'begin': 26, 'length': 1}, {'begin': 28, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 28, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:16:31.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:16:31.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:31.343 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:31.339+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:31.344 INFO:teuthology.orchestra.run.smithi134.stdout:2943 read 0x3fafdab thru 0x3fb8bb5 (0x8e0b bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2945 write 0x61c1336 thru 0x61cbf92 (0xac5d bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2946 write 0xbfc78e thru 0xc0bf23 (0xf796 bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2947 punch from 0xbe78b59 to 0xbe7c225, (0x36cc bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2949 writesame 0x8df95da thru 0x8e0693f data_size 0x1(0xd366 bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2951 trunc from 0xe38c6d5 to 0xddb9fa3 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2953 read 0x7a8d25a thru 0x7a9bc83 (0xea2a bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2955 read 0xd7cb663 thru 0xd7cdc57 (0x25f5 bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2957 punch from 0x1ed09bc to 0x1ed32ef, (0x2933 bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2958 punch from 0xc5b1a75 to 0xc5c00f7, (0xe682 bytes) 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:2960 trunc from 0xddb9fa3 to 0xa74a199 2024-09-21T22:16:31.345 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:2962 writesame 0xc2ea57b thru 0xc2f4d71 data_size 0xb(0xa7f7 bytes) 2024-09-21T22:16:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:2963 punch from 0x786ee60 to 0x786f7cb, (0x96b bytes) 2024-09-21T22:16:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:2964 punch from 0x87e6fe4 to 0x87ec30b, (0x5327 bytes) 2024-09-21T22:16:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:2966 punch from 0x9c6d799 to 0x9c72644, (0x4eab bytes) 2024-09-21T22:16:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:2967 read 0xbc0ad2f thru 0xbc17c3b (0xcf0d bytes) 2024-09-21T22:16:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:2969 punch from 0x493b252 to 0x494960b, (0xe3b9 bytes) 2024-09-21T22:16:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:2970 writesame 0xb096408 thru 0xb097de3 data_size 0x1(0x19dc bytes) 2024-09-21T22:16:31.351 INFO:teuthology.orchestra.run.smithi134.stdout:2972 trunc from 0xc2f4d72 to 0x1a697f9 2024-09-21T22:16:31.376 INFO:teuthology.orchestra.run.smithi134.stdout:2973 write 0x57a2c18 thru 0x57b006e (0xd457 bytes) 2024-09-21T22:16:31.389 INFO:teuthology.orchestra.run.smithi134.stdout:2974 trunc from 0x57b006f to 0xebb0467 2024-09-21T22:16:31.395 INFO:teuthology.orchestra.run.smithi134.stdout:2975 punch from 0xb4b7dcf to 0xb4ba983, (0x2bb4 bytes) 2024-09-21T22:16:31.396 INFO:teuthology.orchestra.run.smithi134.stdout:2976 write 0x9900b2a thru 0x99028c2 (0x1d99 bytes) 2024-09-21T22:16:31.410 INFO:teuthology.orchestra.run.smithi134.stdout:2977 trunc from 0xebb0467 to 0x497bb91 2024-09-21T22:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout:2978 writesame 0xb5c03be thru 0xb5cb7ef data_size 0x23(0xb432 bytes) 2024-09-21T22:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout:2979 write 0xa49996 thru 0xa54c02 (0xb26d bytes) 2024-09-21T22:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout:2982 write 0x8400e7f thru 0x840faae (0xec30 bytes) 2024-09-21T22:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout:2984 writesame 0x898eadf thru 0x8995222 data_size 0x6(0x6744 bytes) 2024-09-21T22:16:31.440 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:31.439+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout:2985 read 0x5cedc5a thru 0x5cf9099 (0xb440 bytes) 2024-09-21T22:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout:2986 read 0x205ae43 thru 0x2065120 (0xa2de bytes) 2024-09-21T22:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout:2988 read 0x87530df thru 0x875dc73 (0xab95 bytes) 2024-09-21T22:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout:2989 read 0xd7995e thru 0xd8936d (0xfa10 bytes) 2024-09-21T22:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout:2990 read 0xa93cb8c thru 0xa94112e (0x45a3 bytes) 2024-09-21T22:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout:2991 punch from 0x4935862 to 0x4939e9e, (0x463c bytes) 2024-09-21T22:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout:2992 read 0x6d51ac7 thru 0x6d5dfef (0xc529 bytes) 2024-09-21T22:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout:2993 write 0x8050dc7 thru 0x80544d5 (0x370f bytes) 2024-09-21T22:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout:2995 read 0x7e6209a thru 0x7e701a5 (0xe10c bytes) 2024-09-21T22:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout:2998 punch from 0x8776e4e to 0x8781995, (0xab47 bytes) 2024-09-21T22:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout:2999 read 0x92af7ea thru 0x92b1906 (0x211d bytes) 2024-09-21T22:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout:3000 punch from 0xc994fb to 0xc9e078, (0x4b7d bytes) 2024-09-21T22:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout:3001 punch from 0x1a65a31 to 0x1a6f0b7, (0x9686 bytes) 2024-09-21T22:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout:3002 punch from 0x3c5b7c9 to 0x3c6b6f2, (0xff29 bytes) 2024-09-21T22:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout:3003 trunc from 0xb5cb7f0 to 0x7941698 2024-09-21T22:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout:3004 trunc from 0x7941698 to 0xdb31572 2024-09-21T22:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout:3005 punch from 0x6fc1876 to 0x6fced0b, (0xd495 bytes) 2024-09-21T22:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout:3006 writesame 0x25dd990 thru 0x25ed54d data_size 0x45(0xfbbe bytes) 2024-09-21T22:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout:3007 read 0x4e41954 thru 0x4e445e1 (0x2c8e bytes) 2024-09-21T22:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout:3009 writesame 0x842fe39 thru 0x8432d85 data_size 0x1(0x2f4d bytes) 2024-09-21T22:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout:3010 read 0x77dca22 thru 0x77e5dbb (0x939a bytes) 2024-09-21T22:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout:3011 read 0xab1d7de thru 0xab26fc1 (0x97e4 bytes) 2024-09-21T22:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout:3012 writesame 0x6e0ba78 thru 0x6e1830f data_size 0x83(0xc898 bytes) 2024-09-21T22:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout:3015 writesame 0x53468ff thru 0x53479c0 data_size 0x27(0x10c2 bytes) 2024-09-21T22:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout:3016 punch from 0x7737ed7 to 0x774596c, (0xda95 bytes) 2024-09-21T22:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout:3017 read 0xb7a3901 thru 0xb7a4357 (0xa57 bytes) 2024-09-21T22:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout:3018 read 0xbfd6e61 thru 0xbfdd940 (0x6ae0 bytes) 2024-09-21T22:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout:3019 write 0xb6308f thru 0xb66a3b (0x39ad bytes) 2024-09-21T22:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout:3022 writesame 0xc15331f thru 0xc158665 data_size 0x1(0x5347 bytes) 2024-09-21T22:16:31.490 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:31.490 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout:3024 punch from 0xabd0d3 to 0xac44c5, (0x73f2 bytes) 2024-09-21T22:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout:3026 write 0x7491f1c thru 0x74a19ba (0xfa9f bytes) 2024-09-21T22:16:31.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout:3027 write 0xc45cb69 thru 0xc46c76b (0xfc03 bytes) 2024-09-21T22:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout:3028 read 0x1c001f thru 0x1c416a (0x414c bytes) 2024-09-21T22:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout:3030 read 0xae5e77a thru 0xae6aff0 (0xc877 bytes) 2024-09-21T22:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout:3032 read 0x564a1c thru 0x56ac35 (0x621a bytes) 2024-09-21T22:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout:3033 write 0x15f1f1d thru 0x15ff54f (0xd633 bytes) 2024-09-21T22:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout:3034 trunc from 0xdb31572 to 0x8462732 2024-09-21T22:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout:3035 trunc from 0x8462732 to 0x49a3602 2024-09-21T22:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.544 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:31.542+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:31.545 INFO:teuthology.orchestra.run.smithi134.stdout:3037 trunc from 0x49a3602 to 0xb4ec197 2024-09-21T22:16:31.550 INFO:teuthology.orchestra.run.smithi134.stdout:3038 write 0x8d2a72d thru 0x8d3651d (0xbdf1 bytes) 2024-09-21T22:16:31.554 INFO:teuthology.orchestra.run.smithi134.stdout:3040 write 0x8234e6e thru 0x823cf80 (0x8113 bytes) 2024-09-21T22:16:31.560 INFO:teuthology.orchestra.run.smithi134.stdout:3042 trunc from 0xb4ec197 to 0x8ef00e6 2024-09-21T22:16:31.576 INFO:teuthology.orchestra.run.smithi134.stdout:3043 writesame 0xbdd050e thru 0xbdd9886 data_size 0x1(0x9379 bytes) 2024-09-21T22:16:31.576 INFO:teuthology.orchestra.run.smithi134.stdout:3044 write 0x2b91b0 thru 0x2bf017 (0x5e68 bytes) 2024-09-21T22:16:31.577 INFO:teuthology.orchestra.run.smithi134.stdout:3047 write 0x9ff8334 thru 0x9ffacd0 (0x299d bytes) 2024-09-21T22:16:31.581 INFO:teuthology.orchestra.run.smithi134.stdout:3048 write 0xb4467fd thru 0xb448c5c (0x2460 bytes) 2024-09-21T22:16:31.588 INFO:teuthology.orchestra.run.smithi134.stdout:3049 trunc from 0xbdd9887 to 0x742e49c 2024-09-21T22:16:31.601 INFO:teuthology.orchestra.run.smithi134.stdout:3050 write 0x5098353 thru 0x5099fea (0x1c98 bytes) 2024-09-21T22:16:31.609 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:31.609 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:31.612 INFO:teuthology.orchestra.run.smithi134.stdout:3054 writesame 0xa84dd65 thru 0xa8510d3 data_size 0x4d(0x336f bytes) 2024-09-21T22:16:31.612 INFO:teuthology.orchestra.run.smithi134.stdout:3057 read 0x70bd1b5 thru 0x70bf25d (0x20a9 bytes) 2024-09-21T22:16:31.612 INFO:teuthology.orchestra.run.smithi134.stdout:3059 writesame 0xd947e1 thru 0xd99894 data_size 0xa(0x50b4 bytes) 2024-09-21T22:16:31.614 INFO:teuthology.orchestra.run.smithi134.stdout:3060 read 0x72da254 thru 0x72e3031 (0x8dde bytes) 2024-09-21T22:16:31.614 INFO:teuthology.orchestra.run.smithi134.stdout:3061 punch from 0x99dd1e9 to 0x99e8770, (0xb587 bytes) 2024-09-21T22:16:31.614 INFO:teuthology.orchestra.run.smithi134.stdout:3063 read 0x96b6d49 thru 0x96c4ed3 (0xe18b bytes) 2024-09-21T22:16:31.615 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.615 INFO:teuthology.orchestra.run.smithi134.stdout:3065 write 0x9efb5af thru 0x9efe1a6 (0x2bf8 bytes) 2024-09-21T22:16:31.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:31.623 INFO:teuthology.orchestra.run.smithi134.stdout:3069 trunc from 0xa8510d4 to 0x7044ebf 2024-09-21T22:16:31.638 INFO:teuthology.orchestra.run.smithi134.stdout:3070 trunc from 0x7044ebf to 0xa777b3c 2024-09-21T22:16:31.643 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.643 INFO:teuthology.orchestra.run.smithi134.stdout:3073 read 0x1f2208a thru 0x1f24dc1 (0x2d38 bytes) 2024-09-21T22:16:31.643 INFO:teuthology.orchestra.run.smithi134.stdout:3076 read 0x93507ce thru 0x93578f2 (0x7125 bytes) 2024-09-21T22:16:31.644 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.648 INFO:teuthology.orchestra.run.smithi134.stdout:3079 write 0xaba4d55 thru 0xabb3f83 (0xf22f bytes) 2024-09-21T22:16:31.657 INFO:teuthology.orchestra.run.smithi134.stdout:3080 trunc from 0xabb3f84 to 0xe861d95 2024-09-21T22:16:31.660 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:31.658+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:31.662 INFO:teuthology.orchestra.run.smithi134.stdout:3081 writesame 0xa7c17f3 thru 0xa7c3c4f data_size 0x1d(0x245d bytes) 2024-09-21T22:16:31.665 INFO:teuthology.orchestra.run.smithi134.stdout:3082 writesame 0x8f7f915 thru 0x8f827bf data_size 0x1(0x2eab bytes) 2024-09-21T22:16:31.670 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:31.671 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:16:31.673 INFO:teuthology.orchestra.run.smithi134.stdout:3083 read 0x2a691c0 thru 0x2a69ed4 (0xd15 bytes) 2024-09-21T22:16:31.674 INFO:teuthology.orchestra.run.smithi134.stdout:3084 writesame 0x96e00f7 thru 0x96eb3a0 data_size 0x4d(0xb2aa bytes) 2024-09-21T22:16:31.675 INFO:teuthology.orchestra.run.smithi134.stdout:3085 writesame 0x9697373 thru 0x96a1a73 data_size 0x1(0xa701 bytes) 2024-09-21T22:16:31.685 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-21T22:16:31.184431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":457996620,"num_objects":345,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":345,"num_whiteouts":0,"num_read":42871,"num_read_kb":343211,"num_write":10960,"num_write_kb":283317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":19911710,"num_keys_recovered":32,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7409,"ondisk_log_size":7409,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435960,"kb_used_data":160392,"kb_used_omap":15,"kb_used_meta":275376,"kb_avail":754538760,"statfs":{"total":773094113280,"available":772647690240,"internally_reserved":0,"allocated":164241408,"data_stored":159236249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":281985820},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45226435,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":3104,"num_read_kb":17483,"num_write":778,"num_write_kb":11971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000594"},"pg_stats":[{"pgid":"3.1f","version":"71'368","reported_seq":1295,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.941349+0000","last_change":"2024-09-21T22:16:27.984534+0000","last_active":"2024-09-21T22:16:28.941349+0000","last_peered":"2024-09-21T22:16:28.941349+0000","last_clean":"2024-09-21T22:16:28.941349+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:16:28.941349+0000","last_undegraded":"2024-09-21T22:16:28.941349+0000","last_fullsized":"2024-09-21T22:16:28.941349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:15.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077683600000000004,"stat_sum":{"num_bytes":20019660,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1939,"num_read_kb":14118,"num_write":624,"num_write_kb":11893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.1e","version":"71'313","reported_seq":2321,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.305214+0000","last_change":"2024-09-21T22:16:27.930698+0000","last_active":"2024-09-21T22:16:28.305214+0000","last_peered":"2024-09-21T22:16:28.305214+0000","last_clean":"2024-09-21T22:16:28.305214+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:16:28.305214+0000","last_undegraded":"2024-09-21T22:16:28.305214+0000","last_fullsized":"2024-09-21T22:16:28.305214+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:44:04.281304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091668900000000005,"stat_sum":{"num_bytes":15297098,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3042,"num_read_kb":13757,"num_write":307,"num_write_kb":7190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.1d","version":"71'153","reported_seq":1745,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.959173+0000","last_change":"2024-09-21T22:16:27.927102+0000","last_active":"2024-09-21T22:16:28.959173+0000","last_peered":"2024-09-21T22:16:28.959173+0000","last_clean":"2024-09-21T22:16:28.959173+0000","last_became_active":"2024-09-21T22:15:36.449655+0000","last_became_peered":"2024-09-21T22:15:36.449655+0000","last_unstale":"2024-09-21T22:16:28.959173+0000","last_undegraded":"2024-09-21T22:16:28.959173+0000","last_fullsized":"2024-09-21T22:16:28.959173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:37:04.858091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000447133,"stat_sum":{"num_bytes":25415052,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1733,"num_read_kb":27159,"num_write":266,"num_write_kb":14792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.1c","version":"72'177","reported_seq":819,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.959151+0000","last_change":"2024-09-21T22:16:27.927114+0000","last_active":"2024-09-21T22:16:28.959151+0000","last_peered":"2024-09-21T22:16:28.959151+0000","last_clean":"2024-09-21T22:16:28.959151+0000","last_became_active":"2024-09-21T22:15:36.449203+0000","last_became_peered":"2024-09-21T22:15:36.449203+0000","last_unstale":"2024-09-21T22:16:28.959151+0000","last_undegraded":"2024-09-21T22:16:28.959151+0000","last_fullsized":"2024-09-21T22:16:28.959151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:47:52.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056527699999999999,"stat_sum":{"num_bytes":15022044,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":513,"num_read_kb":11098,"num_write":282,"num_write_kb":12697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.1b","version":"71'116","reported_seq":699,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.941116+0000","last_change":"2024-09-21T22:16:27.984314+0000","last_active":"2024-09-21T22:16:28.941116+0000","last_peered":"2024-09-21T22:16:28.941116+0000","last_clean":"2024-09-21T22:16:28.941116+0000","last_became_active":"2024-09-21T22:15:36.451889+0000","last_became_peered":"2024-09-21T22:15:36.451889+0000","last_unstale":"2024-09-21T22:16:28.941116+0000","last_undegraded":"2024-09-21T22:16:28.941116+0000","last_fullsized":"2024-09-21T22:16:28.941116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:23:09.049151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057918800000000001,"stat_sum":{"num_bytes":6499081,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":643,"num_read_kb":9560,"num_write":191,"num_write_kb":8125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.1a","version":"71'73","reported_seq":961,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.957726+0000","last_change":"2024-09-21T22:16:27.932818+0000","last_active":"2024-09-21T22:16:28.957726+0000","last_peered":"2024-09-21T22:16:28.957726+0000","last_clean":"2024-09-21T22:16:28.957726+0000","last_became_active":"2024-09-21T22:15:36.445163+0000","last_became_peered":"2024-09-21T22:15:36.445163+0000","last_unstale":"2024-09-21T22:16:28.957726+0000","last_undegraded":"2024-09-21T22:16:28.957726+0000","last_fullsized":"2024-09-21T22:16:28.957726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:31.516134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033724200000000002,"stat_sum":{"num_bytes":3293162,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":697,"num_read_kb":2515,"num_write":98,"num_write_kb":4606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.19","version":"73'239","reported_seq":1570,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T22:16:30.044623+0000","last_change":"2024-09-21T22:16:28.006451+0000","last_active":"2024-09-21T22:16:30.044623+0000","last_peered":"2024-09-21T22:16:30.044623+0000","last_clean":"2024-09-21T22:16:30.044623+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:16:30.044623+0000","last_undegraded":"2024-09-21T22:16:30.044623+0000","last_fullsized":"2024-09-21T22:16:30.044623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:43:53.475190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013136510000000001,"stat_sum":{"num_bytes":9830474,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2150,"num_read_kb":8960,"num_write":290,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.18","version":"71'468","reported_seq":753,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.156021+0000","last_change":"2024-09-21T22:16:27.930226+0000","last_active":"2024-09-21T22:16:28.156021+0000","last_peered":"2024-09-21T22:16:28.156021+0000","last_clean":"2024-09-21T22:16:28.156021+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:16:28.156021+0000","last_undegraded":"2024-09-21T22:16:28.156021+0000","last_fullsized":"2024-09-21T22:16:28.156021+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:02:23.134384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054330800000000005,"stat_sum":{"num_bytes":14275145,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1493,"num_read_kb":6676,"num_write":680,"num_write_kb":9109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.17","version":"71'670","reported_seq":1585,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.941328+0000","last_change":"2024-09-21T22:16:27.984650+0000","last_active":"2024-09-21T22:16:28.941328+0000","last_peered":"2024-09-21T22:16:28.941328+0000","last_clean":"2024-09-21T22:16:28.941328+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:16:28.941328+0000","last_undegraded":"2024-09-21T22:16:28.941328+0000","last_fullsized":"2024-09-21T22:16:28.941328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:21:06.912625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087617499999999998,"stat_sum":{"num_bytes":8382498,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3750,"num_read_kb":9676,"num_write":1291,"num_write_kb":10767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.16","version":"73'107","reported_seq":128,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T22:16:29.992284+0000","last_change":"2024-09-21T22:16:28.006987+0000","last_active":"2024-09-21T22:16:29.992284+0000","last_peered":"2024-09-21T22:16:29.992284+0000","last_clean":"2024-09-21T22:16:29.992284+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:16:29.992284+0000","last_undegraded":"2024-09-21T22:16:29.992284+0000","last_fullsized":"2024-09-21T22:16:29.992284+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:37:15.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001509818,"stat_sum":{"num_bytes":41173479,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":647,"num_read_kb":11487,"num_write":185,"num_write_kb":6359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.15","version":"72'549","reported_seq":2389,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.943920+0000","last_change":"2024-09-21T22:16:27.936925+0000","last_active":"2024-09-21T22:16:28.943920+0000","last_peered":"2024-09-21T22:16:28.943920+0000","last_clean":"2024-09-21T22:16:28.943920+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:16:28.943920+0000","last_undegraded":"2024-09-21T22:16:28.943920+0000","last_fullsized":"2024-09-21T22:16:28.943920+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:46:39.158591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047568,"stat_sum":{"num_bytes":42023898,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":3535,"num_read_kb":22529,"num_write":901,"num_write_kb":19309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.14","version":"71'201","reported_seq":1387,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.939668+0000","last_change":"2024-09-21T22:16:27.933154+0000","last_active":"2024-09-21T22:16:28.939668+0000","last_peered":"2024-09-21T22:16:28.939668+0000","last_clean":"2024-09-21T22:16:28.939668+0000","last_became_active":"2024-09-21T22:15:36.448788+0000","last_became_peered":"2024-09-21T22:15:36.448788+0000","last_unstale":"2024-09-21T22:16:28.939668+0000","last_undegraded":"2024-09-21T22:16:28.939668+0000","last_fullsized":"2024-09-21T22:16:28.939668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:32:53.391008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035079399999999998,"stat_sum":{"num_bytes":35571487,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":998,"num_read_kb":9515,"num_write":243,"num_write_kb":8976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.937336+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:16:28.937336+0000","last_peered":"2024-09-21T22:16:28.937336+0000","last_clean":"2024-09-21T22:16:28.937336+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:16:28.937336+0000","last_undegraded":"2024-09-21T22:16:28.937336+0000","last_fullsized":"2024-09-21T22:16:28.937336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"71'223","reported_seq":1689,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.941198+0000","last_change":"2024-09-21T22:16:27.984266+0000","last_active":"2024-09-21T22:16:28.941198+0000","last_peered":"2024-09-21T22:16:28.941198+0000","last_clean":"2024-09-21T22:16:28.941198+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:16:28.941198+0000","last_undegraded":"2024-09-21T22:16:28.941198+0000","last_fullsized":"2024-09-21T22:16:28.941198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:30:58.509418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000652708,"stat_sum":{"num_bytes":23345351,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2074,"num_read_kb":17484,"num_write":271,"num_write_kb":11213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T22:16:29.948800+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:16:29.948800+0000","last_peered":"2024-09-21T22:16:29.948800+0000","last_clean":"2024-09-21T22:16:29.948800+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:16:29.948800+0000","last_undegraded":"2024-09-21T22:16:29.948800+0000","last_fullsized":"2024-09-21T22:16:29.948800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"71'138","reported_seq":900,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.570456+0000","last_change":"2024-09-21T22:16:27.931173+0000","last_active":"2024-09-21T22:16:28.570456+0000","last_peered":"2024-09-21T22:16:28.570456+0000","last_clean":"2024-09-21T22:16:28.570456+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:16:28.570456+0000","last_undegraded":"2024-09-21T22:16:28.570456+0000","last_fullsized":"2024-09-21T22:16:28.570456+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:03:34.029773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012164109999999999,"stat_sum":{"num_bytes":8768499,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":9759,"num_write":195,"num_write_kb":7533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.935621+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:16:28.935621+0000","last_peered":"2024-09-21T22:16:28.935621+0000","last_clean":"2024-09-21T22:16:28.935621+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:16:28.935621+0000","last_undegraded":"2024-09-21T22:16:28.935621+0000","last_fullsized":"2024-09-21T22:16:28.935621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"73'162","reported_seq":1515,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T22:16:29.979967+0000","last_change":"2024-09-21T22:16:28.006278+0000","last_active":"2024-09-21T22:16:29.979967+0000","last_peered":"2024-09-21T22:16:29.979967+0000","last_clean":"2024-09-21T22:16:29.979967+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:16:29.979967+0000","last_undegraded":"2024-09-21T22:16:29.979967+0000","last_fullsized":"2024-09-21T22:16:29.979967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:27:40.623465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013723400000000001,"stat_sum":{"num_bytes":26463564,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1156,"num_read_kb":16702,"num_write":186,"num_write_kb":11379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T22:16:29.948091+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:16:29.948091+0000","last_peered":"2024-09-21T22:16:29.948091+0000","last_clean":"2024-09-21T22:16:29.948091+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:16:29.948091+0000","last_undegraded":"2024-09-21T22:16:29.948091+0000","last_fullsized":"2024-09-21T22:16:29.948091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"71'120","reported_seq":1346,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.959208+0000","last_change":"2024-09-21T22:16:27.927416+0000","last_active":"2024-09-21T22:16:28.959208+0000","last_peered":"2024-09-21T22:16:28.959208+0000","last_clean":"2024-09-21T22:16:28.959208+0000","last_became_active":"2024-09-21T22:16:00.921655+0000","last_became_peered":"2024-09-21T22:16:00.921655+0000","last_unstale":"2024-09-21T22:16:28.959208+0000","last_undegraded":"2024-09-21T22:16:28.959208+0000","last_fullsized":"2024-09-21T22:16:28.959208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:39:44.387676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054681100000000002,"stat_sum":{"num_bytes":16608767,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1004,"num_read_kb":15979,"num_write":222,"num_write_kb":8253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.3","version":"71'119","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.939653+0000","last_change":"2024-09-21T22:16:27.933092+0000","last_active":"2024-09-21T22:16:28.939653+0000","last_peered":"2024-09-21T22:16:28.939653+0000","last_clean":"2024-09-21T22:16:28.939653+0000","last_became_active":"2024-09-21T22:15:36.447748+0000","last_became_peered":"2024-09-21T22:15:36.447748+0000","last_unstale":"2024-09-21T22:16:28.939653+0000","last_undegraded":"2024-09-21T22:16:28.939653+0000","last_fullsized":"2024-09-21T22:16:28.939653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:38.960401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033062199999999998,"stat_sum":{"num_bytes":7154612,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":404,"num_read_kb":9273,"num_write":154,"num_write_kb":8586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":122,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.959012+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:16:28.959012+0000","last_peered":"2024-09-21T22:16:28.959012+0000","last_clean":"2024-09-21T22:16:28.959012+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:16:28.959012+0000","last_undegraded":"2024-09-21T22:16:28.959012+0000","last_fullsized":"2024-09-21T22:16:28.959012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"71'362","reported_seq":1301,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T22:16:29.978430+0000","last_change":"2024-09-21T22:16:28.007044+0000","last_active":"2024-09-21T22:16:29.978430+0000","last_peered":"2024-09-21T22:16:29.978430+0000","last_clean":"2024-09-21T22:16:29.978430+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:16:29.978430+0000","last_undegraded":"2024-09-21T22:16:29.978430+0000","last_fullsized":"2024-09-21T22:16:29.978430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:09.870204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018390500000000001,"stat_sum":{"num_bytes":15398461,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1736,"num_read_kb":17230,"num_write":522,"num_write_kb":12869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T22:16:29.943602+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:16:29.943602+0000","last_peered":"2024-09-21T22:16:29.943602+0000","last_clean":"2024-09-21T22:16:29.943602+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:16:29.943602+0000","last_undegraded":"2024-09-21T22:16:29.943602+0000","last_fullsized":"2024-09-21T22:16:29.943602+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"72'139","reported_seq":859,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.942374+0000","last_change":"2024-09-21T22:16:27.983972+0000","last_active":"2024-09-21T22:16:28.942374+0000","last_peered":"2024-09-21T22:16:28.942374+0000","last_clean":"2024-09-21T22:16:28.942374+0000","last_became_active":"2024-09-21T22:15:36.451816+0000","last_became_peered":"2024-09-21T22:15:36.451816+0000","last_unstale":"2024-09-21T22:16:28.942374+0000","last_undegraded":"2024-09-21T22:16:28.942374+0000","last_fullsized":"2024-09-21T22:16:28.942374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:34:50.742224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048987499999999997,"stat_sum":{"num_bytes":6908940,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":6781,"num_write":193,"num_write_kb":8343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.935324+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:16:28.935324+0000","last_peered":"2024-09-21T22:16:28.935324+0000","last_clean":"2024-09-21T22:16:28.935324+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:16:28.935324+0000","last_undegraded":"2024-09-21T22:16:28.935324+0000","last_fullsized":"2024-09-21T22:16:28.935324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"71'137","reported_seq":357,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.319660+0000","last_change":"2024-09-21T22:16:27.930303+0000","last_active":"2024-09-21T22:16:28.319660+0000","last_peered":"2024-09-21T22:16:28.319660+0000","last_clean":"2024-09-21T22:16:28.319660+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:16:28.319660+0000","last_undegraded":"2024-09-21T22:16:28.319660+0000","last_fullsized":"2024-09-21T22:16:28.319660+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:14:11.904356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":10478373,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":224,"num_read_kb":5778,"num_write":195,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":121,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.959011+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:16:28.959011+0000","last_peered":"2024-09-21T22:16:28.959011+0000","last_clean":"2024-09-21T22:16:28.959011+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:16:28.959011+0000","last_undegraded":"2024-09-21T22:16:28.959011+0000","last_fullsized":"2024-09-21T22:16:28.959011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":271,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.935336+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:16:28.935336+0000","last_peered":"2024-09-21T22:16:28.935336+0000","last_clean":"2024-09-21T22:16:28.935336+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:16:28.935336+0000","last_undegraded":"2024-09-21T22:16:28.935336+0000","last_fullsized":"2024-09-21T22:16:28.935336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"71'196","reported_seq":629,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.470593+0000","last_change":"2024-09-21T22:16:27.931024+0000","last_active":"2024-09-21T22:16:28.470593+0000","last_peered":"2024-09-21T22:16:28.470593+0000","last_clean":"2024-09-21T22:16:28.470593+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:16:28.470593+0000","last_undegraded":"2024-09-21T22:16:28.470593+0000","last_fullsized":"2024-09-21T22:16:28.470593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:18:37.185459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010910819999999999,"stat_sum":{"num_bytes":7823448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":5333,"num_write":293,"num_write_kb":8787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.9","version":"71'138","reported_seq":934,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.939554+0000","last_change":"2024-09-21T22:16:27.932862+0000","last_active":"2024-09-21T22:16:28.939554+0000","last_peered":"2024-09-21T22:16:28.939554+0000","last_clean":"2024-09-21T22:16:28.939554+0000","last_became_active":"2024-09-21T22:15:36.554061+0000","last_became_peered":"2024-09-21T22:15:36.554061+0000","last_unstale":"2024-09-21T22:16:28.939554+0000","last_undegraded":"2024-09-21T22:16:28.939554+0000","last_fullsized":"2024-09-21T22:16:28.939554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:52:18.630699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034179099999999998,"stat_sum":{"num_bytes":10225787,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1140,"num_read_kb":9428,"num_write":222,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.a","version":"72'159","reported_seq":1008,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.970622+0000","last_change":"2024-09-21T22:16:27.931701+0000","last_active":"2024-09-21T22:16:28.970622+0000","last_peered":"2024-09-21T22:16:28.970622+0000","last_clean":"2024-09-21T22:16:28.970622+0000","last_became_active":"2024-09-21T22:15:36.449394+0000","last_became_peered":"2024-09-21T22:15:36.449394+0000","last_unstale":"2024-09-21T22:16:28.970622+0000","last_undegraded":"2024-09-21T22:16:28.970622+0000","last_fullsized":"2024-09-21T22:16:28.970622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:57:40.038992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001388551,"stat_sum":{"num_bytes":2457547,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":3367,"num_write":173,"num_write_kb":3344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.b","version":"71'592","reported_seq":1615,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.355267+0000","last_change":"2024-09-21T22:16:27.930545+0000","last_active":"2024-09-21T22:16:28.355267+0000","last_peered":"2024-09-21T22:16:28.355267+0000","last_clean":"2024-09-21T22:16:28.355267+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:16:28.355267+0000","last_undegraded":"2024-09-21T22:16:28.355267+0000","last_fullsized":"2024-09-21T22:16:28.355267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:23:00.147412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077349299999999999,"stat_sum":{"num_bytes":9771287,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4035,"num_read_kb":8792,"num_write":840,"num_write_kb":7427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.c","version":"71'42","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.959123+0000","last_change":"2024-09-21T22:16:27.927396+0000","last_active":"2024-09-21T22:16:28.959123+0000","last_peered":"2024-09-21T22:16:28.959123+0000","last_clean":"2024-09-21T22:16:28.959123+0000","last_became_active":"2024-09-21T22:16:00.921657+0000","last_became_peered":"2024-09-21T22:16:00.921657+0000","last_unstale":"2024-09-21T22:16:28.959123+0000","last_undegraded":"2024-09-21T22:16:28.959123+0000","last_fullsized":"2024-09-21T22:16:28.959123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:00.563879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615696,"stat_sum":{"num_bytes":4904768,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":4834,"num_write":32,"num_write_kb":2574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.d","version":"71'212","reported_seq":652,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.935564+0000","last_change":"2024-09-21T22:16:27.936542+0000","last_active":"2024-09-21T22:16:28.935564+0000","last_peered":"2024-09-21T22:16:28.935564+0000","last_clean":"2024-09-21T22:16:28.935564+0000","last_became_active":"2024-09-21T22:15:36.450576+0000","last_became_peered":"2024-09-21T22:15:36.450576+0000","last_unstale":"2024-09-21T22:16:28.935564+0000","last_undegraded":"2024-09-21T22:16:28.935564+0000","last_fullsized":"2024-09-21T22:16:28.935564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:14:28.156503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067558500000000003,"stat_sum":{"num_bytes":6651980,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":744,"num_read_kb":8448,"num_write":323,"num_write_kb":8136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.e","version":"71'70","reported_seq":391,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.935487+0000","last_change":"2024-09-21T22:16:27.936067+0000","last_active":"2024-09-21T22:16:28.935487+0000","last_peered":"2024-09-21T22:16:28.935487+0000","last_clean":"2024-09-21T22:16:28.935487+0000","last_became_active":"2024-09-21T22:15:36.452314+0000","last_became_peered":"2024-09-21T22:15:36.452314+0000","last_unstale":"2024-09-21T22:16:28.935487+0000","last_undegraded":"2024-09-21T22:16:28.935487+0000","last_fullsized":"2024-09-21T22:16:28.935487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:24:23.425967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041231800000000001,"stat_sum":{"num_bytes":2129882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":3179,"num_write":136,"num_write_kb":4769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.f","version":"72'187","reported_seq":703,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.980769+0000","last_change":"2024-09-21T22:16:27.936292+0000","last_active":"2024-09-21T22:16:28.980769+0000","last_peered":"2024-09-21T22:16:28.980769+0000","last_clean":"2024-09-21T22:16:28.980769+0000","last_became_active":"2024-09-21T22:15:36.452701+0000","last_became_peered":"2024-09-21T22:15:36.452701+0000","last_unstale":"2024-09-21T22:16:28.980769+0000","last_undegraded":"2024-09-21T22:16:28.980769+0000","last_fullsized":"2024-09-21T22:16:28.980769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:50:59.087597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054548800000000001,"stat_sum":{"num_bytes":11207263,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":482,"num_read_kb":8538,"num_write":285,"num_write_kb":10246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.10","version":"71'117","reported_seq":1090,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.937412+0000","last_change":"2024-09-21T22:16:27.930704+0000","last_active":"2024-09-21T22:16:28.937412+0000","last_peered":"2024-09-21T22:16:28.937412+0000","last_clean":"2024-09-21T22:16:28.937412+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:16:28.937412+0000","last_undegraded":"2024-09-21T22:16:28.937412+0000","last_fullsized":"2024-09-21T22:16:28.937412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:08:09.287316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040406200000000001,"stat_sum":{"num_bytes":18286040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":781,"num_read_kb":11150,"num_write":134,"num_write_kb":4485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.11","version":"71'81","reported_seq":715,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.935570+0000","last_change":"2024-09-21T22:16:27.935998+0000","last_active":"2024-09-21T22:16:28.935570+0000","last_peered":"2024-09-21T22:16:28.935570+0000","last_clean":"2024-09-21T22:16:28.935570+0000","last_became_active":"2024-09-21T22:15:36.451421+0000","last_became_peered":"2024-09-21T22:15:36.451421+0000","last_unstale":"2024-09-21T22:16:28.935570+0000","last_undegraded":"2024-09-21T22:16:28.935570+0000","last_fullsized":"2024-09-21T22:16:28.935570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:17:05.738339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038837799999999999,"stat_sum":{"num_bytes":9413689,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":9918,"num_write":87,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.12","version":"71'240","reported_seq":920,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.941060+0000","last_change":"2024-09-21T22:16:27.984003+0000","last_active":"2024-09-21T22:16:28.941060+0000","last_peered":"2024-09-21T22:16:28.941060+0000","last_clean":"2024-09-21T22:16:28.941060+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:16:28.941060+0000","last_undegraded":"2024-09-21T22:16:28.941060+0000","last_fullsized":"2024-09-21T22:16:28.941060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:21.466762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054642999999999998,"stat_sum":{"num_bytes":5102019,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1305,"num_read_kb":4328,"num_write":354,"num_write_kb":8912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.13","version":"71'421","reported_seq":1450,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T22:16:28.935457+0000","last_change":"2024-09-21T22:16:27.936234+0000","last_active":"2024-09-21T22:16:28.935457+0000","last_peered":"2024-09-21T22:16:28.935457+0000","last_clean":"2024-09-21T22:16:28.935457+0000","last_became_active":"2024-09-21T22:15:36.450372+0000","last_became_peered":"2024-09-21T22:15:36.450372+0000","last_unstale":"2024-09-21T22:16:28.935457+0000","last_undegraded":"2024-09-21T22:16:28.935457+0000","last_fullsized":"2024-09-21T22:16:28.935457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:45:46.798712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057515599999999995,"stat_sum":{"num_bytes":17502878,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2422,"num_read_kb":19760,"num_write":624,"num_write_kb":7206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":457406233,"num_objects":341,"num_object_clones":0,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":42755,"num_read_kb":343111,"num_write":10799,"num_write_kb":280899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":19911710,"num_keys_recovered":32,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":158797824,"data_stored":157373687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7289,"ondisk_log_size":7289,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59852,"kb_used_data":24504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311988,"statfs":{"total":96636764160,"available":96575475712,"internally_reserved":0,"allocated":25092096,"data_stored":24442633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34456,"kb_used_data":3260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337384,"statfs":{"total":96636764160,"available":96601481216,"internally_reserved":0,"allocated":3338240,"data_stored":2826391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53952,"kb_used_data":18604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94317888,"statfs":{"total":96636764160,"available":96581517312,"internally_reserved":0,"allocated":19050496,"data_stored":18402162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66780,"kb_used_data":31424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94305060,"statfs":{"total":96636764160,"available":96568381440,"internally_reserved":0,"allocated":32178176,"data_stored":31480417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528327,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57784,"kb_used_data":21352,"kb_used_omap":4,"kb_used_meta":36411,"kb_avail":94314056,"statfs":{"total":96636764160,"available":96577593344,"internally_reserved":0,"allocated":21864448,"data_stored":21147135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":37285554},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45196,"kb_used_data":14008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326644,"statfs":{"total":96636764160,"available":96590483456,"internally_reserved":0,"allocated":14344192,"data_stored":13803071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54232,"kb_used_data":23040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94317608,"statfs":{"total":96636764160,"available":96581230592,"internally_reserved":0,"allocated":23592960,"data_stored":22983865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63708,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94308132,"statfs":{"total":96636764160,"available":96571527168,"internally_reserved":0,"allocated":24780800,"data_stored":24150575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23392256,"data_stored":23205638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23945216,"data_stored":23776236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14684160,"data_stored":14581772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21032960,"data_stored":20764652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31338496,"data_stored":31091750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":18052333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2498560,"data_stored":2437724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23463582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:16:31.687 INFO:tasks.thrashosds.thrasher:Setting 3.d to [6, 0] 2024-09-21T22:16:31.687 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.d', '6', '0'] 2024-09-21T22:16:31.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.d 6 0 2024-09-21T22:16:31.696 INFO:teuthology.orchestra.run.smithi134.stdout:3086 read 0x36b59b3 thru 0x36ba52d (0x4b7b bytes) 2024-09-21T22:16:31.696 INFO:teuthology.orchestra.run.smithi134.stdout:3087 read 0x1450088 thru 0x145b2ed (0xb266 bytes) 2024-09-21T22:16:31.698 INFO:teuthology.orchestra.run.smithi134.stdout:3088 write 0x2e43bde thru 0x2e43c47 (0x6a bytes) 2024-09-21T22:16:31.705 INFO:teuthology.orchestra.run.smithi134.stdout:3089 trunc from 0xe861d95 to 0x8f0178c 2024-09-21T22:16:31.726 INFO:teuthology.orchestra.run.smithi134.stdout:3090 write 0xbd32e4d thru 0xbd3adde (0x7f92 bytes) 2024-09-21T22:16:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:3091 write 0x585f48b thru 0x586644b (0x6fc1 bytes) 2024-09-21T22:16:31.733 INFO:teuthology.orchestra.run.smithi134.stdout:3093 read 0x778dce4 thru 0x779d2fe (0xf61b bytes) 2024-09-21T22:16:31.736 INFO:teuthology.orchestra.run.smithi134.stdout:3094 trunc from 0xbd3addf to 0x9ddc37d 2024-09-21T22:16:31.743 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:31.742+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:31.743 INFO:teuthology.orchestra.run.smithi134.stdout:3095 write 0x655269c thru 0x6557208 (0x4b6d bytes) 2024-09-21T22:16:31.744 INFO:teuthology.orchestra.run.smithi134.stdout:3097 punch from 0x143b45b to 0x143c7ce, (0x1373 bytes) 2024-09-21T22:16:31.744 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:31.745 INFO:teuthology.orchestra.run.smithi134.stdout:3100 clone 14 order 19 su 2048 sc 14 2024-09-21T22:16:31.764 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:31.764 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:31.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:31.843 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:31.842+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:31.877 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:31.877 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:16:31.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:31.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:31.943+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:32.031 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:32.031 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:32.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:32.085 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:32.083+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:32.144 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:32.145 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:32.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:32.145+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:32.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:32.247 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:32.246+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:32.299 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:32.299 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:32.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:32.354 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:32.352+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:32.413 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:32.413 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:32.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:32.463 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:32.461+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:32.527 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:32.527 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:32.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:32.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:32.579+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:32.639 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:32.639 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:32.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:32.650 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:32.649+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:32.751 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:32.750+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:32.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:32.791 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:32.792 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:32.801 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:32.883 INFO:teuthology.orchestra.run.smithi134.stderr:set 3.d pg_upmap mapping to [6,0] 2024-09-21T22:16:32.884 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:32.883+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:32.925 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:32.925 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:32.952 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:32.951+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:32.958 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:32.984 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:32.984 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:32.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:33.010 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:33.011 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:33.034 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:33.034 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:33.054 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:33.052+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:33.056 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:33.056 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:33.083 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:33.083 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:33.106 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:33.106 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:33.147 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:33.147 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:33.153 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:33.152+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:33.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:33.255 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:33.253+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:33.337 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12194 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1327104~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387735454000001, 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024432683, 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12194 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947443+0000", 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.102e-06 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947446+0000", 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0359999999999998e-06 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947449+0000", 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.357e-06 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971629+0000", 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024180103000000001 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971669+0000", 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0457999999999998e-05 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971875+0000", 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020541299999999999 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.342 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12195 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1409024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387722970999999, 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024694972999999999, 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12195 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947454+0000", 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947455+0000", 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.16e-07 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947456+0000", 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1650000000000001e-06 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947460+0000", 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1250000000000003e-06 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947464+0000", 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971900+0000", 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024436198999999999 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.971941+0000", 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0914999999999997e-05 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972149+0000", 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000208581 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12196 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1490944~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387708059000001, 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024916424999999999, 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12196 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947469+0000", 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947470+0000", 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947472+0000", 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.894e-06 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947479+0000", 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.182e-06 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4669999999999998e-06 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972175+0000", 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024691870000000001 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972216+0000", 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0747000000000001e-05 2024-09-21T22:16:33.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972386+0000", 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169875 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12219 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 835584~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387660804999999, 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025132278000000001, 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12219 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947517+0000", 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947525+0000", 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2549999999999997e-06 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947535+0000", 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5400000000000001e-06 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947547+0000", 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1721e-05 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972410+0000", 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024863703000000001 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972450+0000", 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9440999999999997e-05 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972649+0000", 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000199044 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12220 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 917504~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387597544999998, 2024-09-21T22:16:33.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025318852999999999, 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12220 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0447e-05 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947600+0000", 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3649999999999993e-06 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8660000000000002e-06 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972675+0000", 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025069168999999999 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972719+0000", 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3757999999999997e-05 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972899+0000", 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017969899999999999 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12221 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 999424~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387561473000002, 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025531113000000001, 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12221 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947619+0000", 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947629+0000", 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0325e-05 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947634+0000", 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1760000000000001e-06 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972923+0000", 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025289282999999999 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.972964+0000", 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0225000000000002e-05 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973147+0000", 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183365 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12222 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1048576~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387536206, 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02581663, 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12222 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947641+0000", 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947642+0000", 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947649+0000", 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999999e-06 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947659+0000", 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0023e-05 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947664+0000", 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2399999999999998e-06 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973181+0000", 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025516975000000001 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973232+0000", 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1538e-05 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973458+0000", 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225405 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12223 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1130496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.368 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387506229, 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026051338, 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12223 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:33.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947671+0000", 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947672+0000", 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947674+0000", 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1880000000000001e-06 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947680+0000", 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2149999999999998e-06 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947689+0000", 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6889999999999993e-06 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973492+0000", 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025803362 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973543+0000", 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378000000000002e-05 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973723+0000", 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017904499999999999 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12224 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1212416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387480808999999, 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026304080000000001, 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12224 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.373 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947697+0000", 2024-09-21T22:16:33.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6899999999999998e-07 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947699+0000", 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947710+0000", 2024-09-21T22:16:33.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5210000000000004e-06 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973748+0000", 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026037801999999999 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.973795+0000", 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6866999999999997e-05 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974001+0000", 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020599600000000001 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12225 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1294336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387461067, 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026580894000000001, 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12225 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947716+0000", 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947717+0000", 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947719+0000", 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.885e-06 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947724+0000", 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7180000000000001e-06 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947729+0000", 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974025+0000", 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026295888999999999 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974066+0000", 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1458999999999997e-05 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974297+0000", 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023100900000000001 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.381 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12226 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1343488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387442955000001, 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026843615000000001, 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12226 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947734+0000", 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947735+0000", 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947737+0000", 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.812e-06 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947744+0000", 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9500000000000004e-06 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947748+0000", 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:16:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974323+0000", 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026574644000000001 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974385+0000", 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2318999999999997e-05 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974578+0000", 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192864 2024-09-21T22:16:33.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12227 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1425408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.38742311, 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027110875999999999, 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12227 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947754+0000", 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947755+0000", 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947757+0000", 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0099999999999998e-06 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947766+0000", 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4089999999999992e-06 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947792+0000", 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6367999999999999e-05 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974604+0000", 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026811181 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974646+0000", 2024-09-21T22:16:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2694000000000002e-05 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974865+0000", 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021881900000000001 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12228 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 1507328~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.387378825999999, 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027303377, 2024-09-21T22:16:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12228 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947799+0000", 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7700000000000001e-07 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947800+0000", 2024-09-21T22:16:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6220000000000001e-06 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947813+0000", 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2833999999999999e-05 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.947816+0000", 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1030000000000002e-06 2024-09-21T22:16:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974890+0000", 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027073904999999999 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.974931+0000", 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0194000000000002e-05 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975102+0000", 2024-09-21T22:16:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171442 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12229 3.1f 3:f99fee0f:::rbd_object_map.1185fc79843.000000000000000e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.384063790999999, 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026242102, 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12229 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951114+0000", 2024-09-21T22:16:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951121+0000", 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0559999999999999e-06 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951129+0000", 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951137+0000", 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4600000000000003e-06 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.951143+0000", 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9989999999999997e-06 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975127+0000", 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023983563999999999 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975176+0000", 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9753000000000003e-05 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.975510+0000", 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033344700000000001 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977251+0000", 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017413859999999999 2024-09-21T22:16:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977283+0000", 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2261000000000002e-05 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977317+0000", 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3463999999999997e-05 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.977356+0000", 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8859000000000002e-05 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12465 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.337556081999999, 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024627518000000001, 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12465 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997621+0000", 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997622+0000", 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5600000000000002e-07 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997624+0000", 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:16:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997630+0000", 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.392e-06 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997634+0000", 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3810000000000001e-06 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021905+0000", 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024270242000000001 2024-09-21T22:16:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.021988+0000", 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3836000000000002e-05 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022249+0000", 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026042300000000002 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12466 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2785280~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.337538260999999, 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025061416, 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12466 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997639+0000", 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.53e-07 2024-09-21T22:16:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997641+0000", 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6700000000000001e-06 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997647+0000", 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.942e-06 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997652+0000", 2024-09-21T22:16:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7639999999999996e-06 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022294+0000", 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024641880000000001 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022385+0000", 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1324999999999997e-05 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022701+0000", 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031558200000000002 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12467 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2867200~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.337517627, 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02537503, 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12467 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997660+0000", 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-07 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997662+0000", 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9039999999999999e-06 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997668+0000", 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997673+0000", 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022728+0000", 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025054937999999999 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.022814+0000", 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6520000000000005e-05 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023035+0000", 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022056699999999999 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12476 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.337260947000001, 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025528713000000001, 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12476 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997916+0000", 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997917+0000", 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9199999999999999e-07 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997922+0000", 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6589999999999998e-06 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997934+0000", 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.224e-05 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997941+0000", 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8669999999999996e-06 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023079+0000", 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025137836 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023169+0000", 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0457999999999993e-05 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023445+0000", 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027576100000000002 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12477 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2719744~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.337213958, 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025850773000000001, 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12477 2024-09-21T22:16:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997963+0000", 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997964+0000", 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2099999999999996e-07 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997967+0000", 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1089999999999998e-06 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997976+0000", 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.524e-06 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997979+0000", 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7589999999999999e-06 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023470+0000", 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025490777999999999 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023552+0000", 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1893999999999999e-05 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023814+0000", 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262088 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:12478 3.1f 3:f8340bf7:::rbd_data.11854f79dd7.0000000000000002:d [read 2801664~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.337190657000001, 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026321787999999999, 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 12478 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997987+0000", 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8799999999999998e-07 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997992+0000", 2024-09-21T22:16:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.045e-06 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997996+0000", 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3939999999999998e-06 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.997999+0000", 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.937e-06 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023857+0000", 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025858069000000001 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.023951+0000", 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3226999999999994e-05 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.024309+0000", 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035782799999999998 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.428 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:33.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:33.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:33.428+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:33.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:33.529+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48486 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601236+0000", 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010638180000000001, 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010657880999999999, 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48486 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601236+0000", 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601236+0000", 2024-09-21T22:16:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601236+0000", 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601237+0000", 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1739999999999999e-06 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601241+0000", 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2359999999999998e-06 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601245+0000", 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2989999999999998e-06 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48518 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603264+0000", 2024-09-21T22:16:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0086095100000000008, 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086685709999999999, 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48518 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603264+0000", 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603264+0000", 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603265+0000", 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603267+0000", 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9259999999999999e-06 2024-09-21T22:16:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603272+0000", 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7660000000000004e-06 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603276+0000", 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0890000000000002e-06 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48550 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604132+0000", 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077417700000000002, 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078293319999999996, 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48550 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604132+0000", 2024-09-21T22:16:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604132+0000", 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604132+0000", 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1099999999999996e-07 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604137+0000", 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604143+0000", 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9220000000000002e-06 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604148+0000", 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48583 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604872+0000", 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0070021149999999997, 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071169120000000004, 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48583 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604872+0000", 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604872+0000", 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604872+0000", 2024-09-21T22:16:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3499999999999996e-07 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604874+0000", 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604880+0000", 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3709999999999999e-06 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604884+0000", 2024-09-21T22:16:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5499999999999996e-06 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48615 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605652+0000", 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062216709999999998, 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00636281, 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48615 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605652+0000", 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605652+0000", 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605652+0000", 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-07 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605654+0000", 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605660+0000", 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605665+0000", 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0000000000000004e-06 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48647 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606151+0000", 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057224909999999997, 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058917919999999999, 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48647 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606151+0000", 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606151+0000", 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606152+0000", 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606154+0000", 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-06 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606159+0000", 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2939999999999996e-06 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606163+0000", 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3649999999999997e-06 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48755 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606663+0000", 2024-09-21T22:16:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052112390000000003, 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054064869999999998, 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48755 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606663+0000", 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606663+0000", 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606663+0000", 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.23e-07 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606664+0000", 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606667+0000", 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.959e-06 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606669+0000", 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4169999999999999e-06 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48787 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610926+0000", 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00094816300000000002, 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001170241, 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48787 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610926+0000", 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610926+0000", 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610926+0000", 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1699999999999999e-07 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610928+0000", 2024-09-21T22:16:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7990000000000001e-06 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610934+0000", 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.857e-06 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610938+0000", 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5709999999999999e-06 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48487 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601261+0000", 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010612982999999999, 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01086141, 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48487 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601261+0000", 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601261+0000", 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601261+0000", 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6899999999999998e-07 2024-09-21T22:16:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601263+0000", 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601269+0000", 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4580000000000001e-06 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601274+0000", 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:16:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48519 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603282+0000", 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0085917770000000001, 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088684309999999995, 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48519 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603282+0000", 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603282+0000", 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603282+0000", 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-07 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603284+0000", 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.922e-06 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603290+0000", 2024-09-21T22:16:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5779999999999998e-06 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603295+0000", 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0329999999999999e-06 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48551 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604154+0000", 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077198739999999998, 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080228299999999999, 2024-09-21T22:16:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48551 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604154+0000", 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604154+0000", 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604154+0000", 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604156+0000", 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.683e-06 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604162+0000", 2024-09-21T22:16:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:16:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604166+0000", 2024-09-21T22:16:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7480000000000001e-06 2024-09-21T22:16:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48584 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604894+0000", 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0069793149999999998, 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073083100000000002, 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48584 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604894+0000", 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604894+0000", 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604895+0000", 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5400000000000001e-07 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604897+0000", 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0080000000000001e-06 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604903+0000", 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7599999999999999e-06 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604908+0000", 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48616 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605672+0000", 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062021530000000002, 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065572260000000002, 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48616 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605672+0000", 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605672+0000", 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605672+0000", 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.03e-07 2024-09-21T22:16:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605674+0000", 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605679+0000", 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7660000000000004e-06 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605684+0000", 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6580000000000001e-06 2024-09-21T22:16:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48648 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606168+0000", 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057055409999999997, 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060933380000000002, 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48648 2024-09-21T22:16:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606168+0000", 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606168+0000", 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606169+0000", 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606170+0000", 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8780000000000001e-06 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606176+0000", 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606181+0000", 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8740000000000003e-06 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48756 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606672+0000", 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052018259999999997, 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056188380000000001, 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48756 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606672+0000", 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606672+0000", 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606672+0000", 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606673+0000", 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.108e-06 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606676+0000", 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9160000000000001e-06 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606679+0000", 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48788 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610944+0000", 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000930155, 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013736009999999999, 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48788 2024-09-21T22:16:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610944+0000", 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610944+0000", 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610944+0000", 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.77e-07 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610946+0000", 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6509999999999999e-06 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610952+0000", 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7610000000000002e-06 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610959+0000", 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.28e-06 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48488 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601300+0000", 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010574202, 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011043884, 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48488 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601300+0000", 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601300+0000", 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601300+0000", 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6899999999999999e-07 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601302+0000", 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.751e-06 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601305+0000", 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.506e-06 2024-09-21T22:16:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601308+0000", 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7e-06 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48520 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603308+0000", 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0085661299999999999, 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090650629999999999, 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48520 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603308+0000", 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603308+0000", 2024-09-21T22:16:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603308+0000", 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6899999999999997e-07 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603310+0000", 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1390000000000002e-06 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603316+0000", 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2939999999999996e-06 2024-09-21T22:16:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603320+0000", 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48552 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604180+0000", 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.007694055, 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082189570000000007, 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48552 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604180+0000", 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604180+0000", 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604180+0000", 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604182+0000", 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9630000000000001e-06 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604188+0000", 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000001e-06 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604193+0000", 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6140000000000002e-06 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48585 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604914+0000", 2024-09-21T22:16:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0069601029999999996, 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075108759999999997, 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48585 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604914+0000", 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604914+0000", 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604914+0000", 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.65e-07 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604916+0000", 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.863e-06 2024-09-21T22:16:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604922+0000", 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1709999999999999e-06 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604926+0000", 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2130000000000002e-06 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48617 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605689+0000", 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0061843319999999999, 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067612699999999998, 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48617 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605689+0000", 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605689+0000", 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605690+0000", 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.53e-07 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605692+0000", 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9e-06 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605697+0000", 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605702+0000", 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6190000000000002e-06 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48649 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606186+0000", 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056877339999999998, 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062907070000000004, 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48649 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606186+0000", 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606186+0000", 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606186+0000", 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606188+0000", 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606194+0000", 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4349999999999996e-06 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606198+0000", 2024-09-21T22:16:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4460000000000003e-06 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48757 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606682+0000", 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051922119999999999, 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058210309999999999, 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48757 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606682+0000", 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606682+0000", 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606682+0000", 2024-09-21T22:16:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606683+0000", 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0699999999999999e-06 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606686+0000", 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8710000000000001e-06 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606688+0000", 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.334e-06 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48789 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610965+0000", 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00090924899999999999, 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001563938, 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48789 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610965+0000", 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610965+0000", 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610965+0000", 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610967+0000", 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.103e-06 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610974+0000", 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0129999999999996e-06 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610979+0000", 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48489 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601312+0000", 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010562037999999999, 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011243438, 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48489 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601312+0000", 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601312+0000", 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601312+0000", 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601314+0000", 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601319+0000", 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3909999999999997e-06 2024-09-21T22:16:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601322+0000", 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9629999999999998e-06 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48521 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603330+0000", 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0085441300000000005, 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092600789999999992, 2024-09-21T22:16:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48521 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603330+0000", 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603330+0000", 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603330+0000", 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603332+0000", 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1409999999999999e-06 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603338+0000", 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.648e-06 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603343+0000", 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8180000000000003e-06 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48553 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604198+0000", 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076757980000000002, 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084192840000000008, 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48553 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604198+0000", 2024-09-21T22:16:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604198+0000", 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604198+0000", 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604200+0000", 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1959999999999998e-06 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604206+0000", 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2820000000000004e-06 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604210+0000", 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2100000000000003e-06 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48586 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604959+0000", 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0069148760000000004, 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076845790000000004, 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48586 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604959+0000", 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604959+0000", 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604959+0000", 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604962+0000", 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604967+0000", 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604973+0000", 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7209999999999999e-06 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48618 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605707+0000", 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0061665599999999997, 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006962747, 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48618 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605707+0000", 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605707+0000", 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605708+0000", 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605713+0000", 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1490000000000002e-06 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605718+0000", 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7869999999999998e-06 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605723+0000", 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4780000000000002e-06 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48650 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606203+0000", 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056703190000000001, 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064925149999999999, 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48650 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606203+0000", 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606203+0000", 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606204+0000", 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606206+0000", 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606214+0000", 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5080000000000005e-06 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606219+0000", 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48758 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606691+0000", 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051829900000000002, 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060328070000000003, 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48758 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606691+0000", 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606691+0000", 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606691+0000", 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606692+0000", 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1179999999999999e-06 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606695+0000", 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8710000000000001e-06 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606697+0000", 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3369999999999998e-06 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48790 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610987+0000", 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00088638699999999998, 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001762113, 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48790 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610987+0000", 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610987+0000", 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610988+0000", 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610990+0000", 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389999999999999e-06 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610996+0000", 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1249999999999998e-06 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611001+0000", 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6110000000000004e-06 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48490 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601327+0000", 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010547045999999999, 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011457581, 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48490 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601327+0000", 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601327+0000", 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601327+0000", 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5200000000000002e-07 2024-09-21T22:16:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601329+0000", 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6980000000000001e-06 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601334+0000", 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5969999999999999e-06 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601339+0000", 2024-09-21T22:16:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4510000000000002e-06 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48522 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603348+0000", 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0085253169999999993, 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094627370000000006, 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48522 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603348+0000", 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603348+0000", 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603349+0000", 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.39e-07 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603351+0000", 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8649999999999999e-06 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603356+0000", 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6230000000000002e-06 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603360+0000", 2024-09-21T22:16:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2270000000000004e-06 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48554 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604235+0000", 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.007639018, 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086093569999999998, 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48554 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604235+0000", 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604235+0000", 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604235+0000", 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604237+0000", 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604242+0000", 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7199999999999997e-06 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604247+0000", 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4750000000000004e-06 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48587 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604979+0000", 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0068945370000000001, 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078918200000000008, 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48587 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604979+0000", 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604979+0000", 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604980+0000", 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.34e-07 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604984+0000", 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6110000000000004e-06 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604990+0000", 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7270000000000004e-06 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604995+0000", 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6190000000000002e-06 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48619 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605729+0000", 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0061444159999999998, 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071678380000000002, 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48619 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605729+0000", 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605729+0000", 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605730+0000", 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605732+0000", 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9350000000000001e-06 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605742+0000", 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0747000000000001e-05 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605747+0000", 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9910000000000002e-06 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48651 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606225+0000", 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056489909999999999, 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066986010000000002, 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48651 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606225+0000", 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606225+0000", 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606225+0000", 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606227+0000", 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606233+0000", 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606237+0000", 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.51e-06 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48759 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606700+0000", 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051737140000000003, 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00625138, 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48759 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606700+0000", 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606700+0000", 2024-09-21T22:16:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606700+0000", 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606701+0000", 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0079999999999999e-06 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606704+0000", 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8449999999999999e-06 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606706+0000", 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2539999999999999e-06 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48791 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.611007+0000", 2024-09-21T22:16:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00086697200000000003, 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019709530000000001, 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48791 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611007+0000", 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611007+0000", 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611007+0000", 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1699999999999999e-07 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611009+0000", 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.967e-06 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611015+0000", 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6960000000000002e-06 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611019+0000", 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2429999999999999e-06 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48491 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601345+0000", 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010528983, 2024-09-21T22:16:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011659981999999999, 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48491 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601345+0000", 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601345+0000", 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601345+0000", 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601349+0000", 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601355+0000", 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2920000000000003e-06 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601359+0000", 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48523 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603376+0000", 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0084980130000000004, 2024-09-21T22:16:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096552300000000008, 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48523 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603376+0000", 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603376+0000", 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603376+0000", 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.44e-07 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603378+0000", 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.818e-06 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603384+0000", 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4e-06 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603388+0000", 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.34e-06 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48555 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604266+0000", 2024-09-21T22:16:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076081320000000001, 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087967470000000006, 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48555 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604266+0000", 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604266+0000", 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604266+0000", 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2399999999999998e-07 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604268+0000", 2024-09-21T22:16:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.075e-06 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604274+0000", 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0100000000000001e-06 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604279+0000", 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3959999999999999e-06 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48588 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605001+0000", 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0068732230000000004, 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080883719999999999, 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48588 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605001+0000", 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605001+0000", 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605001+0000", 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9900000000000001e-07 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605003+0000", 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0059999999999999e-06 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605010+0000", 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5899999999999996e-06 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605015+0000", 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48620 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605754+0000", 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0061199009999999996, 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073612449999999998, 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48620 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605754+0000", 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605754+0000", 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605754+0000", 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605756+0000", 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1169999999999998e-06 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605762+0000", 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1489999999999999e-06 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605773+0000", 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0682e-05 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48652 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606243+0000", 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056305829999999998, 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006898146, 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48652 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606243+0000", 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606243+0000", 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606244+0000", 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606245+0000", 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8649999999999999e-06 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606251+0000", 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.728e-06 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606256+0000", 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.668e-06 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48760 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606710+0000", 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051641830000000001, 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064576770000000002, 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48760 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606710+0000", 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606710+0000", 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606710+0000", 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606711+0000", 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0699999999999999e-06 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606714+0000", 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9469999999999999e-06 2024-09-21T22:16:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606716+0000", 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3920000000000001e-06 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48792 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.611023+0000", 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00085033699999999995, 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021749009999999999, 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48792 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611023+0000", 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611023+0000", 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611024+0000", 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611025+0000", 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2780000000000001e-06 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611029+0000", 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2529999999999998e-06 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611032+0000", 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5289999999999998e-06 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48492 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601376+0000", 2024-09-21T22:16:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010497448, 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011848844000000001, 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48492 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601376+0000", 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601376+0000", 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601377+0000", 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4999999999999999e-07 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601378+0000", 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.782e-06 2024-09-21T22:16:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601382+0000", 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.579e-06 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601385+0000", 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5900000000000002e-06 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48524 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603394+0000", 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0084797339999999992, 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098594289999999994, 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48524 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603394+0000", 2024-09-21T22:16:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603394+0000", 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603394+0000", 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603397+0000", 2024-09-21T22:16:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1150000000000001e-06 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603402+0000", 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603407+0000", 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48556 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604285+0000", 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075892290000000003, 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089950870000000006, 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48556 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604285+0000", 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604285+0000", 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604285+0000", 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3500000000000002e-07 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604287+0000", 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0540000000000002e-06 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604293+0000", 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604299+0000", 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5380000000000002e-06 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48589 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605040+0000", 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0068337490000000001, 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082666779999999995, 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48589 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605040+0000", 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605040+0000", 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605041+0000", 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3399999999999999e-07 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605043+0000", 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.018e-06 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605048+0000", 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9100000000000002e-06 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605053+0000", 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7670000000000003e-06 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48621 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605778+0000", 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060957399999999997, 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075551209999999997, 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48621 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605778+0000", 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605778+0000", 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605778+0000", 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605780+0000", 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.39e-06 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605783+0000", 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3809999999999999e-06 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605786+0000", 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6960000000000001e-06 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48653 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606261+0000", 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056127260000000002, 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070984990000000003, 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48653 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606261+0000", 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606261+0000", 2024-09-21T22:16:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606261+0000", 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7500000000000001e-07 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606263+0000", 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7940000000000001e-06 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606268+0000", 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2449999999999998e-06 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606273+0000", 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4859999999999999e-06 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48761 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606719+0000", 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051548239999999997, 2024-09-21T22:16:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066669030000000001, 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48761 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606719+0000", 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606719+0000", 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606719+0000", 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606720+0000", 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2640000000000001e-06 2024-09-21T22:16:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606725+0000", 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0130000000000001e-06 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606729+0000", 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.676e-06 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48793 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.611035+0000", 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00083906900000000001, 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002377269, 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48793 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611035+0000", 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.611035+0000", 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612773+0000", 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001737843 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612776+0000", 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8870000000000002e-06 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612784+0000", 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0520000000000002e-06 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612792+0000", 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3989999999999998e-06 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48493 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601388+0000", 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010486168000000001, 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012050389999999999, 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48493 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601388+0000", 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601388+0000", 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601388+0000", 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601389+0000", 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.105e-06 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601393+0000", 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8480000000000003e-06 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601397+0000", 2024-09-21T22:16:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.403e-06 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48525 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603420+0000", 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0084534599999999994, 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010048768, 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48525 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603420+0000", 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603420+0000", 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603421+0000", 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9800000000000004e-07 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603423+0000", 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.103e-06 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603429+0000", 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6609999999999997e-06 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603433+0000", 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3930000000000001e-06 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48557 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604312+0000", 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075617510000000002, 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091837310000000005, 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48557 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604312+0000", 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604312+0000", 2024-09-21T22:16:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604313+0000", 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604315+0000", 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604321+0000", 2024-09-21T22:16:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0249999999999999e-06 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604325+0000", 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48590 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605071+0000", 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0068031690000000004, 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084513290000000005, 2024-09-21T22:16:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48590 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605071+0000", 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605071+0000", 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605071+0000", 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605073+0000", 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605079+0000", 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9379999999999997e-06 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605084+0000", 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.865e-06 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48622 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605789+0000", 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060850349999999999, 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077593039999999999, 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48622 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605789+0000", 2024-09-21T22:16:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605789+0000", 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605789+0000", 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605790+0000", 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.158e-06 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605793+0000", 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.852e-06 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605795+0000", 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5229999999999998e-06 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48654 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606278+0000", 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055957450000000001, 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007296093, 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48654 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606278+0000", 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606278+0000", 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606278+0000", 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606283+0000", 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606289+0000", 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7570000000000001e-06 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606295+0000", 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8420000000000001e-06 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48762 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606742+0000", 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051320949999999997, 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068585110000000003, 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48762 2024-09-21T22:16:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606742+0000", 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606742+0000", 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606742+0000", 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-07 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606744+0000", 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.041e-06 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606750+0000", 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5659999999999997e-06 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606754+0000", 2024-09-21T22:16:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.622e-06 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48794 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612803+0000", 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9990711, 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082452800000000004, 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48794 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612803+0000", 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612803+0000", 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612803+0000", 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612805+0000", 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.108e-06 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612821+0000", 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5209e-05 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612826+0000", 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48494 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601402+0000", 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01047171, 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012251576, 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48494 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601402+0000", 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601402+0000", 2024-09-21T22:16:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601403+0000", 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0999999999999999e-07 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601405+0000", 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601410+0000", 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.434e-06 2024-09-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601415+0000", 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4160000000000003e-06 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48526 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603448+0000", 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0084258500000000004, 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010233485, 2024-09-21T22:16:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48526 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603448+0000", 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603448+0000", 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603448+0000", 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9700000000000003e-07 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603450+0000", 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.722e-06 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603454+0000", 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.907e-06 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603456+0000", 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000002e-06 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48558 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604332+0000", 2024-09-21T22:16:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075420080000000002, 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093758599999999997, 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48558 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604332+0000", 2024-09-21T22:16:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604332+0000", 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604332+0000", 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604334+0000", 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.928e-06 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604340+0000", 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604344+0000", 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1339999999999997e-06 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48591 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605097+0000", 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0067770620000000004, 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086367600000000003, 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48591 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605097+0000", 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605097+0000", 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605097+0000", 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:16:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605098+0000", 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.497e-06 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605102+0000", 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5609999999999999e-06 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605105+0000", 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7470000000000001e-06 2024-09-21T22:16:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48623 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605798+0000", 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060756350000000002, 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080217870000000007, 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48623 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605798+0000", 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605798+0000", 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605798+0000", 2024-09-21T22:16:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605799+0000", 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-06 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605802+0000", 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.937e-06 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605805+0000", 2024-09-21T22:16:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4250000000000001e-06 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48655 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606301+0000", 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055728080000000003, 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075462359999999996, 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48655 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606301+0000", 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606301+0000", 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606301+0000", 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.96e-07 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606303+0000", 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8589999999999999e-06 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606309+0000", 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6509999999999998e-06 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606314+0000", 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5099999999999998e-06 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48763 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606760+0000", 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051136059999999997, 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071145269999999998, 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48763 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606760+0000", 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606760+0000", 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606760+0000", 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1899999999999998e-07 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606762+0000", 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.742e-06 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606774+0000", 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1639e-05 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606779+0000", 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8999999999999997e-06 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48795 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612835+0000", 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9990387, 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010672450000000001, 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48795 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612835+0000", 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612835+0000", 2024-09-21T22:16:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612835+0000", 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612838+0000", 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612844+0000", 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5200000000000003e-06 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612850+0000", 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1999999999999999e-06 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48495 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601429+0000", 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010444467000000001, 2024-09-21T22:16:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012499206000000001, 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48495 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601429+0000", 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601429+0000", 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601430+0000", 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3900000000000001e-07 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601431+0000", 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.44e-06 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601434+0000", 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3809999999999999e-06 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601437+0000", 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7180000000000001e-06 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48527 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603474+0000", 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0084001719999999992, 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010482808999999999, 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48527 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603474+0000", 2024-09-21T22:16:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603474+0000", 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603474+0000", 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603479+0000", 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9219999999999996e-06 2024-09-21T22:16:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603485+0000", 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.879e-06 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603489+0000", 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3109999999999999e-06 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48559 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604357+0000", 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075166520000000004, 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096302769999999996, 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48559 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604357+0000", 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604357+0000", 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604358+0000", 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2e-07 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604360+0000", 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.013e-06 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604366+0000", 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3759999999999996e-06 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604370+0000", 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4220000000000002e-06 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48592 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605108+0000", 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.006765587, 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089078409999999997, 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48592 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605108+0000", 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605108+0000", 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605108+0000", 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:16:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605110+0000", 2024-09-21T22:16:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.203e-06 2024-09-21T22:16:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605113+0000", 2024-09-21T22:16:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.242e-06 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605115+0000", 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48624 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605808+0000", 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060661609999999996, 2024-09-21T22:16:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082345969999999998, 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48624 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605808+0000", 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605808+0000", 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605808+0000", 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605809+0000", 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.17e-06 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605812+0000", 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9359999999999999e-06 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605814+0000", 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.407e-06 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48656 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606320+0000", 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055536939999999996, 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077499989999999996, 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48656 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606320+0000", 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606320+0000", 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606320+0000", 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606323+0000", 2024-09-21T22:16:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606336+0000", 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3117e-05 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606339+0000", 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.67e-06 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48764 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606785+0000", 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0050887160000000001, 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007310843, 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48764 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606785+0000", 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606785+0000", 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608781+0000", 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019958799999999998 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608785+0000", 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.053e-06 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608794+0000", 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3910000000000004e-06 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608800+0000", 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.891e-06 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48796 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612857+0000", 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9990163, 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012675710000000001, 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48796 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612857+0000", 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612857+0000", 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612858+0000", 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612860+0000", 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612869+0000", 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1139999999999995e-06 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612874+0000", 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8110000000000002e-06 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48496 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601440+0000", 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01043328, 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012710905, 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48496 2024-09-21T22:16:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601440+0000", 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601440+0000", 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601441+0000", 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:16:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601442+0000", 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.128e-06 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601445+0000", 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8119999999999999e-06 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601447+0000", 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5799999999999999e-06 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48528 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603495+0000", 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0083789499999999996, 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010689405000000001, 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48528 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603495+0000", 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603495+0000", 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603495+0000", 2024-09-21T22:16:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.96e-07 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603497+0000", 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8700000000000001e-06 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603503+0000", 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0430000000000004e-06 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603508+0000", 2024-09-21T22:16:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.617e-06 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48560 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604376+0000", 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074976139999999997, 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098347250000000008, 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48560 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604376+0000", 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604376+0000", 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604376+0000", 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604378+0000", 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9700000000000002e-06 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604384+0000", 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5269999999999998e-06 2024-09-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604389+0000", 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6979999999999997e-06 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48593 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605118+0000", 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0067555779999999999, 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091202760000000001, 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48593 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605118+0000", 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605118+0000", 2024-09-21T22:16:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605118+0000", 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605120+0000", 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.141e-06 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605122+0000", 2024-09-21T22:16:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9510000000000002e-06 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605125+0000", 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48625 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605817+0000", 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060565250000000001, 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084475279999999993, 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48625 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605817+0000", 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605817+0000", 2024-09-21T22:16:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605817+0000", 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605819+0000", 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1000000000000001e-06 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605821+0000", 2024-09-21T22:16:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8660000000000002e-06 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605824+0000", 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.305e-06 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48657 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606344+0000", 2024-09-21T22:16:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055301639999999997, 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079488140000000002, 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48657 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606344+0000", 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606344+0000", 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606344+0000", 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606345+0000", 2024-09-21T22:16:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4589999999999999e-06 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606349+0000", 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2040000000000002e-06 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606351+0000", 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5160000000000001e-06 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48765 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608811+0000", 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003062352, 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005508804, 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48765 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608811+0000", 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608811+0000", 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608812+0000", 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608814+0000", 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1440000000000001e-06 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608823+0000", 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7490000000000004e-06 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608828+0000", 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8910000000000003e-06 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48797 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612883+0000", 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9989905, 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014659370000000001, 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48797 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612883+0000", 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612883+0000", 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612884+0000", 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6100000000000002e-07 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612886+0000", 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612892+0000", 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2670000000000003e-06 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612901+0000", 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7809999999999994e-06 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48497 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.601450+0000", 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010423836000000001, 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012931356, 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48497 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601450+0000", 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.601450+0000", 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602771+0000", 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001321212 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602775+0000", 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4180000000000001e-06 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602782+0000", 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0119999999999999e-06 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602787+0000", 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48529 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603517+0000", 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0083565570000000006, 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010891167, 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48529 2024-09-21T22:16:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603517+0000", 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603517+0000", 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603518+0000", 2024-09-21T22:16:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.44e-07 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603520+0000", 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603525+0000", 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4060000000000004e-06 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603530+0000", 2024-09-21T22:16:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2050000000000001e-06 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48561 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604400+0000", 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074738019999999999, 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010036239000000001, 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48561 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604400+0000", 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604400+0000", 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604400+0000", 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604402+0000", 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9980000000000002e-06 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604408+0000", 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4240000000000001e-06 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604413+0000", 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.729e-06 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48594 3.16 3.6a053db6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605128+0000", 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0067455809999999996, 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093343079999999995, 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48594 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605128+0000", 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605128+0000", 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605128+0000", 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5100000000000001e-07 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605310+0000", 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018168399999999999 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605318+0000", 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7729999999999999e-06 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605324+0000", 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.981e-06 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48626 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605826+0000", 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060472620000000003, 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086645990000000003, 2024-09-21T22:16:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48626 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605826+0000", 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605826+0000", 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605827+0000", 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0100000000000001e-07 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605828+0000", 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1969999999999999e-06 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605831+0000", 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0979999999999998e-06 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605834+0000", 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.514e-06 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48658 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606354+0000", 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005519833, 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081638960000000003, 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48658 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606354+0000", 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606354+0000", 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606354+0000", 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9999999999999999e-07 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606355+0000", 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1850000000000001e-06 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606358+0000", 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.88e-06 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606361+0000", 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.464e-06 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48766 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608835+0000", 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003038462, 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057098579999999999, 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48766 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608835+0000", 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608835+0000", 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608836+0000", 2024-09-21T22:16:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.08e-07 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608841+0000", 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1630000000000004e-06 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608848+0000", 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4019999999999996e-06 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608853+0000", 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0690000000000001e-06 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48798 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612925+0000", 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9989491, 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016471400000000001, 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48798 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612925+0000", 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612925+0000", 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612925+0000", 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4999999999999999e-07 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612927+0000", 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6279999999999999e-06 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612931+0000", 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4710000000000001e-06 2024-09-21T22:16:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612934+0000", 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0979999999999998e-06 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48498 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602795+0000", 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0090784000000000004, 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011809605000000001, 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48498 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602795+0000", 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602795+0000", 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602796+0000", 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1300000000000001e-07 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602798+0000", 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.159e-06 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602804+0000", 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602808+0000", 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5179999999999998e-06 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48530 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603555+0000", 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0083185229999999995, 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011076064, 2024-09-21T22:16:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48530 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603555+0000", 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603555+0000", 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603556+0000", 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9200000000000001e-07 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603558+0000", 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-06 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603563+0000", 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7339999999999999e-06 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603567+0000", 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4950000000000002e-06 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48562 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604436+0000", 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074381550000000001, 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010223183, 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48562 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604436+0000", 2024-09-21T22:16:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604436+0000", 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604436+0000", 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4499999999999997e-07 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604441+0000", 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604448+0000", 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6050000000000003e-06 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604452+0000", 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3359999999999997e-06 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48595 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605342+0000", 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0065315060000000003, 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093426289999999999, 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48595 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605342+0000", 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605342+0000", 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605343+0000", 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605345+0000", 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605352+0000", 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5810000000000002e-06 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605357+0000", 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2220000000000001e-06 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48627 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605836+0000", 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060375669999999998, 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088760660000000002, 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48627 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605836+0000", 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605836+0000", 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605836+0000", 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605838+0000", 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.119e-06 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605840+0000", 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8399999999999999e-06 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605844+0000", 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8029999999999998e-06 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48659 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606363+0000", 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055102959999999996, 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083746989999999993, 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48659 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606363+0000", 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606363+0000", 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606364+0000", 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606365+0000", 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0529999999999999e-06 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606368+0000", 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8590000000000001e-06 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606370+0000", 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4980000000000001e-06 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48767 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608860+0000", 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0030140000000000002, 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059058979999999997, 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48767 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608860+0000", 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608860+0000", 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608860+0000", 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608862+0000", 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608868+0000", 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608873+0000", 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4839999999999998e-06 2024-09-21T22:16:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48799 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612938+0000", 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9989357, 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00186309, 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48799 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612938+0000", 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612938+0000", 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612938+0000", 2024-09-21T22:16:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612940+0000", 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612943+0000", 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0939999999999999e-06 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612945+0000", 2024-09-21T22:16:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5799999999999999e-06 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48499 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602820+0000", 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0090536760000000001, 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012010131, 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48499 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602820+0000", 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602820+0000", 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602821+0000", 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8500000000000001e-07 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602823+0000", 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1339999999999998e-06 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602829+0000", 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7880000000000003e-06 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602833+0000", 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6399999999999996e-06 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48531 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603586+0000", 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0082874219999999992, 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011270416, 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48531 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603586+0000", 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603586+0000", 2024-09-21T22:16:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603587+0000", 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8400000000000004e-07 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603589+0000", 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0310000000000001e-06 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603594+0000", 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1590000000000001e-06 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603598+0000", 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.369e-06 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48563 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604467+0000", 2024-09-21T22:16:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074065479999999998, 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010416404000000001, 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48563 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604467+0000", 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604467+0000", 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604468+0000", 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604470+0000", 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1890000000000001e-06 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604476+0000", 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9020000000000004e-06 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604481+0000", 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6909999999999996e-06 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48596 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605364+0000", 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0065097719999999996, 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095476999999999992, 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48596 2024-09-21T22:16:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605364+0000", 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605364+0000", 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605364+0000", 2024-09-21T22:16:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605366+0000", 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.866e-06 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605372+0000", 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6189999999999999e-06 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605377+0000", 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8450000000000002e-06 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48628 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605849+0000", 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060242860000000002, 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090884920000000001, 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48628 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605849+0000", 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605849+0000", 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605850+0000", 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.75e-07 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605852+0000", 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.894e-06 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605857+0000", 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5310000000000001e-06 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605862+0000", 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48660 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606373+0000", 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055008139999999997, 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085924899999999995, 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48660 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606373+0000", 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606373+0000", 2024-09-21T22:16:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606373+0000", 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606374+0000", 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7300000000000004e-07 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606377+0000", 2024-09-21T22:16:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.976e-06 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606380+0000", 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-06 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48768 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608878+0000", 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029955649999999999, 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061135709999999999, 2024-09-21T22:16:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48768 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608878+0000", 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608878+0000", 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608879+0000", 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608881+0000", 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608887+0000", 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0109999999999997e-06 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608892+0000", 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48800 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612948+0000", 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9989257, 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020715590000000002, 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48800 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612948+0000", 2024-09-21T22:16:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612948+0000", 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612948+0000", 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612950+0000", 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1990000000000001e-06 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612953+0000", 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9790000000000002e-06 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612956+0000", 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.427e-06 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48500 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602839+0000", 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0090343999999999997, 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012207773999999999, 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48500 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602839+0000", 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602839+0000", 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602840+0000", 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602842+0000", 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9520000000000001e-06 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602847+0000", 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3449999999999996e-06 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602851+0000", 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3290000000000004e-06 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48532 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603617+0000", 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.008256312, 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011458336, 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48532 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603617+0000", 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603617+0000", 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603618+0000", 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6400000000000002e-07 2024-09-21T22:16:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603620+0000", 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603625+0000", 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.887e-06 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603629+0000", 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3669999999999999e-06 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48564 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604486+0000", 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0073873630000000001, 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010620321, 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48564 2024-09-21T22:16:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604486+0000", 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604486+0000", 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604487+0000", 2024-09-21T22:16:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604489+0000", 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.86e-06 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604494+0000", 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7320000000000003e-06 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604498+0000", 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0659999999999997e-06 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48597 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605382+0000", 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064913469999999997, 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097521199999999995, 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48597 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605382+0000", 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605382+0000", 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605383+0000", 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.39e-07 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605385+0000", 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8759999999999999e-06 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605390+0000", 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4210000000000003e-06 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605395+0000", 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.724e-06 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48629 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605867+0000", 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060065049999999997, 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092933149999999999, 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48629 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605867+0000", 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605867+0000", 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605868+0000", 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8999999999999998e-07 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605869+0000", 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.863e-06 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605875+0000", 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2599999999999996e-06 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605879+0000", 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2980000000000002e-06 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48661 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606382+0000", 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054915959999999996, 2024-09-21T22:16:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088065369999999997, 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48661 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606382+0000", 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606382+0000", 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606382+0000", 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0100000000000001e-07 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606383+0000", 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.78e-07 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606386+0000", 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9079999999999999e-06 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606389+0000", 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4959999999999999e-06 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48769 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608898+0000", 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002975798, 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063168080000000001, 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48769 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608898+0000", 2024-09-21T22:16:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608898+0000", 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608898+0000", 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6399999999999998e-07 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608900+0000", 2024-09-21T22:16:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608906+0000", 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608911+0000", 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1109999999999999e-06 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48801 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612959+0000", 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9989147, 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002287781, 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48801 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612959+0000", 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612959+0000", 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612959+0000", 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.16e-07 2024-09-21T22:16:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612965+0000", 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6749999999999999e-06 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612968+0000", 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.247e-06 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612971+0000", 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5440000000000001e-06 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48501 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602875+0000", 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0089984230000000002, 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012398377, 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48501 2024-09-21T22:16:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602875+0000", 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602875+0000", 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602876+0000", 2024-09-21T22:16:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4600000000000005e-07 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602878+0000", 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1610000000000001e-06 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602885+0000", 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5379999999999999e-06 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602889+0000", 2024-09-21T22:16:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2169999999999996e-06 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48533 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603648+0000", 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0082252639999999995, 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011652819, 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48533 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603648+0000", 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603648+0000", 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603649+0000", 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9999999999999997e-07 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603651+0000", 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603656+0000", 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8149999999999996e-06 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603660+0000", 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2719999999999999e-06 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48565 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604504+0000", 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0073699639999999997, 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010824029000000001, 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48565 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604504+0000", 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604504+0000", 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604504+0000", 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604506+0000", 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9190000000000002e-06 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604511+0000", 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604516+0000", 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.882e-06 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48598 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605400+0000", 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064735740000000002, 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099537229999999994, 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48598 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605400+0000", 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605400+0000", 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605401+0000", 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3599999999999999e-07 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605402+0000", 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8560000000000001e-06 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605408+0000", 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605413+0000", 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5170000000000001e-06 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48630 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605884+0000", 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059894880000000003, 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095028620000000008, 2024-09-21T22:16:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48630 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605884+0000", 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605884+0000", 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605885+0000", 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9999999999999999e-07 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605891+0000", 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6610000000000003e-06 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605897+0000", 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8200000000000002e-06 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605902+0000", 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4780000000000002e-06 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48737 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606391+0000", 2024-09-21T22:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054823989999999998, 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090221450000000005, 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48737 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606391+0000", 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606391+0000", 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606392+0000", 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606392+0000", 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9899999999999999e-07 2024-09-21T22:16:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606396+0000", 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4180000000000001e-06 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606398+0000", 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48770 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608916+0000", 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029572600000000002, 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065255010000000004, 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48770 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608916+0000", 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608916+0000", 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608917+0000", 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608919+0000", 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9649999999999998e-06 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608927+0000", 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7859999999999997e-06 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608931+0000", 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6210000000000003e-06 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48802 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612974+0000", 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9988995, 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024943330000000001, 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48802 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612974+0000", 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612974+0000", 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612974+0000", 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:16:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612975+0000", 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.145e-06 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612978+0000", 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612981+0000", 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:16:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48502 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602896+0000", 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0089779660000000004, 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012601081, 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48502 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602896+0000", 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602896+0000", 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602896+0000", 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602898+0000", 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602904+0000", 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7289999999999997e-06 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602908+0000", 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3919999999999996e-06 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48534 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603678+0000", 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0081959900000000002, 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011845481, 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48534 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603678+0000", 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603678+0000", 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603678+0000", 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3499999999999996e-07 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603680+0000", 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0770000000000002e-06 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603686+0000", 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.874e-06 2024-09-21T22:16:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603690+0000", 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9179999999999996e-06 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48566 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604528+0000", 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0073459559999999998, 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0110232, 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48566 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604528+0000", 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604528+0000", 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604528+0000", 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3399999999999999e-07 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604530+0000", 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1639999999999999e-06 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604536+0000", 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4249999999999997e-06 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604541+0000", 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7160000000000002e-06 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48599 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605418+0000", 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064556869999999999, 2024-09-21T22:16:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010162434999999999, 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48599 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605418+0000", 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605418+0000", 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605418+0000", 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605420+0000", 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605431+0000", 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605435+0000", 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9350000000000002e-06 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48631 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605908+0000", 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005966074, 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097079880000000007, 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48631 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605908+0000", 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605908+0000", 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605908+0000", 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7399999999999999e-07 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605910+0000", 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9759999999999998e-06 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605916+0000", 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.874e-06 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605921+0000", 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.622e-06 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48738 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606402+0000", 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054721639999999998, 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092416440000000002, 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48738 2024-09-21T22:16:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606402+0000", 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606402+0000", 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606402+0000", 2024-09-21T22:16:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606403+0000", 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-07 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606406+0000", 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9450000000000002e-06 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606408+0000", 2024-09-21T22:16:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5519999999999999e-06 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48771 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608937+0000", 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002936503, 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067336100000000001, 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48771 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608937+0000", 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608937+0000", 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608938+0000", 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608940+0000", 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0849999999999999e-06 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608946+0000", 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070000000000004e-06 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608950+0000", 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.138e-06 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48803 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612984+0000", 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9988894, 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027132160000000001, 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48803 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612984+0000", 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612984+0000", 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612984+0000", 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612986+0000", 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0389999999999999e-06 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612988+0000", 2024-09-21T22:16:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519999999999999e-06 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612991+0000", 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.514e-06 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48503 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602914+0000", 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0089594389999999996, 2024-09-21T22:16:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012835302999999999, 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48503 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602914+0000", 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602914+0000", 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602915+0000", 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602920+0000", 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9989999999999999e-06 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602925+0000", 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2780000000000001e-06 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602930+0000", 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4390000000000002e-06 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48535 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603711+0000", 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0081623870000000001, 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012072006999999999, 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48535 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603711+0000", 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603711+0000", 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603712+0000", 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603714+0000", 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1399999999999998e-06 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603720+0000", 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.049e-06 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603724+0000", 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3080000000000001e-06 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48567 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604551+0000", 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0073225879999999997, 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011259061000000001, 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48567 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604551+0000", 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604551+0000", 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604552+0000", 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3499999999999996e-07 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604554+0000", 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604560+0000", 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7239999999999997e-06 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604564+0000", 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48600 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605442+0000", 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.006432129, 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010395137, 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48600 2024-09-21T22:16:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605442+0000", 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605442+0000", 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605442+0000", 2024-09-21T22:16:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-07 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605444+0000", 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0229999999999999e-06 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605448+0000", 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605451+0000", 2024-09-21T22:16:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7089999999999998e-06 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48632 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605926+0000", 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059480770000000004, 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099373039999999992, 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48632 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605926+0000", 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605926+0000", 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605926+0000", 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605928+0000", 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9709999999999998e-06 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605934+0000", 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6849999999999998e-06 2024-09-21T22:16:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605938+0000", 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2370000000000003e-06 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48740 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606411+0000", 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054628250000000001, 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094782070000000006, 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48740 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606411+0000", 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606411+0000", 2024-09-21T22:16:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606411+0000", 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606412+0000", 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0699999999999999e-06 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606415+0000", 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7429999999999998e-06 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606417+0000", 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.43e-06 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48772 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608955+0000", 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029183730000000001, 2024-09-21T22:16:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069596839999999998, 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48772 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608955+0000", 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608955+0000", 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608956+0000", 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1e-07 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608958+0000", 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608963+0000", 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7740000000000001e-06 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608969+0000", 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5450000000000003e-06 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48804 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.612994+0000", 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9988799, 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002952859, 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48804 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612994+0000", 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612994+0000", 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612994+0000", 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612995+0000", 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.139e-06 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.612998+0000", 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.613001+0000", 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4949999999999998e-06 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48504 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602939+0000", 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0089344909999999993, 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013033746000000001, 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48504 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602939+0000", 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602939+0000", 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602940+0000", 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4099999999999999e-07 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602942+0000", 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5289999999999998e-06 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602948+0000", 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0129999999999999e-06 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602953+0000", 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48536 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603731+0000", 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0081431690000000004, 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01226875, 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48536 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603731+0000", 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603731+0000", 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603731+0000", 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603733+0000", 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.249e-06 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603739+0000", 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6919999999999999e-06 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603744+0000", 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0150000000000003e-06 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48568 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604570+0000", 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0073037570000000001, 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011455587, 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48568 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604570+0000", 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604570+0000", 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604570+0000", 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4400000000000001e-07 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604572+0000", 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604578+0000", 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604582+0000", 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48601 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605454+0000", 2024-09-21T22:16:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064198340000000001, 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010598177, 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48601 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605454+0000", 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605454+0000", 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605454+0000", 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605456+0000", 2024-09-21T22:16:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5069999999999999e-06 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605459+0000", 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9799999999999998e-06 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605461+0000", 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5399999999999998e-06 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48633 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605944+0000", 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059298969999999999, 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010134516999999999, 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48633 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605944+0000", 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605944+0000", 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605944+0000", 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:16:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605946+0000", 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605952+0000", 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7209999999999999e-06 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605957+0000", 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7190000000000001e-06 2024-09-21T22:16:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48741 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606420+0000", 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054537850000000001, 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096846859999999996, 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48741 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606420+0000", 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606420+0000", 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606420+0000", 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606421+0000", 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.271e-06 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606424+0000", 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606427+0000", 2024-09-21T22:16:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4109999999999999e-06 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48773 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.608974+0000", 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028993909999999999, 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071574489999999998, 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48773 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608974+0000", 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608974+0000", 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608975+0000", 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608977+0000", 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3489999999999999e-06 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608983+0000", 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:16:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.608987+0000", 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48805 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.613003+0000", 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9988704, 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003155316, 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48805 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.613003+0000", 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.613003+0000", 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614782+0000", 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017782080000000001 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614785+0000", 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9689999999999996e-06 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614796+0000", 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0155e-05 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614802+0000", 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2949999999999999e-06 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48505 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602959+0000", 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0089147099999999993, 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013226004, 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48505 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602959+0000", 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602959+0000", 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602959+0000", 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602961+0000", 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9549999999999999e-06 2024-09-21T22:16:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602967+0000", 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7309999999999998e-06 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602971+0000", 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9999999999999998e-06 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48537 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603757+0000", 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0081171709999999994, 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012455285999999999, 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48537 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603757+0000", 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603757+0000", 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603757+0000", 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3499999999999996e-07 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603759+0000", 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.075e-06 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603765+0000", 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9889999999999997e-06 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603780+0000", 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4445e-05 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48569 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604588+0000", 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0072861790000000003, 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011650634, 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48569 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604588+0000", 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604588+0000", 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604588+0000", 2024-09-21T22:16:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0400000000000002e-07 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604590+0000", 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9269999999999999e-06 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604595+0000", 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604601+0000", 2024-09-21T22:16:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7150000000000003e-06 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48602 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605464+0000", 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064098860000000001, 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010800574, 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48602 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605464+0000", 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605464+0000", 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605464+0000", 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.91e-07 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605465+0000", 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.189e-06 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605468+0000", 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8619999999999999e-06 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605471+0000", 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2449999999999998e-06 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48634 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605962+0000", 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059115540000000003, 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010328429, 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48634 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605962+0000", 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605962+0000", 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605963+0000", 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605964+0000", 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8199999999999999e-06 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605970+0000", 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5670000000000002e-06 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605974+0000", 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.143e-06 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48742 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606431+0000", 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005443214, 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098858169999999999, 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48742 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606431+0000", 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606431+0000", 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606431+0000", 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606435+0000", 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606441+0000", 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.587e-06 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606446+0000", 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5310000000000003e-06 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48774 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.609002+0000", 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028721860000000001, 2024-09-21T22:16:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073455289999999999, 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48774 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609002+0000", 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609002+0000", 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609002+0000", 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5400000000000002e-07 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609003+0000", 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T22:16:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609007+0000", 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8290000000000001e-06 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609010+0000", 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9510000000000002e-06 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48806 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614814+0000", 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9970603, 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001560348, 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48806 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614814+0000", 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614814+0000", 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614814+0000", 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614817+0000", 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4549999999999998e-06 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614822+0000", 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8039999999999998e-06 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614829+0000", 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1260000000000003e-06 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48506 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.602977+0000", 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0088971320000000003, 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013423987, 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48506 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602977+0000", 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602977+0000", 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602977+0000", 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602979+0000", 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602985+0000", 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.857e-06 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.602989+0000", 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6890000000000003e-06 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48538 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603793+0000", 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080807210000000008, 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012634037000000001, 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48538 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603793+0000", 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603793+0000", 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603793+0000", 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:16:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603796+0000", 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4090000000000001e-06 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603803+0000", 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9090000000000003e-06 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603807+0000", 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5909999999999998e-06 2024-09-21T22:16:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48570 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604611+0000", 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0072626310000000003, 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011842935000000001, 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48570 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604611+0000", 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604611+0000", 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604612+0000", 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1699999999999998e-07 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604614+0000", 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1150000000000001e-06 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604619+0000", 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.614e-06 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604624+0000", 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48603 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605475+0000", 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063987569999999997, 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011005068999999999, 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48603 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605475+0000", 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605475+0000", 2024-09-21T22:16:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605475+0000", 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605476+0000", 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.173e-06 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605479+0000", 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0860000000000002e-06 2024-09-21T22:16:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605483+0000", 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0450000000000001e-06 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48635 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605979+0000", 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058943759999999998, 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010526908, 2024-09-21T22:16:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48635 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605979+0000", 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605979+0000", 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605980+0000", 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5699999999999998e-07 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605982+0000", 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9539999999999998e-06 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605987+0000", 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5999999999999997e-06 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605992+0000", 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48743 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606451+0000", 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054226609999999996, 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010081153000000001, 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48743 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606451+0000", 2024-09-21T22:16:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606451+0000", 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606452+0000", 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606453+0000", 2024-09-21T22:16:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8610000000000001e-06 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606459+0000", 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.366e-06 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606463+0000", 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6840000000000004e-06 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48775 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.609014+0000", 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028595439999999999, 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075442900000000004, 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48775 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609014+0000", 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609014+0000", 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609015+0000", 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8999999999999998e-07 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609016+0000", 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1930000000000001e-06 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609019+0000", 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5549999999999998e-06 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609022+0000", 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5629999999999999e-06 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48807 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614835+0000", 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9970384, 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017511759999999999, 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48807 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614835+0000", 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614835+0000", 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614836+0000", 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614837+0000", 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.933e-06 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614845+0000", 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2609999999999996e-06 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614850+0000", 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8409999999999999e-06 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48507 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603006+0000", 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0088680719999999994, 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013606798, 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48507 2024-09-21T22:16:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603006+0000", 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603006+0000", 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603006+0000", 2024-09-21T22:16:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000004e-07 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603008+0000", 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0540000000000002e-06 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603014+0000", 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1070000000000001e-06 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603019+0000", 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2169999999999996e-06 2024-09-21T22:16:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48539 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603821+0000", 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080525200000000005, 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012817103999999999, 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48539 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603821+0000", 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603821+0000", 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603822+0000", 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4300000000000003e-07 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603824+0000", 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2649999999999999e-06 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603830+0000", 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603834+0000", 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3200000000000001e-06 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48571 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604635+0000", 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0072391089999999996, 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012031036, 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48571 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604635+0000", 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604635+0000", 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604635+0000", 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604637+0000", 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604643+0000", 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604649+0000", 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5289999999999999e-06 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48604 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605485+0000", 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063883560000000004, 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011205994, 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48604 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605485+0000", 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605485+0000", 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605486+0000", 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605487+0000", 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1459999999999999e-06 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605490+0000", 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.977e-06 2024-09-21T22:16:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605492+0000", 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48636 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605997+0000", 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058763549999999998, 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010719818000000001, 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48636 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605997+0000", 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605997+0000", 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605998+0000", 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606000+0000", 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.916e-06 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606005+0000", 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4689999999999996e-06 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606010+0000", 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3900000000000003e-06 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48744 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606468+0000", 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054054410000000004, 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010279103, 2024-09-21T22:16:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48744 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606468+0000", 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606468+0000", 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606469+0000", 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3599999999999999e-07 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606470+0000", 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.765e-06 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606476+0000", 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606480+0000", 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5210000000000004e-06 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48776 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.609025+0000", 2024-09-21T22:16:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002849075, 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077584960000000001, 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48776 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609025+0000", 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609025+0000", 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609025+0000", 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609026+0000", 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1650000000000001e-06 2024-09-21T22:16:34.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609029+0000", 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3230000000000002e-06 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609032+0000", 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.638e-06 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.182 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48808 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614857+0000", 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9970169, 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001954192, 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48808 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614857+0000", 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614857+0000", 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614857+0000", 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614859+0000", 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.013e-06 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614866+0000", 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8909999999999998e-06 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614880+0000", 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3597e-05 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48508 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603024+0000", 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0088494349999999992, 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013814651000000001, 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48508 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603024+0000", 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603024+0000", 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603025+0000", 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:16:34.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603027+0000", 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.779e-06 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603032+0000", 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603038+0000", 2024-09-21T22:16:34.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5060000000000003e-06 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48540 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603860+0000", 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080133979999999997, 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013004890999999999, 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48540 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603860+0000", 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603860+0000", 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603861+0000", 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5400000000000001e-07 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603863+0000", 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603868+0000", 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8999999999999997e-06 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603873+0000", 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7809999999999996e-06 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48572 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604655+0000", 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0072189100000000003, 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01223694, 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.192 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48572 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604655+0000", 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604655+0000", 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604655+0000", 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604657+0000", 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604663+0000", 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8950000000000003e-06 2024-09-21T22:16:34.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604667+0000", 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.053e-06 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48605 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605495+0000", 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00637887, 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011423654, 2024-09-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48605 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605495+0000", 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605495+0000", 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605495+0000", 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605496+0000", 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-06 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605499+0000", 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605502+0000", 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.526e-06 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48637 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.198 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606015+0000", 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058587969999999998, 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010929628, 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48637 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606015+0000", 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606015+0000", 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606015+0000", 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606017+0000", 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.765e-06 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606022+0000", 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3299999999999998e-06 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606027+0000", 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7740000000000004e-06 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48745 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606485+0000", 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053883289999999999, 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010485672999999999, 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48745 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.202 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606485+0000", 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606485+0000", 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606486+0000", 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-07 2024-09-21T22:16:34.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606487+0000", 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6959999999999999e-06 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606493+0000", 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3600000000000004e-06 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606497+0000", 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4129999999999999e-06 2024-09-21T22:16:34.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48777 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.609035+0000", 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028389460000000002, 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079626030000000004, 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48777 2024-09-21T22:16:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609035+0000", 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609035+0000", 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609035+0000", 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609036+0000", 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006e-06 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609040+0000", 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609042+0000", 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5359999999999999e-06 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48809 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614887+0000", 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9969869, 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021456499999999998, 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48809 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614887+0000", 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614887+0000", 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614888+0000", 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614890+0000", 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.142e-06 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614897+0000", 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.985e-06 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614902+0000", 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2689999999999999e-06 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48509 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603048+0000", 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0088254049999999997, 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01402373, 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48509 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603048+0000", 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603048+0000", 2024-09-21T22:16:34.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603049+0000", 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.51e-07 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603051+0000", 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9929999999999998e-06 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603056+0000", 2024-09-21T22:16:34.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603060+0000", 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.929e-06 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48541 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603892+0000", 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.007982042, 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013207419999999999, 2024-09-21T22:16:34.214 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48541 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603892+0000", 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603892+0000", 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603892+0000", 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5000000000000003e-07 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603894+0000", 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9989999999999998e-06 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603899+0000", 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7350000000000004e-06 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603903+0000", 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3939999999999998e-06 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48573 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604673+0000", 2024-09-21T22:16:34.217 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.007201112, 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012452941, 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48573 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604673+0000", 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604673+0000", 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604673+0000", 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604675+0000", 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.046e-06 2024-09-21T22:16:34.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604681+0000", 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4890000000000003e-06 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604686+0000", 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2179999999999998e-06 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48606 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605504+0000", 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063695490000000004, 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011647912, 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48606 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605504+0000", 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605504+0000", 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605504+0000", 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605508+0000", 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.98e-06 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605512+0000", 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.185e-06 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605514+0000", 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5959999999999998e-06 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48638 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606049+0000", 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058245859999999997, 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011128822999999999, 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48638 2024-09-21T22:16:34.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606049+0000", 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606049+0000", 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606049+0000", 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1e-07 2024-09-21T22:16:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606052+0000", 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0229999999999999e-06 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606055+0000", 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6969999999999999e-06 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606058+0000", 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8789999999999999e-06 2024-09-21T22:16:34.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48746 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606503+0000", 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053711269999999998, 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010701894999999999, 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.227 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48746 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606503+0000", 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606503+0000", 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606503+0000", 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1e-07 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606505+0000", 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7540000000000001e-06 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606511+0000", 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5440000000000004e-06 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606516+0000", 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.617e-06 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48778 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.609045+0000", 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028286880000000002, 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081855060000000004, 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48778 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609045+0000", 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609045+0000", 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609045+0000", 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609049+0000", 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1019999999999999e-06 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609053+0000", 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.202e-06 2024-09-21T22:16:34.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609055+0000", 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48810 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614909+0000", 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9969649, 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023480649999999999, 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48810 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614909+0000", 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614909+0000", 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614909+0000", 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.65e-07 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614911+0000", 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0159999999999998e-06 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614917+0000", 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7100000000000004e-06 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614922+0000", 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48510 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603086+0000", 2024-09-21T22:16:34.236 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0087873919999999998, 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014197285, 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48510 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603086+0000", 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603086+0000", 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603087+0000", 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603089+0000", 2024-09-21T22:16:34.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603095+0000", 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4349999999999996e-06 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603099+0000", 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7539999999999997e-06 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48542 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603922+0000", 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079515939999999993, 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013387784, 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48542 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603922+0000", 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603922+0000", 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603923+0000", 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3200000000000005e-07 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603925+0000", 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603929+0000", 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603934+0000", 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8130000000000003e-06 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48574 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604697+0000", 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0071768580000000004, 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01263978, 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48574 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604697+0000", 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604697+0000", 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604697+0000", 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604702+0000", 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5619999999999997e-06 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604708+0000", 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2559999999999999e-06 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604712+0000", 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2119999999999997e-06 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48607 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605518+0000", 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063558900000000003, 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011844888, 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48607 2024-09-21T22:16:34.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605518+0000", 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605518+0000", 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605518+0000", 2024-09-21T22:16:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605519+0000", 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.173e-06 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605522+0000", 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0469999999999998e-06 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605525+0000", 2024-09-21T22:16:34.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5600000000000001e-06 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48639 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606062+0000", 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058122130000000001, 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011327123999999999, 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48639 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606062+0000", 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606062+0000", 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606062+0000", 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0100000000000001e-07 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606063+0000", 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606066+0000", 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0110000000000001e-06 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606069+0000", 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5270000000000001e-06 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48747 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606521+0000", 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00535259, 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010893448999999999, 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48747 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606521+0000", 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606521+0000", 2024-09-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606522+0000", 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606523+0000", 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7889999999999999e-06 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606529+0000", 2024-09-21T22:16:34.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6779999999999997e-06 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606534+0000", 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5240000000000002e-06 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48779 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.609059+0000", 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002814684, 2024-09-21T22:16:34.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083816859999999993, 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48779 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609059+0000", 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.609059+0000", 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610772+0000", 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017133039999999999 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610775+0000", 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1070000000000001e-06 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610782+0000", 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0820000000000004e-06 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610786+0000", 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.211e-06 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48811 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614927+0000", 2024-09-21T22:16:34.258 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9969463, 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025403629999999999, 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48811 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614927+0000", 2024-09-21T22:16:34.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614927+0000", 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614928+0000", 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3599999999999999e-07 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614929+0000", 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8300000000000001e-06 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614940+0000", 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0539e-05 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614945+0000", 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1120000000000004e-06 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48511 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603110+0000", 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0087637659999999992, 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014384078, 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48511 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603110+0000", 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603110+0000", 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603111+0000", 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603113+0000", 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603119+0000", 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5950000000000004e-06 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603124+0000", 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:16:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48543 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603953+0000", 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079205360000000006, 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013567304000000001, 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48543 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603953+0000", 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603953+0000", 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603954+0000", 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603956+0000", 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603962+0000", 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9329999999999998e-06 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603967+0000", 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7759999999999997e-06 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48575 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604722+0000", 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0071516779999999999, 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012824927999999999, 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48575 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604722+0000", 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604722+0000", 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604722+0000", 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604725+0000", 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1490000000000001e-06 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604730+0000", 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604735+0000", 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5870000000000003e-06 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48608 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605528+0000", 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063461979999999999, 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012046866999999999, 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48608 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605528+0000", 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605528+0000", 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605528+0000", 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605529+0000", 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1489999999999999e-06 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605532+0000", 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8909999999999999e-06 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605534+0000", 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4609999999999998e-06 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48640 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606071+0000", 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058024770000000003, 2024-09-21T22:16:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011529776, 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48640 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606071+0000", 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606071+0000", 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606071+0000", 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606073+0000", 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.096e-06 2024-09-21T22:16:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606075+0000", 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9040000000000001e-06 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606078+0000", 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4940000000000002e-06 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48748 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606539+0000", 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053349629999999999, 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011088618999999999, 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48748 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606539+0000", 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606539+0000", 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606539+0000", 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606541+0000", 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7600000000000001e-06 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606547+0000", 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6670000000000001e-06 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606551+0000", 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419999999999997e-06 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48780 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610794+0000", 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010802120000000001, 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068609259999999998, 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48780 2024-09-21T22:16:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610794+0000", 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610794+0000", 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610794+0000", 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9499999999999998e-07 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610795+0000", 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.384e-06 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610799+0000", 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4680000000000001e-06 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610802+0000", 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8619999999999999e-06 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48812 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614951+0000", 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9969225, 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027299580000000002, 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48812 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614951+0000", 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614951+0000", 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614951+0000", 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-07 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614953+0000", 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.052e-06 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614960+0000", 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8889999999999996e-06 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614965+0000", 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9080000000000003e-06 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48512 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603130+0000", 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0087440469999999996, 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014577728, 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48512 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603130+0000", 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603130+0000", 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603130+0000", 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2500000000000001e-07 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603132+0000", 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.835e-06 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603137+0000", 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9710000000000003e-06 2024-09-21T22:16:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603142+0000", 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7230000000000004e-06 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48544 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603972+0000", 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079017099999999993, 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013761793, 2024-09-21T22:16:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48544 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603972+0000", 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603972+0000", 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603972+0000", 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603974+0000", 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.829e-06 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603980+0000", 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4670000000000003e-06 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603985+0000", 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8380000000000001e-06 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48577 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604741+0000", 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0071332210000000004, 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013019776, 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48577 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604741+0000", 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604741+0000", 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604741+0000", 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.37e-07 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604743+0000", 2024-09-21T22:16:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9700000000000002e-06 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604748+0000", 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604753+0000", 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4989999999999996e-06 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48609 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605537+0000", 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063368950000000004, 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012253780000000001, 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48609 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605537+0000", 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605537+0000", 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605537+0000", 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.34e-07 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605538+0000", 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.540000000000001e-07 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605543+0000", 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6349999999999997e-06 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605546+0000", 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.693e-06 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48641 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606081+0000", 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057930810000000003, 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011735972000000001, 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48641 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606081+0000", 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606081+0000", 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606081+0000", 2024-09-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0100000000000001e-07 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606082+0000", 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1069999999999999e-06 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606085+0000", 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.875e-06 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606088+0000", 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:16:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48749 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606556+0000", 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053172970000000003, 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011286536999999999, 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48749 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606556+0000", 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606556+0000", 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606557+0000", 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606558+0000", 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.652e-06 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606564+0000", 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1100000000000002e-06 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606568+0000", 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5549999999999996e-06 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48781 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610805+0000", 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010686960000000001, 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070644280000000002, 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48781 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610805+0000", 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610805+0000", 2024-09-21T22:16:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610805+0000", 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5100000000000001e-07 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610807+0000", 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4389999999999999e-06 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610812+0000", 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1590000000000001e-06 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610816+0000", 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.566e-06 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48813 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.614976+0000", 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9968977, 2024-09-21T22:16:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920073, 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48813 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614976+0000", 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614976+0000", 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614976+0000", 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.77e-07 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614982+0000", 2024-09-21T22:16:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.716e-06 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614988+0000", 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7169999999999996e-06 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.614994+0000", 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860000000000001e-06 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48513 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603148+0000", 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0087256429999999999, 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014780546, 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48513 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603148+0000", 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603148+0000", 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603149+0000", 2024-09-21T22:16:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0800000000000005e-07 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603151+0000", 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9659999999999999e-06 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603156+0000", 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8730000000000004e-06 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603161+0000", 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6689999999999997e-06 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48545 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603996+0000", 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0078775340000000003, 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013959084, 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48545 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603996+0000", 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603996+0000", 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603997+0000", 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000004e-07 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603999+0000", 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0310000000000001e-06 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604004+0000", 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604008+0000", 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5860000000000001e-06 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48578 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604763+0000", 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0071106340000000002, 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013218435000000001, 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48578 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604763+0000", 2024-09-21T22:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604763+0000", 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604764+0000", 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.51e-07 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604766+0000", 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1440000000000001e-06 2024-09-21T22:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604776+0000", 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0176e-05 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604781+0000", 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48610 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605560+0000", 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063140460000000002, 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012448193999999999, 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48610 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605560+0000", 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605560+0000", 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605560+0000", 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605562+0000", 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0360000000000001e-06 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605568+0000", 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5130000000000004e-06 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605572+0000", 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48642 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606090+0000", 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057834419999999997, 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011943811, 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48642 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606090+0000", 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606090+0000", 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606091+0000", 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606094+0000", 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7910000000000002e-06 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606098+0000", 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9689999999999996e-06 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606101+0000", 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5189999999999999e-06 2024-09-21T22:16:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48750 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606573+0000", 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053004410000000004, 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011487908999999999, 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48750 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606573+0000", 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606573+0000", 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606574+0000", 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606575+0000", 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.804e-06 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606581+0000", 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606586+0000", 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5630000000000002e-06 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48782 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610830+0000", 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010442509999999999, 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072587900000000002, 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48782 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610830+0000", 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610830+0000", 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610830+0000", 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6400000000000002e-07 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610832+0000", 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9300000000000002e-06 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610838+0000", 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6629999999999998e-06 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610843+0000", 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9309999999999999e-06 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48814 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.615023+0000", 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9968514, 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030932429999999999, 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48814 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615023+0000", 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615023+0000", 2024-09-21T22:16:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615023+0000", 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.72e-07 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615025+0000", 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.962e-06 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615029+0000", 2024-09-21T22:16:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0060000000000003e-06 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615032+0000", 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48514 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603167+0000", 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0087070080000000005, 2024-09-21T22:16:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014975443999999999, 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48514 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603167+0000", 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603167+0000", 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603167+0000", 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603169+0000", 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9410000000000001e-06 2024-09-21T22:16:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603175+0000", 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.553e-06 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603179+0000", 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48546 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604031+0000", 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0078425019999999995, 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014137077, 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48546 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604031+0000", 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604031+0000", 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604032+0000", 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604034+0000", 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9759999999999998e-06 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604040+0000", 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604044+0000", 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5909999999999998e-06 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48579 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604787+0000", 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0070868199999999998, 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013408491999999999, 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48579 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604787+0000", 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604787+0000", 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604787+0000", 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.01e-07 2024-09-21T22:16:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604790+0000", 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.199e-06 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604795+0000", 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4469999999999997e-06 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604799+0000", 2024-09-21T22:16:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5090000000000004e-06 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48611 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605578+0000", 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062956519999999997, 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012646615999999999, 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48611 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605578+0000", 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605578+0000", 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605578+0000", 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-07 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605580+0000", 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.823e-06 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605586+0000", 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6489999999999996e-06 2024-09-21T22:16:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605590+0000", 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4469999999999999e-06 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48643 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606104+0000", 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057700690000000001, 2024-09-21T22:16:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012149452999999999, 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48643 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606104+0000", 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606104+0000", 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606104+0000", 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.16e-07 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606105+0000", 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1650000000000001e-06 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606108+0000", 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9569999999999998e-06 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606111+0000", 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48751 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606591+0000", 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052832110000000003, 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011690369000000001, 2024-09-21T22:16:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48751 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606591+0000", 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606591+0000", 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606591+0000", 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606593+0000", 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.821e-06 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606598+0000", 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4090000000000002e-06 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606603+0000", 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3970000000000004e-06 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48783 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610849+0000", 2024-09-21T22:16:34.357 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010251570000000001, 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007458686, 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48783 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610849+0000", 2024-09-21T22:16:34.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610849+0000", 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610849+0000", 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610851+0000", 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610857+0000", 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.648e-06 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610861+0000", 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.459e-06 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48815 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.615036+0000", 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9968381, 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032981350000000002, 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48815 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615036+0000", 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615036+0000", 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615036+0000", 2024-09-21T22:16:34.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-07 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615037+0000", 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.249e-06 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615040+0000", 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0019999999999998e-06 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615043+0000", 2024-09-21T22:16:34.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5289999999999998e-06 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48515 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603198+0000", 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0086757980000000002, 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015162685, 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48515 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603198+0000", 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603198+0000", 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603198+0000", 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603204+0000", 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0490000000000003e-06 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603210+0000", 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0800000000000002e-06 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603215+0000", 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.446e-06 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48547 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604064+0000", 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0078102170000000004, 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014323255, 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48547 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604064+0000", 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604064+0000", 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604064+0000", 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604066+0000", 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604072+0000", 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.032e-06 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604077+0000", 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7199999999999997e-06 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48580 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604810+0000", 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0070635749999999999, 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013602822000000001, 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48580 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604810+0000", 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604810+0000", 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604811+0000", 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604813+0000", 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0810000000000001e-06 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604819+0000", 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8629999999999996e-06 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604823+0000", 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6299999999999997e-06 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48612 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605596+0000", 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062778060000000004, 2024-09-21T22:16:34.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012843482, 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48612 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605596+0000", 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605596+0000", 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605596+0000", 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605598+0000", 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.733e-06 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605604+0000", 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0569999999999998e-06 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605609+0000", 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6360000000000002e-06 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48644 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.376 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606114+0000", 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057601320000000003, 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012352217, 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48644 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606114+0000", 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606114+0000", 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606114+0000", 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0100000000000001e-07 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606115+0000", 2024-09-21T22:16:34.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.17e-06 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606118+0000", 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8779999999999998e-06 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606120+0000", 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.441e-06 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48752 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606608+0000", 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052656120000000002, 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011884077999999999, 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48752 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606608+0000", 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606608+0000", 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606608+0000", 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0400000000000002e-07 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606610+0000", 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.686e-06 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606615+0000", 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2989999999999996e-06 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606620+0000", 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2139999999999998e-06 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.382 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48784 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610867+0000", 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010070050000000001, 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076516099999999997, 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48784 2024-09-21T22:16:34.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610867+0000", 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610867+0000", 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610867+0000", 2024-09-21T22:16:34.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610869+0000", 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.804e-06 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610875+0000", 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610879+0000", 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5029999999999999e-06 2024-09-21T22:16:34.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48816 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.615046+0000", 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9968281, 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034988760000000002, 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48816 2024-09-21T22:16:34.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615046+0000", 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615046+0000", 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615046+0000", 2024-09-21T22:16:34.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5600000000000002e-07 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615047+0000", 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1790000000000001e-06 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615050+0000", 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9500000000000001e-06 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615053+0000", 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4590000000000001e-06 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48516 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603221+0000", 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0086526060000000002, 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01534959, 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48516 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603221+0000", 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603221+0000", 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603222+0000", 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603223+0000", 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9439999999999999e-06 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603229+0000", 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2440000000000001e-06 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603233+0000", 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3980000000000001e-06 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48548 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604090+0000", 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.007784109, 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014524017, 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.392 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48548 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604090+0000", 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604090+0000", 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604090+0000", 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604092+0000", 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0250000000000001e-06 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604098+0000", 2024-09-21T22:16:34.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.614e-06 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604103+0000", 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6619999999999996e-06 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48581 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604829+0000", 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0070448259999999997, 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013831477, 2024-09-21T22:16:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48581 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604829+0000", 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604829+0000", 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604829+0000", 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.65e-07 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604831+0000", 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.841e-06 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604837+0000", 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1249999999999998e-06 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604842+0000", 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.398 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48613 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605614+0000", 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062596400000000003, 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013094554, 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48613 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605614+0000", 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605614+0000", 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605614+0000", 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.53e-07 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605616+0000", 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605622+0000", 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5949999999999998e-06 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605627+0000", 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1660000000000002e-06 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48645 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606123+0000", 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057507970000000002, 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012630997999999999, 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48645 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606123+0000", 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606123+0000", 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606123+0000", 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606124+0000", 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.057e-06 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606127+0000", 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.796e-06 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606130+0000", 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48753 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606637+0000", 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005236475, 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012165148000000001, 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48753 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606637+0000", 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606637+0000", 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606638+0000", 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4299999999999999e-07 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606639+0000", 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8619999999999999e-06 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606643+0000", 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7510000000000002e-06 2024-09-21T22:16:34.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606646+0000", 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5979999999999999e-06 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48785 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610885+0000", 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000988589, 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079631000000000007, 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48785 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610885+0000", 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610885+0000", 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610886+0000", 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610887+0000", 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9350000000000001e-06 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610896+0000", 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3359999999999995e-06 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610901+0000", 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8629999999999999e-06 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48817 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.615055+0000", 2024-09-21T22:16:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9968185, 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003837277, 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48817 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615055+0000", 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.615055+0000", 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616774+0000", 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017188030000000001 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616778+0000", 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0330000000000002e-06 2024-09-21T22:16:34.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616786+0000", 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5989999999999996e-06 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616792+0000", 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0209999999999996e-06 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48517 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.603245+0000", 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0086285149999999998, 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015694596000000002, 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48517 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603245+0000", 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603245+0000", 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603246+0000", 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9800000000000004e-07 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603248+0000", 2024-09-21T22:16:34.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1119999999999999e-06 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603254+0000", 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.976e-06 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.603258+0000", 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5950000000000001e-06 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48549 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604108+0000", 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077656180000000002, 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014876126, 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48549 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604108+0000", 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604108+0000", 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604108+0000", 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.34e-07 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604110+0000", 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604116+0000", 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2820000000000004e-06 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604120+0000", 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3039999999999998e-06 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48582 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.604847+0000", 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0070264020000000002, 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014183579, 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48582 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604847+0000", 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604847+0000", 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604848+0000", 2024-09-21T22:16:34.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604850+0000", 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604855+0000", 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.31e-06 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.604860+0000", 2024-09-21T22:16:34.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48614 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.605633+0000", 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062411979999999999, 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013445413999999999, 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48614 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605633+0000", 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605633+0000", 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605633+0000", 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605635+0000", 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8300000000000001e-06 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605641+0000", 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5350000000000001e-06 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.605647+0000", 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.254e-06 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48646 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606133+0000", 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0057408909999999997, 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012988691, 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48646 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606133+0000", 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606133+0000", 2024-09-21T22:16:34.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606133+0000", 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.89e-07 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606135+0000", 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7069999999999999e-06 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606140+0000", 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9729999999999997e-06 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606144+0000", 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.42e-06 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48754 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.606649+0000", 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052247229999999997, 2024-09-21T22:16:34.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012520384000000001, 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48754 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606649+0000", 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606649+0000", 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606649+0000", 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606654+0000", 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.566e-06 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606657+0000", 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.264e-06 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.606660+0000", 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389999999999999e-06 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48786 3.16 3.e1145d16 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.610907+0000", 2024-09-21T22:16:34.433 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00096712999999999996, 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.008309004, 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48786 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610907+0000", 2024-09-21T22:16:34.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610907+0000", 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610907+0000", 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610909+0000", 2024-09-21T22:16:34.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610915+0000", 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0730000000000001e-06 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.610920+0000", 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5950000000000001e-06 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48818 3.16 3.4c6303d6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.616802+0000", 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9950714, 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024613119999999998, 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48818 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616802+0000", 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616802+0000", 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616803+0000", 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9800000000000004e-07 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616805+0000", 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1009999999999999e-06 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616816+0000", 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1172000000000001e-05 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.616821+0000", 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2399999999999998e-06 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.440 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:16:34.440 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 256 2024-09-21T22:16:34.440 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:34.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:16:34.441 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:34.439+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:34.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:34.542 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:34.541+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:34.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:34.678 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:34.677+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:34.744 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:34.743+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:34.787 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.869996645000001, 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:34.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44892 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1609728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.747276858, 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212790999999999, 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44892 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.793 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:34.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037225+0000", 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0240000000000001e-06 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037228+0000", 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037231+0000", 2024-09-21T22:16:34.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094342+0000", 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057111375999999998 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094386+0000", 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4069000000000001e-05 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094437+0000", 2024-09-21T22:16:34.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0937999999999999e-05 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44893 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1638400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.747264843, 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057317179000000003, 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44893 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037238+0000", 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.392e-06 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037241+0000", 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.224e-06 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037243+0000", 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2469999999999998e-06 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094462+0000", 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057218453000000002 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094503+0000", 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1247e-05 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094553+0000", 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0405999999999998e-05 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7472550280000001, 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.801 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.805 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.747245489, 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.747236649, 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:34.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:16:34.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:16:34.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7472274429999999, 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.814 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:16:34.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:16:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7472184689999999, 2024-09-21T22:16:34.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:16:34.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:16:34.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.747209564, 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7471878240000001, 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:16:34.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:34.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:16:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7471784000000001, 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:16:34.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:16:34.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7471695010000001, 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:16:34.835 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7471605480000001, 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44905 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1982464~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7456849169999999, 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057165557999999998, 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44905 2024-09-21T22:16:34.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:34.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5100000000000001e-07 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038818+0000", 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038821+0000", 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1250000000000001e-06 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038831+0000", 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0752e-05 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095858+0000", 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057026163999999997 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095903+0000", 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5030000000000001e-05 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095982+0000", 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9030999999999996e-05 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.745665805, 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.745655688, 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:34.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7456461829999999, 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:16:34.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:16:34.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7456324439999999, 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.864 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.7456231340000001, 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:16:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44917 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2351104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.040931+0000", 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.743570294, 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057312614999999997, 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44917 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040931+0000", 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040931+0000", 2024-09-21T22:16:34.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042775+0000", 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018438440000000001 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042779+0000", 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5299999999999998e-06 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:34.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042787+0000", 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0309999999999998e-06 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042798+0000", 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0351e-05 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.098088+0000", 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055290187999999997 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:34.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.098155+0000", 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7282999999999999e-05 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.098243+0000", 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8387999999999995e-05 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:34.873 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:34.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:34.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:34.873+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:34.975 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:34.974+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:35.061 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:35.061 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:35.061 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:35.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:35.076 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:35.074+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:35.122 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:35.176 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:35.174+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:35.259 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:35.260 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:35.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:35.317 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:35.316+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:35.353 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:35.353 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:35.374 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:35.374 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:35.377 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:35.376+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:35.405 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:35.405 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:35.432 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:35.432 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:35.448 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:35.449 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:35.461 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:35.462 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:35.462 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:35.489 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:35.490 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:35.489+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:35.512 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:35.513 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:35.540 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:35.540 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:35.587 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:35.588 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:35.597 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:35.596+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:35.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:35.680 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:35.679+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:35.728 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:35.729 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:35.740 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:35.784 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:35.782+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:35.882 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:35.880+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:35.883 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:35.883 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:35.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:35.894 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:16:35.983 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:35.981+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:36.058 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:36.058 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:36.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:36.112 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:36.110+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:36.185 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:36.183+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:36.235 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:36.235 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:36.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:36.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:36.284+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:36.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:36.385+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:36.407 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:36.407 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:36.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:36.488 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:36.486+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:36.537 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:36.537 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:36.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:36.589 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:36.588+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:36.690 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:36.688+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:36.716 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:36.716 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:36.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:36.811 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:36.809+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:36.886 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:36.886 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:36.892 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:36.890+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:36.897 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:36.992 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:36.991+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:37.066 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:37.066 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:37.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:37.117 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:37.116+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:37.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:37.194+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:37.243 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:37.244 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:37.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:37.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:37.294+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:37.363 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:37.364 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:37.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:37.395 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:37.394+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:37.496 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:37.494+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:37.522 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:37.522 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:37.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:37.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:37.621 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:37.620+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:37.676 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:37.676 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:37.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:37.728 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:37.727+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:37.750 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:37.750 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:37.779 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:37.779 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:37.798 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:37.797+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:37.808 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:37.808 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:37.830 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:37.830 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:37.855 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:37.856 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:37.873 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.96150763, 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.874 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:37.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.958885557000002, 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:37.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14147 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1867776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.673434495999999, 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015400951, 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.885 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14147 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198257+0000", 2024-09-21T22:16:37.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:16:37.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198260+0000", 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.576e-06 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198266+0000", 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198270+0000", 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.42e-06 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213525+0000", 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015254304 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213593+0000", 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8192e-05 2024-09-21T22:16:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213658+0000", 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-05 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14148 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1949696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.673414882000003, 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015536743, 2024-09-21T22:16:37.890 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14148 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198279+0000", 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:37.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198285+0000", 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198290+0000", 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5759999999999999e-06 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213689+0000", 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015398719999999999 2024-09-21T22:16:37.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213735+0000", 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6873999999999999e-05 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213813+0000", 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8047999999999995e-05 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14149 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2031616~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.673396461999999, 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015749758999999999, 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14149 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:37.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198297+0000", 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198303+0000", 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198317+0000", 2024-09-21T22:16:37.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-05 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213846+0000", 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015529685 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213929+0000", 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2341000000000003e-05 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214045+0000", 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116208 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.673367757000001, 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:37.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.673348863000001, 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:37.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.673325749, 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.672651561999999, 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:37.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14285 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3751936~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:37.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.652248088, 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015470901, 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14285 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219443+0000", 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219444+0000", 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3099999999999999e-07 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219445+0000", 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1349999999999999e-06 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219449+0000", 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9360000000000001e-06 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219453+0000", 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1629999999999998e-06 2024-09-21T22:16:37.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234705+0000", 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015251740999999999 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234797+0000", 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2108000000000006e-05 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234914+0000", 2024-09-21T22:16:37.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117587 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14286 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3833856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.652232951999999, 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015717103999999999, 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.922 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14286 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219461+0000", 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219467+0000", 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219471+0000", 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2640000000000002e-06 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234983+0000", 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015511680999999999 2024-09-21T22:16:37.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235069+0000", 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5778000000000004e-05 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235176+0000", 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107092 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14287 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.652216566999996, 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015894090999999999, 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14287 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6800000000000002e-07 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219477+0000", 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.362e-06 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219480+0000", 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1700000000000001e-06 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219482+0000", 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.475e-06 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235247+0000", 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015765000000000001 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235298+0000", 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0577e-05 2024-09-21T22:16:37.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235369+0000", 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1239e-05 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.652206307999997, 2024-09-21T22:16:37.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:37.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.652191199000001, 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:37.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:37.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.652172905, 2024-09-21T22:16:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:37.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.651516170000001, 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.945 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.671032873000001, 2024-09-21T22:16:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:16:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.203572954999999, 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:37.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:16:37.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.503842923000001, 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.961 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:16:37.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.503796397999999, 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:37.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:37.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:37.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:37.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:16:37.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:16:37.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:16:37.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:37.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:37.974 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:37.974 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:16:37.974 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:16:37.974 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:16:37.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-21T22:16:37.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:16:37.976 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:37.976 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:37.977 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:37.977 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:37.977 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:37.978 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:37.978 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:37.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:37.974+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:38.076 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:38.074+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:38.177 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:38.176+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:38.180 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:38.180 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:38.180 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:38.180 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:38.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:38.278 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:38.276+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:38.369 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:38.369 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:38.369 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:38.370 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:38.379 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:38.377+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:38.382 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:38.423 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-21T22:16:38.422+0000 7f810b4c5640 -1 mon.a@0(leader).osd e80 definitely_dead 0 2024-09-21T22:16:38.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:38.479+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:38.527 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62618 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2596864~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2275292260000001, 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046851039999999997, 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62618 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297855+0000", 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297861+0000", 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-09-21T22:16:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297869+0000", 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4229999999999999e-06 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344498+0000", 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046629275999999997 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344580+0000", 2024-09-21T22:16:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.229e-05 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344704+0000", 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012379399999999999 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62619 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2625536~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.227506295, 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047029327000000003, 2024-09-21T22:16:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62619 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297878+0000", 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297884+0000", 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8420000000000001e-06 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297889+0000", 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0529999999999997e-06 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344750+0000", 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046860589000000001 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344799+0000", 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9259999999999999e-05 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344905+0000", 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106023 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62620 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2654208~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2274866499999999, 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047262419999999999, 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62620 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297896+0000", 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297900+0000", 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297906+0000", 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0499999999999997e-06 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297911+0000", 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6070000000000001e-06 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344949+0000", 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047038468999999999 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345037+0000", 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7664999999999995e-05 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345158+0000", 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121206 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62621 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2682880~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.227465676, 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047537283, 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62621 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297917+0000", 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:16:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297919+0000", 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297925+0000", 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1970000000000001e-06 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297930+0000", 2024-09-21T22:16:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5619999999999997e-06 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345251+0000", 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047321410000000001 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345344+0000", 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3447000000000002e-05 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345454+0000", 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010932700000000001 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62622 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2711552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2274441449999998, 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047769796000000003, 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62622 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297941+0000", 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.137e-06 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297946+0000", 2024-09-21T22:16:38.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297951+0000", 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345499+0000", 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047547865000000002 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345601+0000", 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101671 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345708+0000", 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107141 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62623 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2740224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:38.549 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.227419936, 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047987992, 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62623 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297963+0000", 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297971+0000", 2024-09-21T22:16:38.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9009999999999994e-06 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297977+0000", 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5590000000000002e-06 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297989+0000", 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.183e-05 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345742+0000", 2024-09-21T22:16:38.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047753035999999999 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345846+0000", 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103859 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345950+0000", 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104388 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62624 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2768896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2273857160000001, 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048201194000000003, 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62624 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297997+0000", 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297999+0000", 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2620000000000001e-06 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298005+0000", 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298011+0000", 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1789999999999999e-06 2024-09-21T22:16:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345994+0000", 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983959 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346078+0000", 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3830000000000002e-05 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346198+0000", 2024-09-21T22:16:38.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119311 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62625 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2797568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2271528429999998, 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048206511, 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62625 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298230+0000", 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298233+0000", 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.371e-06 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298240+0000", 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1790000000000002e-06 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298253+0000", 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2186e-05 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346236+0000", 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983499999999998 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346318+0000", 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2273000000000003e-05 2024-09-21T22:16:38.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346436+0000", 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011741199999999999 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62626 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2826240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2271181580000001, 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048414997000000001, 2024-09-21T22:16:38.562 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62626 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298267+0000", 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4109999999999999e-06 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298278+0000", 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1399999999999999e-05 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298283+0000", 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1919999999999996e-06 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346477+0000", 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048193998000000002 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346529+0000", 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1561999999999999e-05 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346679+0000", 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149973 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.566 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62627 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2854912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2270895550000001, 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048814124, 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62627 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298295+0000", 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298302+0000", 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3060000000000003e-06 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298306+0000", 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6820000000000002e-06 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346724+0000", 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048417610999999999 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346818+0000", 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3733000000000005e-05 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347107+0000", 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028912000000000002 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62628 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2270646530000002, 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048832672000000001, 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62628 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298318+0000", 2024-09-21T22:16:38.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298320+0000", 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1239999999999999e-06 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298326+0000", 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8220000000000003e-06 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298331+0000", 2024-09-21T22:16:38.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347139+0000", 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048808782000000002 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347150+0000", 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0672e-05 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62629 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2270456780000001, 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048848529000000002, 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62629 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298337+0000", 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298339+0000", 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298345+0000", 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298350+0000", 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347177+0000", 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048826889999999998 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347185+0000", 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62630 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2270235700000001, 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048855136, 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62630 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298361+0000", 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298367+0000", 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298372+0000", 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347206+0000", 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048834223000000003 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347214+0000", 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8639999999999996e-06 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62631 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:38.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2268291100000002, 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048836962999999997, 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62631 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298554+0000", 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298557+0000", 2024-09-21T22:16:38.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.145e-06 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298570+0000", 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2870999999999999e-05 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298575+0000", 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7570000000000001e-06 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347379+0000", 2024-09-21T22:16:38.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048803199999999998 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347390+0000", 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1415e-05 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62632 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2267956619999998, 2024-09-21T22:16:38.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048882087999999997, 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62632 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:38.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298587+0000", 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298590+0000", 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6129999999999998e-06 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298601+0000", 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1517e-05 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298606+0000", 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8060000000000002e-06 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347417+0000", 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048811326000000002 2024-09-21T22:16:38.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347469+0000", 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378999999999997e-05 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62633 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.226767223, 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048891830999999997, 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62633 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298618+0000", 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298624+0000", 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999998e-06 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298634+0000", 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347498+0000", 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863908999999997 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347507+0000", 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8829999999999995e-06 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62634 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2267414830000001, 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048897406999999997, 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62634 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298643+0000", 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-06 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298649+0000", 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298654+0000", 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.831e-06 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347530+0000", 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048875952 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347538+0000", 2024-09-21T22:16:38.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8059999999999995e-06 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62635 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2267221269999999, 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.04890684, 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62635 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298685+0000", 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4230999999999999e-05 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298691+0000", 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.562e-06 2024-09-21T22:16:38.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298696+0000", 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347560+0000", 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863986999999998 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347567+0000", 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.579e-06 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62636 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.226676206, 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048894625999999997, 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62636 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298709+0000", 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298714+0000", 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298719+0000", 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347592+0000", 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048872916000000002 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347601+0000", 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5879999999999998e-06 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62637 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2266523149999999, 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048904669999999997, 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62637 2024-09-21T22:16:38.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298732+0000", 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298738+0000", 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298745+0000", 2024-09-21T22:16:38.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6710000000000002e-06 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347627+0000", 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048881775000000002 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347634+0000", 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.926e-06 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.611 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:38.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:38.612 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:38.610+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:38.713 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:38.712+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:38.756 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:38.756 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:38.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:38.814 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:38.813+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:38.866 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:38.867 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:38.867 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:38.867 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:38.867 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:38.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:38.898 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:16:38.898 INFO:teuthology.orchestra.run.smithi134.stderr:marked out osd.4. 2024-09-21T22:16:38.915 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:38.913+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:38.986 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.069979324000002, 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44892 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1609728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9472595369999999, 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212790999999999, 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44892 2024-09-21T22:16:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037224+0000", 2024-09-21T22:16:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037225+0000", 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0240000000000001e-06 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037228+0000", 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037231+0000", 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094342+0000", 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057111375999999998 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094386+0000", 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4069000000000001e-05 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094437+0000", 2024-09-21T22:16:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0937999999999999e-05 2024-09-21T22:16:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44893 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1638400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9472475219999996, 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057317179000000003, 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44893 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037238+0000", 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.392e-06 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037241+0000", 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.224e-06 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037243+0000", 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2469999999999998e-06 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094462+0000", 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057218453000000002 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094503+0000", 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1247e-05 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094553+0000", 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0405999999999998e-05 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9472377070000002, 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9472281679999996, 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:16:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9472193280000001, 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:16:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:16:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9472101219999995, 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:16:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9472011479999995, 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9471922429999999, 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:16:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9471705029999997, 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:16:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:16:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9471610789999998, 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:16:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:16:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9471521799999998, 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9471432269999998, 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:16:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44905 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1982464~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9456675959999998, 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057165557999999998, 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44905 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038816+0000", 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5100000000000001e-07 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038818+0000", 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038821+0000", 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1250000000000001e-06 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038831+0000", 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0752e-05 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095858+0000", 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057026163999999997 2024-09-21T22:16:39.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095903+0000", 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5030000000000001e-05 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095982+0000", 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9030999999999996e-05 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9456484840000003, 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:16:39.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:16:39.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.051 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9456383669999999, 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:39.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:16:39.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9456288619999995, 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.059 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9456151229999996, 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.060 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:39.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:16:39.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:16:39.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:16:39.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.064 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9456058130000002, 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:16:39.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:16:39.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44917 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2351104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.040931+0000", 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9435529730000001, 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057312614999999997, 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:39.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44917 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040931+0000", 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040931+0000", 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042775+0000", 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018438440000000001 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042779+0000", 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5299999999999998e-06 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042787+0000", 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0309999999999998e-06 2024-09-21T22:16:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.042798+0000", 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0351e-05 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.098088+0000", 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055290187999999997 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.098155+0000", 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7282999999999999e-05 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.098243+0000", 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8387999999999995e-05 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.073 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:39.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:39.075 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:39.073+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:39.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:39.174+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:39.220 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:39.220 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:39.220 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:39.220 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:39.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:39.276 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:39.275+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:39.371 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:39.371 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:39.376 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:39.375+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:39.379 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:39.477 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:39.476+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:39.524 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.021678594000001, 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:16:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:16:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.006495135000002, 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.995048697000001, 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:16:39.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:16:39.537 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.475142357999999, 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:39.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:16:39.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.313207552000001, 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:16:39.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.545 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9187 3.0 e42/23 3:057833b6:::rbd_data.1185acca6c1f.0000000000000004:head v 42'223, mlcod=42'221)", 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.577715765999997, 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003477997, 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7100000000000001e-07 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945256+0000", 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5610000000000001e-06 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945261+0000", 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5290000000000002e-06 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945264+0000", 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.078e-06 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945304+0000", 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0345000000000001e-05 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945326+0000", 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1733999999999999e-05 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948698+0000", 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033719520000000001 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948732+0000", 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3627000000000002e-05 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.549 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.444961468999999, 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:12256 3.4 e50/23 3:22ba8708:::rbd_data.1185fc79843.0000000000000007:head v 50'45, mlcod=42'43)", 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.536249718000001, 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034474280000000002, 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.554 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986721+0000", 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.178e-06 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987147+0000", 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042672899999999999 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987162+0000", 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4619e-05 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987171+0000", 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7900000000000005e-06 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987229+0000", 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8338000000000003e-05 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987251+0000", 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2140000000000001e-05 2024-09-21T22:16:39.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990117+0000", 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028654069999999999 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990167+0000", 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0226999999999999e-05 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.389873706000003, 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:16:39.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:16:39.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.118781017000003, 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:16:39.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:16:39.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.113874443, 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:16:39.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:16:39.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.110663844000001, 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:16:39.575 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.105642146999998, 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.103654814999999, 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:16:39.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:16:39.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.579801224000001, 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:39.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:16:39.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:40247 3.0 e71/23 3:0688b99e:::rbd_data.118542b14bcd.0000000000000281:head v 71'358, mlcod=71'356)", 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.28859201, 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039211389999999997, 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234378+0000", 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9500000000000001e-07 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234387+0000", 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2599999999999994e-06 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234398+0000", 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234405+0000", 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234460+0000", 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4975999999999997e-05 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234482+0000", 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1407e-05 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238263+0000", 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037812039999999998 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238298+0000", 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5419000000000001e-05 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:16:39.592 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5366396130000002, 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:39.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:16:39.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42362 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'145, mlcod=73'141)", 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5358187450000003, 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033865950000000001, 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0200000000000002e-07 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987156+0000", 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8609999999999997e-06 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987167+0000", 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0946e-05 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987173+0000", 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2650000000000002e-06 2024-09-21T22:16:39.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987216+0000", 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2908999999999999e-05 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987232+0000", 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5699e-05 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990506+0000", 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032747129999999998 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990537+0000", 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0700000000000001e-05 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5351388719999992, 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:16:39.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:39.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:45992 3.16 e76/63 3:6be7cafa:::rbd_data.1185af582f87.0000000000000002:head v 76'119, mlcod=74'117)", 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.2551047940000002, 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038321589999999999, 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:39.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267865+0000", 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9500000000000002e-07 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268183+0000", 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000318239 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268202+0000", 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8732e-05 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:39.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268210+0000", 2024-09-21T22:16:39.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7810000000000005e-06 2024-09-21T22:16:39.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268292+0000", 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1990000000000006e-05 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268316+0000", 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3915999999999999e-05 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271655+0000", 2024-09-21T22:16:39.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00333892 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271697+0000", 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1986000000000001e-05 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:39.611 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:39.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:39.613 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:39.611+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:39.713 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:39.712+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:39.726 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:39.727 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:39.727 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:39.727 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:39.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:39.820 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:39.818+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:39.880 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:39.880 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:39.880 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:39.880 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:39.881 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:39.889 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:39.915 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:39.914+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:39.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:40.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:40.022+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:40.042 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.476112249000003, 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.043 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:40.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.047 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.476070243999999, 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:16:40.051 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.475972781999999, 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.052 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:16:40.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.475917725999999, 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:16:40.056 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:16:40.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:16:40.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.060 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.475875719999998, 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:16:40.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.475815122, 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.475792929000001, 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:16:40.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.474888122000003, 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.074 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:16:40.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.519453390000002, 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:16:40.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:16:40.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.516314147999999, 2024-09-21T22:16:40.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.088 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2737 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.813283669999997, 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010753749, 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2737 2024-09-21T22:16:40.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0999999999999997e-07 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227036+0000", 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227046+0000", 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227051+0000", 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000004e-06 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227099+0000", 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7920000000000002e-05 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227152+0000", 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2753000000000001e-05 2024-09-21T22:16:40.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.228909+0000", 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017568519999999999 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237712+0000", 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088031670000000006 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237722+0000", 2024-09-21T22:16:40.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0478e-05 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237750+0000", 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7885000000000002e-05 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237784+0000", 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4186000000000001e-05 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.423300523000002, 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:16:40.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:16:40.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.467435231000003, 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:16:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.106 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.361596681000002, 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:16:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:16:40.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:40.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:40.112 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.360580106, 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:16:40.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:40.118 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.360212339999997, 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:40.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:16:40.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:16:40.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.841870041, 2024-09-21T22:16:40.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:16:40.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:16:40.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:40.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.130 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.83999416, 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:16:40.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:16:40.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 11.570251864999999, 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.135 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:16:40.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:16:40.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.140 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 11.454482033, 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:40.148 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:40.148 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:40.149 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:40.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:40.149 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:40.150 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:40.150 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:40.146+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:40.152 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:40.152 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:40.168 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:40.168 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:40.185 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:40.186 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:40.203 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:40.203 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:40.219 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:40.219 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:40.256 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:40.256 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:40.264 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:40.271 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:40.270+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:40.350 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:40.349+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:40.368 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:40.368 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:40.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:40.461 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:40.460+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:40.520 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:40.520 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:40.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:40.553 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:40.552+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:40.654 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:40.652+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:40.672 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:40.673 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:40.681 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:40.754 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:40.753+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:40.785 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:40.785 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:40.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:40.855 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:40.854+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:40.897 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:40.897 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:40.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:40.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:16:40.953 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-21T22:16:40.956 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:40.955+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:41.055 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:41.055 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:41.056 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:41.055+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:41.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:41.158 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:41.157+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:41.194 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:41.194 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:41.203 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:41.253 INFO:teuthology.orchestra.run.smithi134.stdout:3104 write 0xd340b0e thru 0xd34aff7 (0xa4ea bytes) 2024-09-21T22:16:41.272 INFO:teuthology.orchestra.run.smithi134.stdout:3105 write 0x214c24e thru 0x2159811 (0xd5c4 bytes) 2024-09-21T22:16:41.277 INFO:teuthology.orchestra.run.smithi134.stdout:3107 read 0xcfacf6f thru 0xcfb8244 (0xb2d6 bytes) 2024-09-21T22:16:41.277 INFO:teuthology.orchestra.run.smithi134.stdout:3108 read 0xafb72d thru 0xb05a57 (0xa32b bytes) 2024-09-21T22:16:41.278 INFO:teuthology.orchestra.run.smithi134.stdout:3109 punch from 0x64d170d to 0x64dc9d3, (0xb2c6 bytes) 2024-09-21T22:16:41.287 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:41.287+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:41.292 INFO:teuthology.orchestra.run.smithi134.stdout:3110 trunc from 0xd34aff8 to 0x18f6fd7 2024-09-21T22:16:41.360 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:41.358+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:41.372 INFO:teuthology.orchestra.run.smithi134.stdout:3111 clone 15 order 21 su 1048576 sc 13 2024-09-21T22:16:41.375 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:41.375 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:41.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:41.461 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:41.459+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:41.487 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:41.488 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:41.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:41.562 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:41.561+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:41.640 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:41.640 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:41.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:41.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:41.691+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:41.751 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:41.751 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:41.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:41.763 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:41.763+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:41.864 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:41.864+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:41.883 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:16:41.915 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:41.915 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:41.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:41.965 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:41.964+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:42.066 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:42.065+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:42.067 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:42.067 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:42.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:42.167 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:42.166+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:42.179 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:42.179 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:42.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:42.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:42.268 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:42.267+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:42.335 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:42.335 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:42.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:42.350 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:42.351 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:42.368 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:42.367+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:42.368 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:42.368 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:42.384 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:42.384 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:42.402 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:42.402 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:42.419 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:42.419 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:42.436 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:42.436 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:42.450 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:42.450 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:42.453 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:42.453 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:42.459 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:42.470 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:42.470 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:42.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:42.469+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:42.570 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:42.569+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:42.573 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.657344424000001, 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:42.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:42.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:42.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44893 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1638400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5346126220000009, 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057317179000000003, 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44893 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:42.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037238+0000", 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.392e-06 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037241+0000", 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.224e-06 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037243+0000", 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2469999999999998e-06 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094462+0000", 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057218453000000002 2024-09-21T22:16:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094503+0000", 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1247e-05 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094553+0000", 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0405999999999998e-05 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5346028070000006, 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:16:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345932680000001, 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:16:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345844280000005, 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:16:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345752220000008, 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:16:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:16:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345662480000009, 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345573429999995, 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345356030000001, 2024-09-21T22:16:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:16:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:16:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345261790000002, 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:16:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345172799999993, 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5345083269999993, 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:16:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:16:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5330135840000008, 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5330034670000003, 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5329939620000008, 2024-09-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:16:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5329802229999991, 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5329709129999998, 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6729599139999998, 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:16:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:16:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6693384930000001, 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:16:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0868679590000001, 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:16:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:42.670 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:42.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:42.671 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:42.670+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:42.772 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:42.771+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:42.814 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:42.815 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:42.815 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:42.815 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:42.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:42.872 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:42.871+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:42.934 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:42.935 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:42.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:42.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:42.984+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:43.074 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:43.074+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.584724254000001, 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.088 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:16:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.569540795000002, 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.093 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:16:43.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.558094357000002, 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:16:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2625 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'40, mlcod=34'38)", 2024-09-21T22:16:43.102 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.038188018, 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035041069999999998, 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047827+0000", 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047828+0000", 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.159e-06 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047838+0000", 2024-09-21T22:16:43.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7580000000000004e-06 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047854+0000", 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5897999999999999e-05 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047863+0000", 2024-09-21T22:16:43.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8419999999999994e-06 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047919+0000", 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6501e-05 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.047941+0000", 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1679999999999999e-05 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051294+0000", 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033528239999999999 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.051331+0000", 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7444999999999998e-05 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.107 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2722 3.0 e34/23 3:053415b0:::rbd_object_map.118555b0e245:head v 34'65, mlcod=34'63)", 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.876253212000002, 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033911229999999998, 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209762+0000", 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209763+0000", 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209780+0000", 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6639000000000001e-05 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209798+0000", 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8502e-05 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209811+0000", 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2754e-05 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209871+0000", 2024-09-21T22:16:43.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9876000000000001e-05 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.209893+0000", 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2362e-05 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213118+0000", 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032243269999999999 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:48.213153+0000", 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5305999999999997e-05 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9187 3.0 e42/23 3:057833b6:::rbd_data.1185acca6c1f.0000000000000004:head v 42'223, mlcod=42'221)", 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.140761425999997, 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003477997, 2024-09-21T22:16:43.112 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945254+0000", 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7100000000000001e-07 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945256+0000", 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5610000000000001e-06 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945261+0000", 2024-09-21T22:16:43.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5290000000000002e-06 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945264+0000", 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.078e-06 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945304+0000", 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0345000000000001e-05 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.945326+0000", 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1733999999999999e-05 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948698+0000", 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033719520000000001 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:56.948732+0000", 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3627000000000002e-05 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.008007128999999, 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:12256 3.4 e50/23 3:22ba8708:::rbd_data.1185fc79843.0000000000000007:head v 50'45, mlcod=42'43)", 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.099295378000001, 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034474280000000002, 2024-09-21T22:16:43.121 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986720+0000", 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.986721+0000", 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.178e-06 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987147+0000", 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042672899999999999 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987162+0000", 2024-09-21T22:16:43.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4619e-05 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987171+0000", 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7900000000000005e-06 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987229+0000", 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8338000000000003e-05 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.987251+0000", 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2140000000000001e-05 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990117+0000", 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028654069999999999 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:04.990167+0000", 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0226999999999999e-05 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.952919366000003, 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:16:43.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.681826676999997, 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.130 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:16:43.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.676920103, 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:43.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:43.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.673709504000001, 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:16:43.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.668687806999998, 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:16:43.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.666700474999999, 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:16:43.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:16:43.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.142846884000001, 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:43.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:16:43.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:16:43.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:40247 3.0 e71/23 3:0688b99e:::rbd_data.118542b14bcd.0000000000000281:head v 71'358, mlcod=71'356)", 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.851637670000001, 2024-09-21T22:16:43.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039211389999999997, 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:43.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234378+0000", 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9500000000000001e-07 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234387+0000", 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2599999999999994e-06 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234398+0000", 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234405+0000", 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234460+0000", 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4975999999999997e-05 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234482+0000", 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1407e-05 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238263+0000", 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037812039999999998 2024-09-21T22:16:43.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238298+0000", 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5419000000000001e-05 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.099685273, 2024-09-21T22:16:43.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:16:43.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42362 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'145, mlcod=73'141)", 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.098864405, 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033865950000000001, 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987151+0000", 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0200000000000002e-07 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987156+0000", 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8609999999999997e-06 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987167+0000", 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0946e-05 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987173+0000", 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2650000000000002e-06 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987216+0000", 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2908999999999999e-05 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987232+0000", 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5699e-05 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990506+0000", 2024-09-21T22:16:43.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032747129999999998 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990537+0000", 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0700000000000001e-05 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.098184531999999, 2024-09-21T22:16:43.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:43.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:16:43.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:16:43.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:45992 3.16 e76/63 3:6be7cafa:::rbd_data.1185af582f87.0000000000000002:head v 76'119, mlcod=74'117)", 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.8181504539999995, 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038321589999999999, 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267865+0000", 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9500000000000002e-07 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268183+0000", 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000318239 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268202+0000", 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8732e-05 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268210+0000", 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7810000000000005e-06 2024-09-21T22:16:43.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268292+0000", 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1990000000000006e-05 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268316+0000", 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3915999999999999e-05 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271655+0000", 2024-09-21T22:16:43.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00333892 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271697+0000", 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1986000000000001e-05 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:43.180 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:43.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:43.182 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:43.181+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:43.283 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:43.282+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:43.291 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:43.291 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:43.291 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:43.291 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:43.300 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:43.384 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:43.383+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:43.444 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:43.444 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:43.444 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:43.444 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:43.444 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:43.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:43.484 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:43.483+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:43.558 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.992289202000002, 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.992247196999998, 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:16:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:16:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.992149734999998, 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.992094678999997, 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:16:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:16:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.992052673000003, 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.991992074999999, 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:16:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:16:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.991969881999999, 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:16:43.585 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:16:43.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.991065075000002, 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.590 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:16:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.035630343000001, 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:16:43.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:16:43.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.032491100999998, 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:16:43.601 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:16:43.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2737 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.329460623000003, 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010753749, 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.606 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2737 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227031+0000", 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0999999999999997e-07 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227036+0000", 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227046+0000", 2024-09-21T22:16:43.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0268999999999999e-05 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227051+0000", 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000004e-06 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227099+0000", 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7920000000000002e-05 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.227152+0000", 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2753000000000001e-05 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.228909+0000", 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017568519999999999 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237712+0000", 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088031670000000006 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237722+0000", 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0478e-05 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237750+0000", 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7885000000000002e-05 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:48.237784+0000", 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4186000000000001e-05 2024-09-21T22:16:43.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.939477476, 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:16:43.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.983612184000002, 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.618 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:16:43.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:16:43.623 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.877773634, 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.624 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:16:43.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:16:43.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.876757058999999, 2024-09-21T22:16:43.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:16:43.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:16:43.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.876389293000003, 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.637 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.642 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.358046993999999, 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:16:43.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:16:43.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.356171112999998, 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:16:43.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 15.086428818, 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:16:43.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:16:43.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.970658986, 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:43.658 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:43.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:16:43.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:43.663 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:43.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:43.665 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:43.664+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:43.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:43.764+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:43.769 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:43.769 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:43.769 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:43.769 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:43.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:43.866 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:43.866+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:43.880 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:43.881 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:43.881 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:43.881 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:43.881 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:43.890 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:43.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:16:43.921 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:16:43.922 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:16:43.922 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-21T22:16:43.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-21T22:16:43.975 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:43.975+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095562176999998, 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:16:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095542006000002, 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095523059999998, 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:16:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095503696999998, 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:16:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095471048999997, 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:16:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095419882000002, 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:16:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:16:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095393209999997, 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:16:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095368411000003, 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:16:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095337463, 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:16:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:16:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095313245, 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:16:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095288893000003, 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:16:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:16:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095264649999997, 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095234914999999, 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:16:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:16:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.095199444999999, 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:16:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:16:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 10.05766824, 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:16:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.8648005810000008, 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:16:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.8594340490000008, 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:16:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:16:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:16:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.8418692560000007, 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:16:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:16:44.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.125 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.8094882630000004, 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:16:44.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.7616848170000008, 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.131 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:44.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.132 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:16:44.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.139 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.140 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:44.141 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:44.141 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:44.140+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:44.241 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:44.241+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:44.263 INFO:tasks.ceph.mon.a.smithi134.stderr:2024-09-21T22:16:44.262+0000 7f810b4c5640 -1 mon.a@0(leader).osd e86 definitely_dead 0 2024-09-21T22:16:44.286 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:44.286 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:44.286 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:44.287 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:44.295 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:44.380 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:44.379+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:44.440 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:44.440 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:44.440 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:44.440 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:44.440 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:44.443 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:44.442+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:44.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:44.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:44.544 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:44.543+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:44.595 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:44.595 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.462399456, 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.596 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:16:44.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:16:44.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:44.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.433339635000003, 2024-09-21T22:16:44.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:16:44.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:16:44.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:16:44.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 48.233125889, 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:16:44.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.613 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 48.081887072999997, 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:16:44.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.678944770000001, 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:16:44.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:16:44.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:16:44.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.678881914999998, 2024-09-21T22:16:44.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:16:44.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:16:44.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:44.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:16:44.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:16:44.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.634 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205377937000002, 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:16:44.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:16:44.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.639 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205355683000001, 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:16:44.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205331268999998, 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:16:44.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:16:44.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205301804000001, 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.649 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:16:44.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:16:44.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205274660000001, 2024-09-21T22:16:44.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:44.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:16:44.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.657 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205255557999998, 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.658 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205231406000003, 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.662 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205207627999997, 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.666 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:44.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:16:44.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:16:44.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205188653, 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:44.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.674 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205169902999998, 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:16:44.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:16:44.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:44.679 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205137819999997, 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:44.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:16:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:16:44.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205124832999999, 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:16:44.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.205114584, 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.688 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:44.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.692 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97073 3.d 3:b30a3fcc:::rbd_data.11859a4b084.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.668555224, 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011897978999999999, 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97073 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:44.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924748+0000", 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.147e-06 2024-09-21T22:16:44.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928499+0000", 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514219999999999 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928513+0000", 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4032000000000001e-05 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928520+0000", 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3409999999999997e-06 2024-09-21T22:16:44.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928582+0000", 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1748000000000006e-05 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928728+0000", 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000145523 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928881+0000", 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015284599999999999 2024-09-21T22:16:44.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.932050+0000", 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031697330000000001 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936518+0000", 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044676120000000001 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936587+0000", 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8783999999999997e-05 2024-09-21T22:16:44.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936644+0000", 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7791000000000003e-05 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:44.698 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:44.700 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:44.700 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:44.699+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:44.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:16:44.781+0000 7fb7d1214640 0 --2- 172.21.15.134:0/815496775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7cc13f570 0x7fb7cc1450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-21T22:16:44.800 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:44.799+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:44.805 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:44.805 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:44.822 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:44.822 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:44.838 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:44.838 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:44.845 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:44.845 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:44.845 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:44.845 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:44.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:44.854 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:44.870 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:44.870 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:44.888 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:44.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:44.900+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:44.904 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:44.922 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:44.924 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:16:44.929 INFO:teuthology.orchestra.run.smithi134.stderr:marked in osd.4. 2024-09-21T22:16:44.950 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-21T22:16:44.965 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:44.965 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:44.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:45.002 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:45.002+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:45.078 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:45.078 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:45.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:45.132 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:45.131+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:45.191 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:45.191 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:45.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:45.205 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:45.204+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:45.305 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:45.305+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:45.343 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:45.344 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:45.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:45.407 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:45.406+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:45.456 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:45.456 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:45.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:45.508 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:45.507+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:45.609 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:45.609 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:45.609 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:45.608+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:45.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:45.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:45.709+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:45.720 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:45.720 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:45.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:45.813 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:45.812+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:45.872 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:45.872 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:45.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:45.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:45.920+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:46.012 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:46.012+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:46.027 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:46.027 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:46.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:46.113 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:46.112+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:46.179 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:46.179 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:46.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:46.232 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:46.231+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:46.291 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:46.292 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:46.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:46.341 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:46.340+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:46.416 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:46.415+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:46.443 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:46.443 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:46.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:46.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:46.515+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:46.555 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:46.555 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:46.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:46.647 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:46.646+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:46.706 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:46.706 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:46.715 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:46.756 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:46.755+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:46.818 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:46.818+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:46.831 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:46.832 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:46.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:46.919 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:46.919+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:46.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:46.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:16:46.974 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-21T22:16:47.001 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:47.002 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:47.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:47.055 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:47.054+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:47.086 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:47.086 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:47.106 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:47.106 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:47.120 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:47.120+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:47.131 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:47.131 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:47.132 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:47.132 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:47.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:47.149 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:47.149 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:47.160 INFO:teuthology.orchestra.run.smithi134.stdout:3112 punch from 0x12ae5c7 to 0x12b7c2a, (0x9663 bytes) 2024-09-21T22:16:47.164 INFO:teuthology.orchestra.run.smithi134.stdout:3113 punch from 0xaa5434 to 0xab1398, (0xbf64 bytes) 2024-09-21T22:16:47.167 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:47.167 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:47.170 INFO:teuthology.orchestra.run.smithi134.stdout:3114 write 0x26d125b thru 0x26d763d (0x63e3 bytes) 2024-09-21T22:16:47.180 INFO:teuthology.orchestra.run.smithi134.stdout:3115 writesame 0x386b0bd thru 0x387aba0 data_size 0x2(0xfae4 bytes) 2024-09-21T22:16:47.180 INFO:teuthology.orchestra.run.smithi134.stdout:3119 clone 16 order 25 su 131072 sc 15 2024-09-21T22:16:47.186 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:47.186 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:47.203 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:47.203 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:47.221 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:47.220+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:47.222 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:47.222 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:47.299 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:47.300 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:47.300 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:47.300 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:47.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:47.353 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:47.352+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:47.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:47.422+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:47.426 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:47.427 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:47.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:47.524 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:47.523+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:47.595 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:47.595 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645932377000001, 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:16:47.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:16:47.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645912205999998, 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.600 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:16:47.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:16:47.604 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.605 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645893260000001, 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645873897000001, 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:16:47.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.613 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645841249, 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.614 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645790081999998, 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645763410000001, 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.622 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645738610999999, 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:16:47.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.628 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:16:47.629 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645707663000003, 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.630 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.632 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.633 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645683445000003, 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.635 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:16:47.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.637 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645659092999999, 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:16:47.639 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:16:47.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.641 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.64563485, 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.642 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:16:47.643 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:16:47.644 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:16:47.645 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645605115000002, 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:16:47.646 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.647 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.648 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:16:47.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.650 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.645569645000002, 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.651 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.654 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.60803844, 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.655 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:16:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:16:47.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.415170781, 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.659 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:16:47.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:16:47.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.409804249, 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:16:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:16:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.392239456, 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.668 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:16:47.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:16:47.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.672 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.359858463, 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.312055017, 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:47.677 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:47.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:16:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:47.683 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:47.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:47.685 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:47.684+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:47.785 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:47.785+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:47.789 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:47.790 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:47.790 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:47.790 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:47.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:47.887 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:47.886+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:47.902 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:47.903 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:47.903 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:47.903 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:47.903 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:47.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:47.944 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:16:47.988 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:47.987+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:48.022 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.889411897000002, 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:16:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:16:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.860352075999998, 2024-09-21T22:16:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:16:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.660138330000002, 2024-09-21T22:16:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.508899513999999, 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:16:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.105957211000003, 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:16:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:16:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.105894356, 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:16:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632390377999997, 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:16:48.062 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:16:48.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.066 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632368124000003, 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.067 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:16:48.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:48.071 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632343710000001, 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:16:48.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:16:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632314245000003, 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.080 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632287101000003, 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.081 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:48.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:16:48.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632267999, 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.086 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:16:48.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:16:48.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632243846999998, 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.090 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:16:48.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632220068999999, 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:16:48.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:16:48.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632201094000003, 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:16:48.099 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:16:48.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:16:48.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632182344, 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:16:48.104 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:16:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:16:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632150261, 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:16:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:16:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632137274000002, 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:16:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.632127025000003, 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:16:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97073 3.d 3:b30a3fcc:::rbd_data.11859a4b084.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:16:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.0955676649999999, 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011897978999999999, 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97073 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924748+0000", 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.147e-06 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928499+0000", 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514219999999999 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928513+0000", 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4032000000000001e-05 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928520+0000", 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3409999999999997e-06 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928582+0000", 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1748000000000006e-05 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928728+0000", 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000145523 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928881+0000", 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015284599999999999 2024-09-21T22:16:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.932050+0000", 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031697330000000001 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936518+0000", 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044676120000000001 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936587+0000", 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8783999999999997e-05 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936644+0000", 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7791000000000003e-05 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.128 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:48.130 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:48.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:48.129+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:48.231 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:48.230+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:48.273 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:48.273 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:48.274 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:48.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:48.332 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:48.331+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:48.386 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:48.386 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:48.386 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:48.386 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:48.386 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:48.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:48.437 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:48.436+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:48.534 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:48.533+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:48.541 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139883018000001, 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139837398999999, 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:16:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:16:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:16:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139764666, 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:16:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:16:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139717789000001, 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:16:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:16:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139653049, 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139616820000001, 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:16:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:16:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139522893000001, 2024-09-21T22:16:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:16:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139499125, 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:16:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:16:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139434253999999, 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:16:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139396631, 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139355838, 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:16:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:16:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139280377, 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:16:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139210004000001, 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:16:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:16:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:16:48.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:16:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139176329, 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.599 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139107577000001, 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.603 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.607 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.139063180999999, 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:16:48.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:16:48.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.138972233000001, 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:16:48.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.616 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.138943708999999, 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:16:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.620 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.138911415000001, 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:16:48.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:16:48.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.138873282, 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:16:48.625 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:16:48.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:16:48.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.629 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.630 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:48.631 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:48.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:48.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:48.633+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:48.735 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:48.734+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:48.747 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:48.748 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:48.748 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:48.748 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:48.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:48.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:48.834+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:48.860 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:48.860 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:48.860 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:48.860 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:48.860 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:48.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:48.953 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:48.952+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.110790940000001, 2024-09-21T22:16:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.108168867000003, 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14148 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1949696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.822698191999997, 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015536743, 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14148 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198279+0000", 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198285+0000", 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198290+0000", 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5759999999999999e-06 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213689+0000", 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015398719999999999 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213735+0000", 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6873999999999999e-05 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213813+0000", 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8047999999999995e-05 2024-09-21T22:16:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14149 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2031616~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.822679772000001, 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015749758999999999, 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14149 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198297+0000", 2024-09-21T22:16:49.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:49.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198303+0000", 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198317+0000", 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-05 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213846+0000", 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015529685 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213929+0000", 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2341000000000003e-05 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214045+0000", 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116208 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.822651067000002, 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:49.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.822632173000002, 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.048 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.822609059000001, 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:49.052 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:49.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.821934872, 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:49.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:49.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14286 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3833856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.801516262, 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015717103999999999, 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14286 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219461+0000", 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219467+0000", 2024-09-21T22:16:49.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219471+0000", 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2640000000000002e-06 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234983+0000", 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015511680999999999 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235069+0000", 2024-09-21T22:16:49.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5778000000000004e-05 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235176+0000", 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107092 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14287 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.801499876999998, 2024-09-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015894090999999999, 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14287 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6800000000000002e-07 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219477+0000", 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.362e-06 2024-09-21T22:16:49.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219480+0000", 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1700000000000001e-06 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219482+0000", 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.475e-06 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235247+0000", 2024-09-21T22:16:49.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015765000000000001 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235298+0000", 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0577e-05 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235369+0000", 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1239e-05 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.801489617999998, 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:49.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.801474509000002, 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.801456215000002, 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.800799480000002, 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.082 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:49.086 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.820316183000003, 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:16:49.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.352856265, 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:16:49.092 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:16:49.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:16:49.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:16:49.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.653126233000002, 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:49.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:49.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:16:49.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:16:49.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:16:49.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.103 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.653079708, 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:16:49.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:16:49.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:49.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:97229 3.b 3:d168bffe:::rbd_data.11859a4b084.0000000000000007:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0609616610000003, 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018200561000000001, 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 97229 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960015+0000", 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2400000000000002e-06 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960890+0000", 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087496899999999996 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960913+0000", 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2918e-05 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960932+0000", 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8484000000000001e-05 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961011+0000", 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9240999999999996e-05 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961165+0000", 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154036 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961308+0000", 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014330699999999999 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977902+0000", 2024-09-21T22:16:49.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016593469 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978092+0000", 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019035600000000001 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978169+0000", 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6588000000000006e-05 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978214+0000", 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4953000000000001e-05 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97171 3.c e86/45 3:30c3e70a:::rbd_data.11859a4b084.0000000000000005:head v 86'91, mlcod=84'89)", 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0596261589999996, 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017387495999999999, 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:49.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:49.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961350+0000", 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.47e-07 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966000+0000", 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046502469999999997 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966013+0000", 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.343e-05 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966021+0000", 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5650000000000004e-06 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966094+0000", 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2758999999999999e-05 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966119+0000", 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5287999999999999e-05 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978684+0000", 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012564745 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978736+0000", 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2614999999999997e-05 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:49.119 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:49.121 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:49.120+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:49.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:49.222 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:49.221+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:49.233 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:49.266 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:49.267 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:49.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:49.322 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:49.322+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:49.356 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:49.356 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:49.374 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:49.374 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:49.390 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:49.391 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:49.407 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:49.407 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:49.423 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:49.422+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:49.423 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:49.423 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:49.424 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:49.424 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:49.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:49.441 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:49.441 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:49.458 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:49.458 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:49.476 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:49.476 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:49.528 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:49.527+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:49.546 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:49.546 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:49.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:49.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:49.638+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:49.699 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:49.699 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:49.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:49.726 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:49.725+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:49.827 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:49.826+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:49.850 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:49.850 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:49.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:49.927 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:49.926+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:49.952 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:16:49.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:16:49.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:16:49.966 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:49.966 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:49.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:50.028 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:50.027+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:50.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:50.128+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:50.179 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:50.179 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:50.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:50.230 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:50.229+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:50.331 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:50.330+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:50.333 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:50.333 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:50.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:50.432 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:50.432+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:50.444 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:50.444 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:50.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:50.534 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:50.533+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:50.557 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:50.557 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:50.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:50.635 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:50.634+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:50.669 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:50.670 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:50.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:50.763 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:50.762+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:50.823 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:50.824 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:50.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:50.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:50.837+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:50.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:50.937+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:16:50.963 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:16:50.979 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:50.979 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:50.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:16:50.988 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:51.026 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-21T22:16:51.039 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:51.038+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:51.078 INFO:teuthology.orchestra.run.smithi134.stdout:3120 trunc from 0x387aba1 to 0x539920f 2024-09-21T22:16:51.098 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:51.098 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:51.099 INFO:teuthology.orchestra.run.smithi134.stdout:3121 write 0xa300e15 thru 0xa30c162 (0xb34e bytes) 2024-09-21T22:16:51.100 INFO:teuthology.orchestra.run.smithi134.stdout:3122 write 0x980f478 thru 0x9813090 (0x3c19 bytes) 2024-09-21T22:16:51.102 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:51.102 INFO:teuthology.orchestra.run.smithi134.stdout:3125 read 0x4ba95e9 thru 0x4bb1a63 (0x847b bytes) 2024-09-21T22:16:51.102 INFO:teuthology.orchestra.run.smithi134.stdout:3127 read 0xa2e43e thru 0xa374ed (0x90b0 bytes) 2024-09-21T22:16:51.103 INFO:teuthology.orchestra.run.smithi134.stdout:3128 read 0x64fce97 thru 0x65042cc (0x7436 bytes) 2024-09-21T22:16:51.103 INFO:teuthology.orchestra.run.smithi134.stdout:3131 writesame 0x49efd2b thru 0x49fd048 data_size 0x3d(0xd31e bytes) 2024-09-21T22:16:51.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:51.111 INFO:teuthology.orchestra.run.smithi134.stdout:3133 writesame 0xa491833 thru 0xa49ce86 data_size 0xe(0xb654 bytes) 2024-09-21T22:16:51.112 INFO:teuthology.orchestra.run.smithi134.stdout:3134 writesame 0x1a056b1 thru 0x1a0d349 data_size 0x1(0x7c99 bytes) 2024-09-21T22:16:51.136 INFO:teuthology.orchestra.run.smithi134.stdout:3135 write 0xd00ef3e thru 0xd016862 (0x7925 bytes) 2024-09-21T22:16:51.138 INFO:teuthology.orchestra.run.smithi134.stdout:3136 trunc from 0xd016863 to 0xddc5ae7 2024-09-21T22:16:51.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:51.138+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:51.144 INFO:teuthology.orchestra.run.smithi134.stdout:3137 punch from 0x8dd0607 to 0x8dda7d5, (0xa1ce bytes) 2024-09-21T22:16:51.144 INFO:teuthology.orchestra.run.smithi134.stdout:3138 punch from 0xbe135c1 to 0xbe20611, (0xd050 bytes) 2024-09-21T22:16:51.144 INFO:teuthology.orchestra.run.smithi134.stdout:3139 write 0x1eeaa92 thru 0x1ef69f3 (0xbf62 bytes) 2024-09-21T22:16:51.145 INFO:teuthology.orchestra.run.smithi134.stdout:3140 write 0xd455002 thru 0xd4572b8 (0x22b7 bytes) 2024-09-21T22:16:51.147 INFO:teuthology.orchestra.run.smithi134.stdout:3141 punch from 0x6ff1219 to 0x6ff8cf5, (0x7adc bytes) 2024-09-21T22:16:51.147 INFO:teuthology.orchestra.run.smithi134.stdout:3142 write 0xda9c663 thru 0xda9c839 (0x1d7 bytes) 2024-09-21T22:16:51.148 INFO:teuthology.orchestra.run.smithi134.stdout:3144 read 0xb71d07b thru 0xb71d4ce (0x454 bytes) 2024-09-21T22:16:51.154 INFO:teuthology.orchestra.run.smithi134.stdout:3147 writesame 0xea97499 thru 0xea9d7aa data_size 0x9(0x6312 bytes) 2024-09-21T22:16:51.164 INFO:teuthology.orchestra.run.smithi134.stdout:3148 trunc from 0xea9d7ab to 0x7da921f 2024-09-21T22:16:51.176 INFO:teuthology.orchestra.run.smithi134.stdout:3149 write 0x166e80 thru 0x175229 (0xe3aa bytes) 2024-09-21T22:16:51.186 INFO:teuthology.orchestra.run.smithi134.stdout:3150 trunc from 0x7da921f to 0xe047755 2024-09-21T22:16:51.192 INFO:teuthology.orchestra.run.smithi134.stdout:3151 punch from 0x41cd2c to 0x41f55b, (0x282f bytes) 2024-09-21T22:16:51.192 INFO:teuthology.orchestra.run.smithi134.stdout:3153 punch from 0x1f72992 to 0x1f7dddb, (0xb449 bytes) 2024-09-21T22:16:51.192 INFO:teuthology.orchestra.run.smithi134.stdout:3155 read 0x6fa1768 thru 0x6faed24 (0xd5bd bytes) 2024-09-21T22:16:51.192 INFO:teuthology.orchestra.run.smithi134.stdout:3157 punch from 0x4d382cc to 0x4d4544a, (0xd17e bytes) 2024-09-21T22:16:51.192 INFO:teuthology.orchestra.run.smithi134.stdout:3158 trunc from 0xe047755 to 0xe067292 2024-09-21T22:16:51.196 INFO:teuthology.orchestra.run.smithi134.stdout:3159 writesame 0x8fc2aa1 thru 0x8fceadd data_size 0x1(0xc03d bytes) 2024-09-21T22:16:51.221 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:51.221 INFO:teuthology.orchestra.run.smithi134.stdout:3164 writesame 0x3299f00 thru 0x32a7155 data_size 0x6d(0xd256 bytes) 2024-09-21T22:16:51.223 INFO:teuthology.orchestra.run.smithi134.stdout:3168 writesame 0xdc90ac8 thru 0xdc9866e data_size 0xd(0x7ba7 bytes) 2024-09-21T22:16:51.225 INFO:teuthology.orchestra.run.smithi134.stdout:3170 write 0x9f3f570 thru 0x9f4ba91 (0xc522 bytes) 2024-09-21T22:16:51.227 INFO:teuthology.orchestra.run.smithi134.stdout:3171 write 0x306419f thru 0x306d04b (0x8ead bytes) 2024-09-21T22:16:51.228 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:51.228 INFO:teuthology.orchestra.run.smithi134.stdout:3175 write 0x50307c3 thru 0x5032562 (0x1da0 bytes) 2024-09-21T22:16:51.240 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:51.239+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:51.245 INFO:teuthology.orchestra.run.smithi134.stdout:3176 trunc from 0xe067292 to 0xfdd477 2024-09-21T22:16:51.257 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:51.257 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:51.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:51.273 INFO:teuthology.orchestra.run.smithi134.stdout:3177 trunc from 0xfdd477 to 0xe9db3a4 2024-09-21T22:16:51.278 INFO:teuthology.orchestra.run.smithi134.stdout:3179 read 0x5b35ac1 thru 0x5b363b5 (0x8f5 bytes) 2024-09-21T22:16:51.278 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:51.278 INFO:teuthology.orchestra.run.smithi134.stdout:3182 punch from 0x5ac11b0 to 0x5acbd5a, (0xabaa bytes) 2024-09-21T22:16:51.278 INFO:teuthology.orchestra.run.smithi134.stdout:3184 writesame 0x24cd57e thru 0x24d0342 data_size 0x1(0x2dc5 bytes) 2024-09-21T22:16:51.285 INFO:teuthology.orchestra.run.smithi134.stdout:3188 writesame 0x74b812d thru 0x74b8eb3 data_size 0x1(0xd87 bytes) 2024-09-21T22:16:51.287 INFO:teuthology.orchestra.run.smithi134.stdout:3190 read 0x8d381b5 thru 0x8d479fd (0xf849 bytes) 2024-09-21T22:16:51.287 INFO:teuthology.orchestra.run.smithi134.stdout:3193 read 0x674fffa thru 0x675bb79 (0xbb80 bytes) 2024-09-21T22:16:51.295 INFO:teuthology.orchestra.run.smithi134.stdout:3195 trunc from 0xe9db3a4 to 0x8d0a413 2024-09-21T22:16:51.303 INFO:teuthology.orchestra.run.smithi134.stdout:3196 read 0x19ec189 thru 0x19fae19 (0xec91 bytes) 2024-09-21T22:16:51.303 INFO:teuthology.orchestra.run.smithi134.stdout:3197 read 0x2a1031c thru 0x2a1918e (0x8e73 bytes) 2024-09-21T22:16:51.304 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:51.309 INFO:teuthology.orchestra.run.smithi134.stdout:3201 write 0x8fcdc3e thru 0x8fcf973 (0x1d36 bytes) 2024-09-21T22:16:51.319 INFO:teuthology.orchestra.run.smithi134.stdout:3202 write 0xbe7efa0 thru 0xbe868ba (0x791b bytes) 2024-09-21T22:16:51.321 INFO:teuthology.orchestra.run.smithi134.stdout:3203 punch from 0xeaac3e to 0xeb9142, (0xe504 bytes) 2024-09-21T22:16:51.321 INFO:teuthology.orchestra.run.smithi134.stdout:3204 clone 17 order 19 su 131072 sc 5 2024-09-21T22:16:51.341 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:51.340+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:51.375 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:51.375 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:51.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:51.467 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:51.467+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:51.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:51.528 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:51.528 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:51.537 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:51.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:51.542+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:51.608 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:51.609 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:51.625 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:51.625 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:51.641 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:51.641 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:51.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:51.643+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:51.657 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:51.657 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:51.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:51.675 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:51.681 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:51.681 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:51.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:51.691 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:51.691 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:51.708 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:51.708 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:51.724 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:51.724 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:51.745 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:51.744+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:51.794 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:51.794 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:51.794 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:51.794 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:51.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:51.846 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:51.845+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:51.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:51.945+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:51.948 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:51.948 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:51.948 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:51.948 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:51.948 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:51.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:51.963 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:16:51.978 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:16:52.062 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:52.061+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.663156863000001, 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:16:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.663111244, 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:16:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:16:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.663038511, 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662991634000001, 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:16:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662926894000002, 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:16:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662890664999999, 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:16:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662796738000001, 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:16:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:16:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:16:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662772969999999, 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:16:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662708099, 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:16:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662670475999999, 2024-09-21T22:16:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:16:52.109 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662629682999999, 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:16:52.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:16:52.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:16:52.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:16:52.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:16:52.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662554222000001, 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.115 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:52.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:16:52.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662483849000001, 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.119 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662450174, 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:16:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662381421999999, 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:16:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:16:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:16:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662337025999999, 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662246077999999, 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662217554000001, 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:16:52.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662185260000001, 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.144 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:16:52.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:16:52.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 16.662147127000001, 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:52.148 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:52.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:52.152 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:52.154 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:52.154 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:52.153+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:52.254 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:52.254+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:52.259 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:52.259 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:52.259 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:52.259 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:52.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:52.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:52.354+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:52.369 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:52.369 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:52.369 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:52.369 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:52.369 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:52.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:52.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:52.461+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:52.522 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.610507955999999, 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.607885883000002, 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14148 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 1949696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.322415208000002, 2024-09-21T22:16:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015536743, 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14148 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198277+0000", 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5499999999999999e-07 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198279+0000", 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198285+0000", 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198290+0000", 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5759999999999999e-06 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213689+0000", 2024-09-21T22:16:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015398719999999999 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213735+0000", 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6873999999999999e-05 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213813+0000", 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8047999999999995e-05 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14149 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2031616~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.322396787999999, 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015749758999999999, 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14149 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198295+0000", 2024-09-21T22:16:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198297+0000", 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198303+0000", 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.631e-06 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198317+0000", 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-05 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213846+0000", 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015529685 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.213929+0000", 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2341000000000003e-05 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214045+0000", 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116208 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.322368083000001, 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.322349189000001, 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.322326074999999, 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.321651887999998, 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14286 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3833856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.301233277999998, 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015717103999999999, 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14286 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219459+0000", 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219461+0000", 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219467+0000", 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219471+0000", 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2640000000000002e-06 2024-09-21T22:16:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.234983+0000", 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015511680999999999 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235069+0000", 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5778000000000004e-05 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235176+0000", 2024-09-21T22:16:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107092 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14287 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.301216893000003, 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015894090999999999, 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14287 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219475+0000", 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6800000000000002e-07 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219477+0000", 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.362e-06 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219480+0000", 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1700000000000001e-06 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219482+0000", 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.475e-06 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235247+0000", 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015765000000000001 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235298+0000", 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0577e-05 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235369+0000", 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1239e-05 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.301206634000003, 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.301191525, 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.301173231, 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.300516496, 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.320033199000001, 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:16:52.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:16:52.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:16:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.852573280999998, 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:16:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.152843249, 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:52.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:16:52.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:52.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.152796723999998, 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:16:52.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:97229 3.b 3:d168bffe:::rbd_data.11859a4b084.0000000000000007:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5606786770000003, 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018200561000000001, 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 97229 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960015+0000", 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2400000000000002e-06 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960890+0000", 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087496899999999996 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960913+0000", 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2918e-05 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960932+0000", 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8484000000000001e-05 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961011+0000", 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9240999999999996e-05 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961165+0000", 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154036 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961308+0000", 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014330699999999999 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977902+0000", 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016593469 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978092+0000", 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019035600000000001 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978169+0000", 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6588000000000006e-05 2024-09-21T22:16:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978214+0000", 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4953000000000001e-05 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97171 3.c e86/45 3:30c3e70a:::rbd_data.11859a4b084.0000000000000005:head v 86'91, mlcod=84'89)", 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5593431750000004, 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017387495999999999, 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:52.616 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961350+0000", 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.47e-07 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966000+0000", 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046502469999999997 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966013+0000", 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.343e-05 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966021+0000", 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5650000000000004e-06 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966094+0000", 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2758999999999999e-05 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966119+0000", 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5287999999999999e-05 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978684+0000", 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012564745 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978736+0000", 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2614999999999997e-05 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:52.620 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:52.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:52.622 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:52.621+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:52.722 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:52.721+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:52.765 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:52.766 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:52.766 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:52.766 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:52.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:52.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:52.858+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:52.917 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:52.917 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:52.917 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:52.917 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:52.917 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:52.924 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:52.924+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:52.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:16:52.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:16:52.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:16:53.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:53.027+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:53.126 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:53.125+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62618 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2596864~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.832342622999999, 2024-09-21T22:16:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046851039999999997, 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62618 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297855+0000", 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:16:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297861+0000", 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297869+0000", 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4229999999999999e-06 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344498+0000", 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046629275999999997 2024-09-21T22:16:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344580+0000", 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.229e-05 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344704+0000", 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012379399999999999 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62619 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2625536~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.832319691999999, 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047029327000000003, 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62619 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297878+0000", 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297884+0000", 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8420000000000001e-06 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297889+0000", 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0529999999999997e-06 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344750+0000", 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046860589000000001 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344799+0000", 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9259999999999999e-05 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344905+0000", 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106023 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62620 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2654208~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.832300047, 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047262419999999999, 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62620 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297896+0000", 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297900+0000", 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297906+0000", 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0499999999999997e-06 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297911+0000", 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6070000000000001e-06 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344949+0000", 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047038468999999999 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345037+0000", 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7664999999999995e-05 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345158+0000", 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121206 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62621 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2682880~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.832279072999999, 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047537283, 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62621 2024-09-21T22:16:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297917+0000", 2024-09-21T22:16:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297919+0000", 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297925+0000", 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1970000000000001e-06 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297930+0000", 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5619999999999997e-06 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345251+0000", 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047321410000000001 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345344+0000", 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3447000000000002e-05 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345454+0000", 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010932700000000001 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62622 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2711552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.832257542000001, 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047769796000000003, 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62622 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297941+0000", 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.137e-06 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297946+0000", 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297951+0000", 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345499+0000", 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047547865000000002 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345601+0000", 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101671 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345708+0000", 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107141 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62623 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2740224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.832233333000001, 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047987992, 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62623 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297963+0000", 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297971+0000", 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9009999999999994e-06 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297977+0000", 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5590000000000002e-06 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297989+0000", 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.183e-05 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345742+0000", 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047753035999999999 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345846+0000", 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103859 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345950+0000", 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104388 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62624 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2768896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.832199113000001, 2024-09-21T22:16:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048201194000000003, 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62624 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297997+0000", 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297999+0000", 2024-09-21T22:16:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2620000000000001e-06 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298005+0000", 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298011+0000", 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1789999999999999e-06 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345994+0000", 2024-09-21T22:16:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983959 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346078+0000", 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3830000000000002e-05 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346198+0000", 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119311 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62625 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2797568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.83196624, 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048206511, 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62625 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298230+0000", 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298233+0000", 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.371e-06 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298240+0000", 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1790000000000002e-06 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298253+0000", 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2186e-05 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346236+0000", 2024-09-21T22:16:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983499999999998 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346318+0000", 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2273000000000003e-05 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346436+0000", 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011741199999999999 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62626 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2826240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831931555000001, 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048414997000000001, 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62626 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298267+0000", 2024-09-21T22:16:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4109999999999999e-06 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298278+0000", 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1399999999999999e-05 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298283+0000", 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1919999999999996e-06 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346477+0000", 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048193998000000002 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346529+0000", 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1561999999999999e-05 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346679+0000", 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149973 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62627 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2854912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831902952, 2024-09-21T22:16:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048814124, 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62627 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298295+0000", 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298302+0000", 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3060000000000003e-06 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298306+0000", 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6820000000000002e-06 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346724+0000", 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048417610999999999 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346818+0000", 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3733000000000005e-05 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347107+0000", 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028912000000000002 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62628 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.83187805, 2024-09-21T22:16:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048832672000000001, 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62628 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298318+0000", 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298320+0000", 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1239999999999999e-06 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298326+0000", 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8220000000000003e-06 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298331+0000", 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347139+0000", 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048808782000000002 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347150+0000", 2024-09-21T22:16:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0672e-05 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62629 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831859075000001, 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048848529000000002, 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62629 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298337+0000", 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298339+0000", 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298345+0000", 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:16:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298350+0000", 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347177+0000", 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048826889999999998 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347185+0000", 2024-09-21T22:16:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62630 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831836967000001, 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048855136, 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62630 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298361+0000", 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298367+0000", 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298372+0000", 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347206+0000", 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048834223000000003 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347214+0000", 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8639999999999996e-06 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62631 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831642507000002, 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048836962999999997, 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62631 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298554+0000", 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:16:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298557+0000", 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.145e-06 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298570+0000", 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2870999999999999e-05 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298575+0000", 2024-09-21T22:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7570000000000001e-06 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347379+0000", 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048803199999999998 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347390+0000", 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1415e-05 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62632 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831609059000002, 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048882087999999997, 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62632 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298587+0000", 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298590+0000", 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6129999999999998e-06 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298601+0000", 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1517e-05 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298606+0000", 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8060000000000002e-06 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347417+0000", 2024-09-21T22:16:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048811326000000002 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347469+0000", 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378999999999997e-05 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62633 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.83158062, 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048891830999999997, 2024-09-21T22:16:53.192 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62633 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:53.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298618+0000", 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298624+0000", 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999998e-06 2024-09-21T22:16:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298634+0000", 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347498+0000", 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863908999999997 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347507+0000", 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8829999999999995e-06 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62634 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831554879999999, 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048897406999999997, 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62634 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298643+0000", 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-06 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298649+0000", 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298654+0000", 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.831e-06 2024-09-21T22:16:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347530+0000", 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048875952 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347538+0000", 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8059999999999995e-06 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62635 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831535524, 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.04890684, 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62635 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298685+0000", 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4230999999999999e-05 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298691+0000", 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.562e-06 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298696+0000", 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347560+0000", 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863986999999998 2024-09-21T22:16:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347567+0000", 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.579e-06 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62636 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831489603000001, 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048894625999999997, 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62636 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298709+0000", 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298714+0000", 2024-09-21T22:16:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298719+0000", 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347592+0000", 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048872916000000002 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347601+0000", 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5879999999999998e-06 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62637 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.831465712, 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048904669999999997, 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62637 2024-09-21T22:16:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298732+0000", 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298738+0000", 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298745+0000", 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6710000000000002e-06 2024-09-21T22:16:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347627+0000", 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048881775000000002 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347634+0000", 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.926e-06 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.211 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:53.211 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:53.227 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:53.226+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:53.327 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:53.326+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:53.372 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:53.372 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:53.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:53.428 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:53.427+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:53.484 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:53.484 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:53.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:53.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:53.532+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:53.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:53.628+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.720588325000001, 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44893 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1638400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597856523000001, 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057317179000000003, 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44893 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037238+0000", 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.392e-06 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037241+0000", 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.224e-06 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037243+0000", 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2469999999999998e-06 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094462+0000", 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057218453000000002 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094503+0000", 2024-09-21T22:16:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1247e-05 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094553+0000", 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0405999999999998e-05 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597846707999999, 2024-09-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597837169000002, 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597828328999999, 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597819123000001, 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:16:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597810149000001, 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597801243999999, 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:16:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597779504000002, 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.59777008, 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597761180999999, 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:16:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:16:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.597752228000001, 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.596257484999999, 2024-09-21T22:16:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.596247368, 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.596237862999999, 2024-09-21T22:16:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.596224123999999, 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:16:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:16:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.596214814, 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:16:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.736203815, 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.732582394, 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.150111860000001, 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:53.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:16:53.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:16:53.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:16:53.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:16:53.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:53.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:53.727 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:53.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:53.736 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:53.769 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:53.768+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:53.831 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:53.830+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:53.876 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:53.876 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:53.876 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:53.876 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:53.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:53.890 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:53.891 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:53.907 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:53.908 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:53.924 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:53.924 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:53.933 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:53.932+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:53.956 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:53.956 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:53.973 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:16:53.977 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:16:53.978 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:53.978 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:54.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:16:54.003 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:54.003 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:54.019 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.019 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.020 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:54.020 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:54.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:54.038 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:54.038 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:54.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:54.037+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:54.121 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-21T22:16:54.133 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:54.133+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:54.162 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.162 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:54.204 INFO:teuthology.orchestra.run.smithi134.stdout:3205 punch from 0x834c3f to 0x839e14, (0x51d5 bytes) 2024-09-21T22:16:54.208 INFO:teuthology.orchestra.run.smithi134.stdout:3207 write 0x21ac523 thru 0x21b8a82 (0xc560 bytes) 2024-09-21T22:16:54.212 INFO:teuthology.orchestra.run.smithi134.stdout:3208 punch from 0x7384d9b to 0x738eb79, (0x9dde bytes) 2024-09-21T22:16:54.212 INFO:teuthology.orchestra.run.smithi134.stdout:3209 read 0x81b9f98 thru 0x81c03f8 (0x6461 bytes) 2024-09-21T22:16:54.212 INFO:teuthology.orchestra.run.smithi134.stdout:3210 read 0x6a5dedd thru 0x6a64378 (0x649c bytes) 2024-09-21T22:16:54.212 INFO:teuthology.orchestra.run.smithi134.stdout:3211 writesame 0x9b023b0 thru 0x9b03c4b data_size 0x24(0x189c bytes) 2024-09-21T22:16:54.221 INFO:teuthology.orchestra.run.smithi134.stdout:3212 writesame 0xc808dcb thru 0xc8099f4 data_size 0x9(0xc2a bytes) 2024-09-21T22:16:54.222 INFO:teuthology.orchestra.run.smithi134.stdout:3213 writesame 0x156855 thru 0x160f0f data_size 0x1(0xa6bb bytes) 2024-09-21T22:16:54.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:54.234+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:54.242 INFO:teuthology.orchestra.run.smithi134.stdout:3215 read 0x8d4bdcd thru 0x8d556c6 (0x98fa bytes) 2024-09-21T22:16:54.242 INFO:teuthology.orchestra.run.smithi134.stdout:3216 read 0x31fac53 thru 0x32005ea (0x5998 bytes) 2024-09-21T22:16:54.243 INFO:teuthology.orchestra.run.smithi134.stdout:3217 trunc from 0xc8099f5 to 0xbd94d10 2024-09-21T22:16:54.257 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:54.257 INFO:teuthology.orchestra.run.smithi134.stdout:3219 punch from 0x1259c58 to 0x125fe7f, (0x6227 bytes) 2024-09-21T22:16:54.258 INFO:teuthology.orchestra.run.smithi134.stdout:3220 write 0x7ea55e0 thru 0x7eaca73 (0x7494 bytes) 2024-09-21T22:16:54.260 INFO:teuthology.orchestra.run.smithi134.stdout:3221 read 0x820960f thru 0x82156d6 (0xc0c8 bytes) 2024-09-21T22:16:54.261 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:54.261 INFO:teuthology.orchestra.run.smithi134.stdout:3223 read 0x231edf4 thru 0x2327d40 (0x8f4d bytes) 2024-09-21T22:16:54.261 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:54.261 INFO:teuthology.orchestra.run.smithi134.stdout:3225 write 0xa96d76 thru 0xa9ef8d (0x8218 bytes) 2024-09-21T22:16:54.263 INFO:teuthology.orchestra.run.smithi134.stdout:3226 write 0xf791de thru 0xf7f86e (0x6691 bytes) 2024-09-21T22:16:54.265 INFO:teuthology.orchestra.run.smithi134.stdout:3227 read 0x23e161a thru 0x23ee627 (0xd00e bytes) 2024-09-21T22:16:54.266 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:54.266 INFO:teuthology.orchestra.run.smithi134.stdout:3229 writesame 0x30992b3 thru 0x30a01f4 data_size 0x65(0x6f42 bytes) 2024-09-21T22:16:54.269 INFO:teuthology.orchestra.run.smithi134.stdout:3230 trunc from 0xbd94d10 to 0xc523cdf 2024-09-21T22:16:54.275 INFO:teuthology.orchestra.run.smithi134.stdout:3231 read 0x1e09438 thru 0x1e1649c (0xd065 bytes) 2024-09-21T22:16:54.275 INFO:teuthology.orchestra.run.smithi134.stdout:3232 clone 18 order 21 su 32768 sc 6 2024-09-21T22:16:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:54.336 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:54.335+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:54.394 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.394 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.403 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:54.445 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:54.444+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:54.538 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:54.537+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:54.548 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.548 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:54.641 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:54.640+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:54.702 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.702 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:54.752 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:54.751+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:54.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:54.840+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:54.853 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.854 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.862 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:54.941 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:54.940+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:54.966 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:54.966 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:54.975 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:54.982 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:16:55.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T22:16:55.060 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:55.059+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:55.120 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:55.120 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:55.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:55.170 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:55.169+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:55.244 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:55.243+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:55.273 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:55.273 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:55.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:55.345 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:55.344+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:55.427 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:55.427 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:55.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:55.479 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:55.478+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:55.539 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:55.539 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:55.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:55.546+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:55.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:55.648 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:55.647+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:55.692 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:55.693 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:55.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:55.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:55.748+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:55.845 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:55.846 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:55.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:55.848+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:55.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:55.950 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:55.949+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:55.970 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:55.970 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:55.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:55.987 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T22:16:55.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:16:56.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:16:56.051 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:56.050+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:56.052 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:16:56.151 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:56.151 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:56.152 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:56.151+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:56.167 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:16:56.246 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:56.246 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:56.253 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:56.252+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:56.264 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:56.265 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:56.283 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:56.283 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:56.301 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:56.301 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.400876363999998, 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:16:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:16:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:16:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.398254291000001, 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:16:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14150 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2162688~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.112736491, 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015959405999999999, 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14150 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198324+0000", 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198326+0000", 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198332+0000", 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198337+0000", 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214075+0000", 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015737474000000001 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214149+0000", 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214283+0000", 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013383000000000001 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.112717597, 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.112694482999999, 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:16:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:16:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.112020295999997, 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:16:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:16:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:16:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.091575042000002, 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:16:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.091559932999999, 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:16:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:16:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.091541638999999, 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:16:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:16:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.090884903999999, 2024-09-21T22:16:56.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:16:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.110401607, 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:16:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.642941688999997, 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:16:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:16:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.943211656999999, 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:16:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.943165131999997, 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:16:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:97229 3.b 3:d168bffe:::rbd_data.11859a4b084.0000000000000007:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.351047084999999, 2024-09-21T22:16:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018200561000000001, 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 97229 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960015+0000", 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2400000000000002e-06 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960890+0000", 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087496899999999996 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960913+0000", 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2918e-05 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960932+0000", 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8484000000000001e-05 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961011+0000", 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9240999999999996e-05 2024-09-21T22:16:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961165+0000", 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154036 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961308+0000", 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014330699999999999 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977902+0000", 2024-09-21T22:16:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016593469 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978092+0000", 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019035600000000001 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978169+0000", 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6588000000000006e-05 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978214+0000", 2024-09-21T22:16:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4953000000000001e-05 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97171 3.c e86/45 3:30c3e70a:::rbd_data.11859a4b084.0000000000000005:head v 86'91, mlcod=84'89)", 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.349711582999999, 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017387495999999999, 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961350+0000", 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.47e-07 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966000+0000", 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046502469999999997 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966013+0000", 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.343e-05 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966021+0000", 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5650000000000004e-06 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966094+0000", 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2758999999999999e-05 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966119+0000", 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5287999999999999e-05 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978684+0000", 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012564745 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978736+0000", 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2614999999999997e-05 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101043 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1877259229999999, 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018053537000000001, 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101043 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123335+0000", 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123340+0000", 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6700000000000002e-06 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123353+0000", 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2779000000000001e-05 2024-09-21T22:16:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123360+0000", 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3499999999999999e-06 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126073+0000", 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027131360000000001 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126157+0000", 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3319000000000006e-05 2024-09-21T22:16:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126924+0000", 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000767303 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136269+0000", 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093453049999999999 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141278+0000", 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050086949999999996 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141336+0000", 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7901e-05 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141388+0000", 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2135999999999997e-05 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101044 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1864934520000001, 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017384295000000001, 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101044 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124568+0000", 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0599999999999999e-07 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124573+0000", 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0329999999999999e-06 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124584+0000", 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1569999999999999e-05 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124595+0000", 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0471e-05 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127509+0000", 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002914374 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127599+0000", 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9827000000000006e-05 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127978+0000", 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037899500000000003 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136277+0000", 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082993419999999995 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141448+0000", 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051706950000000003 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141521+0000", 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3114999999999994e-05 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141951+0000", 2024-09-21T22:16:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043006700000000001 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101058 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1851275810000002, 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018654467000000001, 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101058 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125934+0000", 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0400000000000005e-07 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125940+0000", 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125951+0000", 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1600000000000001e-05 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125958+0000", 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0910000000000004e-06 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129088+0000", 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003129452 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129173+0000", 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4979000000000001e-05 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129877+0000", 2024-09-21T22:16:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070436399999999997 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137342+0000", 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074651630000000004 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144517+0000", 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071743989999999997 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144563+0000", 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6304000000000003e-05 2024-09-21T22:16:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144587+0000", 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4158000000000001e-05 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101063 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1839288799999999, 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017538194999999999, 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101063 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127132+0000", 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0200000000000001e-07 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127136+0000", 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3000000000000003e-06 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127145+0000", 2024-09-21T22:16:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1950000000000003e-06 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127150+0000", 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4589999999999997e-06 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130331+0000", 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031804670000000002 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130404+0000", 2024-09-21T22:16:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3003999999999994e-05 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130969+0000", 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056533799999999997 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137356+0000", 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063868520000000002 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144623+0000", 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072671100000000002 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144649+0000", 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5876000000000001e-05 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144670+0000", 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0891999999999999e-05 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.410 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:56.411 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:56.412 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:56.413 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:16:56.413 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:56.413 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:56.414 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:56.414 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:56.415 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:56.415 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:56.411+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:56.512 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:56.512+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:56.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:16:56.613 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:56.611+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:56.669 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:56.670 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:56.670 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:56.670 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:56.670 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:56.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:16:56.714 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:56.713+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:56.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:56.812+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:56.821 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62618 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2596864~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.522320432000001, 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046851039999999997, 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62618 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297855+0000", 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297861+0000", 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297869+0000", 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4229999999999999e-06 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344498+0000", 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046629275999999997 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344580+0000", 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.229e-05 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344704+0000", 2024-09-21T22:16:56.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012379399999999999 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62619 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2625536~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.522297501000001, 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047029327000000003, 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62619 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297878+0000", 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297884+0000", 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8420000000000001e-06 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297889+0000", 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0529999999999997e-06 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344750+0000", 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046860589000000001 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344799+0000", 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9259999999999999e-05 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344905+0000", 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106023 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62620 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2654208~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.522277855999999, 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047262419999999999, 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62620 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297896+0000", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297900+0000", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297906+0000", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0499999999999997e-06 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297911+0000", 2024-09-21T22:16:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6070000000000001e-06 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344949+0000", 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047038468999999999 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345037+0000", 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7664999999999995e-05 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345158+0000", 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121206 2024-09-21T22:16:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62621 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2682880~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.522256882000001, 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047537283, 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62621 2024-09-21T22:16:56.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297917+0000", 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:16:56.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297919+0000", 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297925+0000", 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1970000000000001e-06 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297930+0000", 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5619999999999997e-06 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345251+0000", 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047321410000000001 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345344+0000", 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3447000000000002e-05 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345454+0000", 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010932700000000001 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62622 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2711552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.522235350999999, 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047769796000000003, 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62622 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:16:56.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297941+0000", 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.137e-06 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297946+0000", 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297951+0000", 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:16:56.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345499+0000", 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047547865000000002 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345601+0000", 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101671 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345708+0000", 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107141 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62623 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2740224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.522211142, 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047987992, 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62623 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.842 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297963+0000", 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:16:56.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297971+0000", 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9009999999999994e-06 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297977+0000", 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5590000000000002e-06 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297989+0000", 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.183e-05 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345742+0000", 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047753035999999999 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345846+0000", 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103859 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345950+0000", 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104388 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62624 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2768896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.522176922, 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048201194000000003, 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62624 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297997+0000", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297999+0000", 2024-09-21T22:16:56.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2620000000000001e-06 2024-09-21T22:16:56.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298005+0000", 2024-09-21T22:16:56.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298011+0000", 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1789999999999999e-06 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345994+0000", 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983959 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346078+0000", 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3830000000000002e-05 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346198+0000", 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119311 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62625 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2797568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521944048999998, 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048206511, 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62625 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:16:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298230+0000", 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298233+0000", 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.371e-06 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298240+0000", 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1790000000000002e-06 2024-09-21T22:16:56.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298253+0000", 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2186e-05 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346236+0000", 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983499999999998 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346318+0000", 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2273000000000003e-05 2024-09-21T22:16:56.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346436+0000", 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011741199999999999 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62626 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2826240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521909363999999, 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048414997000000001, 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62626 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298267+0000", 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4109999999999999e-06 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298278+0000", 2024-09-21T22:16:56.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1399999999999999e-05 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298283+0000", 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1919999999999996e-06 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346477+0000", 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048193998000000002 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346529+0000", 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1561999999999999e-05 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346679+0000", 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149973 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62627 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2854912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:56.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521880760999998, 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048814124, 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62627 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298295+0000", 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298302+0000", 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3060000000000003e-06 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298306+0000", 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6820000000000002e-06 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346724+0000", 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048417610999999999 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346818+0000", 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3733000000000005e-05 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347107+0000", 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028912000000000002 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62628 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521855858999999, 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048832672000000001, 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62628 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298318+0000", 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298320+0000", 2024-09-21T22:16:56.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1239999999999999e-06 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298326+0000", 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8220000000000003e-06 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298331+0000", 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347139+0000", 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048808782000000002 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347150+0000", 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0672e-05 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62629 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521836883999999, 2024-09-21T22:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048848529000000002, 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62629 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298337+0000", 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298339+0000", 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298345+0000", 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298350+0000", 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347177+0000", 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048826889999999998 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347185+0000", 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62630 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521814775999999, 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048855136, 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62630 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298361+0000", 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298367+0000", 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298372+0000", 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347206+0000", 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048834223000000003 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347214+0000", 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8639999999999996e-06 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62631 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521620316, 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048836962999999997, 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62631 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298554+0000", 2024-09-21T22:16:56.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298557+0000", 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.145e-06 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298570+0000", 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2870999999999999e-05 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298575+0000", 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7570000000000001e-06 2024-09-21T22:16:56.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347379+0000", 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048803199999999998 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347390+0000", 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1415e-05 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62632 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521586868, 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048882087999999997, 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62632 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298587+0000", 2024-09-21T22:16:56.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298590+0000", 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6129999999999998e-06 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298601+0000", 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1517e-05 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298606+0000", 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8060000000000002e-06 2024-09-21T22:16:56.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347417+0000", 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048811326000000002 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347469+0000", 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378999999999997e-05 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62633 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521558428999999, 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048891830999999997, 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62633 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298618+0000", 2024-09-21T22:16:56.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298624+0000", 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999998e-06 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298634+0000", 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347498+0000", 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863908999999997 2024-09-21T22:16:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347507+0000", 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8829999999999995e-06 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62634 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521532689000001, 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048897406999999997, 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62634 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298643+0000", 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-06 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298649+0000", 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298654+0000", 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.831e-06 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347530+0000", 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048875952 2024-09-21T22:16:56.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347538+0000", 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8059999999999995e-06 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62635 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521513333000001, 2024-09-21T22:16:56.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.04890684, 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62635 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:56.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298685+0000", 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4230999999999999e-05 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298691+0000", 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.562e-06 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298696+0000", 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347560+0000", 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863986999999998 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347567+0000", 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.579e-06 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62636 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521467412, 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048894625999999997, 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62636 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298709+0000", 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298714+0000", 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298719+0000", 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347592+0000", 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048872916000000002 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347601+0000", 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5879999999999998e-06 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62637 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.521443520999998, 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048904669999999997, 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62637 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298732+0000", 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298738+0000", 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:56.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298745+0000", 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6710000000000002e-06 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347627+0000", 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048881775000000002 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347634+0000", 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.926e-06 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:56.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:56.903 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:56.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:16:56.904 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:16:56.904 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:16:56.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:16:56.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:56.945+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:57.016 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:57.015+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:57.035 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-21T22:16:57.060 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:57.060 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:57.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:16:57.118 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:57.116+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:57.191 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:57.191 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:57.192 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:57.192 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:57.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:16:57.242 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:57.240+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:57.266 INFO:teuthology.orchestra.run.smithi134.stdout:3233 punch from 0x159f7f9 to 0x15a1ba2, (0x23a9 bytes) 2024-09-21T22:16:57.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T22:16:57.264+0000 7fe888da6640 0 --2- 172.21.15.134:0/2419779273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe884072560 0x7fe8840ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-21T22:16:57.270 INFO:teuthology.orchestra.run.smithi134.stdout:3235 punch from 0x3736c88 to 0x3739218, (0x2590 bytes) 2024-09-21T22:16:57.270 INFO:teuthology.orchestra.run.smithi134.stdout:3236 write 0x49f071c thru 0x49f1edd (0x17c2 bytes) 2024-09-21T22:16:57.273 INFO:teuthology.orchestra.run.smithi134.stdout:3237 write 0x8062499 thru 0x806e9c1 (0xc529 bytes) 2024-09-21T22:16:57.275 INFO:teuthology.orchestra.run.smithi134.stdout:3239 read 0xac4f85f thru 0xac5797e (0x8120 bytes) 2024-09-21T22:16:57.275 INFO:teuthology.orchestra.run.smithi134.stdout:3241 writesame 0xaf28ed4 thru 0xaf32e4e data_size 0x1f(0x9f7b bytes) 2024-09-21T22:16:57.291 INFO:teuthology.orchestra.run.smithi134.stdout:3242 trunc from 0xc523cdf to 0x2828db0 2024-09-21T22:16:57.308 INFO:teuthology.orchestra.run.smithi134.stdout:3243 punch from 0x46b49a to 0x4746d2, (0x9238 bytes) 2024-09-21T22:16:57.308 INFO:teuthology.orchestra.run.smithi134.stdout:3244 writesame 0x1819cb9 thru 0x1822aa4 data_size 0x1f(0x8dec bytes) 2024-09-21T22:16:57.316 INFO:teuthology.orchestra.run.smithi134.stdout:3245 trunc from 0x2828db0 to 0x77f267f 2024-09-21T22:16:57.318 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:57.317+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:57.322 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:57.322 INFO:teuthology.orchestra.run.smithi134.stdout:3247 write 0x4d132b0 thru 0x4d201ec (0xcf3d bytes) 2024-09-21T22:16:57.338 INFO:teuthology.orchestra.run.smithi134.stdout:3248 writesame 0xc385177 thru 0xc38d558 data_size 0x33(0x83e2 bytes) 2024-09-21T22:16:57.338 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:57.338 INFO:teuthology.orchestra.run.smithi134.stdout:3250 read 0xc00fc4f thru 0xc016187 (0x6539 bytes) 2024-09-21T22:16:57.338 INFO:teuthology.orchestra.run.smithi134.stdout:3252 read 0x14240de thru 0x1424b9b (0xabe bytes) 2024-09-21T22:16:57.341 INFO:teuthology.orchestra.run.smithi134.stdout:3253 trunc from 0xc38d559 to 0x9f061d5 2024-09-21T22:16:57.347 INFO:teuthology.orchestra.run.smithi134.stdout:3254 read 0x85092af thru 0x8517a8d (0xe7df bytes) 2024-09-21T22:16:57.354 INFO:teuthology.orchestra.run.smithi134.stdout:3255 write 0xc2c887c thru 0xc2cabe2 (0x2367 bytes) 2024-09-21T22:16:57.358 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:57.358 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:16:57.358 INFO:teuthology.orchestra.run.smithi134.stdout:3258 read 0x3578de9 thru 0x357e5cc (0x57e4 bytes) 2024-09-21T22:16:57.361 INFO:teuthology.orchestra.run.smithi134.stdout:3259 trunc from 0xc2cabe3 to 0x9f45d20 2024-09-21T22:16:57.367 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:57.367 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:57.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:57.367 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:57.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.450740637999999, 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:16:57.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:16:57.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:16:57.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44893 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1638400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.328008835999999, 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057317179000000003, 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44893 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037238+0000", 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.392e-06 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037241+0000", 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.224e-06 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037243+0000", 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2469999999999998e-06 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094462+0000", 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057218453000000002 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094503+0000", 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1247e-05 2024-09-21T22:16:57.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094553+0000", 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0405999999999998e-05 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327999021, 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:57.381 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327989482, 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:16:57.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327980642, 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.386 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327971435999999, 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:16:57.390 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327962461999999, 2024-09-21T22:16:57.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327953557000001, 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:57.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:16:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:16:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327931817, 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327922393000001, 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.407 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:16:57.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:16:57.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:16:57.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327913494000001, 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:16:57.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:16:57.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.327904540999999, 2024-09-21T22:16:57.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:57.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:16:57.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.326409798, 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:16:57.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:16:57.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:16:57.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.326399681000002, 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:16:57.424 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.326390176, 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.326376437, 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:16:57.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:16:57.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.326367127000001, 2024-09-21T22:16:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:16:57.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.466356128000001, 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.443 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:16:57.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:16:57.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:16:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.462734706999999, 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:57.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:16:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:16:57.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.880264173, 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:16:57.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:16:57.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.464 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:57.465 INFO:teuthology.orchestra.run.smithi134.stdout:3261 clone 19 order 25 su 524288 sc 5 2024-09-21T22:16:57.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:16:57.467 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:57.465+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:57.567 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:57.566+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:57.608 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:16:57.609 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:57.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:16:57.668 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:57.666+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:57.720 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:16:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:16:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:16:57.720 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:57.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:16:57.770 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:57.768+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:57.869 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:57.867+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.370016508999996, 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.354833049999996, 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.343386612000003, 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.793299384000001, 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:16:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:16:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.738211620999998, 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:16:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:16:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:16:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.467118931999998, 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:16:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.462212358000002, 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:16:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:16:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:16:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.459001759000003, 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:16:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:16:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.453980061999999, 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:16:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.451992730000001, 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.928139139000002, 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:16:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:16:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:16:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:40247 3.0 e71/23 3:0688b99e:::rbd_data.118542b14bcd.0000000000000281:head v 71'358, mlcod=71'356)", 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.636929925, 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039211389999999997, 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234378+0000", 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9500000000000001e-07 2024-09-21T22:16:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234387+0000", 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2599999999999994e-06 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234398+0000", 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234405+0000", 2024-09-21T22:16:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234460+0000", 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4975999999999997e-05 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234482+0000", 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1407e-05 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238263+0000", 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037812039999999998 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238298+0000", 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5419000000000001e-05 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.884977528, 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:16:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:16:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:16:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.883476786999999, 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:16:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:16:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:45992 3.16 e76/63 3:6be7cafa:::rbd_data.1185af582f87.0000000000000002:head v 76'119, mlcod=74'117)", 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.603442708999999, 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038321589999999999, 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267865+0000", 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9500000000000002e-07 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268183+0000", 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000318239 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268202+0000", 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8732e-05 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268210+0000", 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7810000000000005e-06 2024-09-21T22:16:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268292+0000", 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1990000000000006e-05 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268316+0000", 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3915999999999999e-05 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271655+0000", 2024-09-21T22:16:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00333892 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271697+0000", 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1986000000000001e-05 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97072 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'409, mlcod=84'406)", 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.948529021000001, 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039520709999999997, 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922780+0000", 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3740000000000001e-06 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922789+0000", 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922808+0000", 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8481000000000001e-05 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922822+0000", 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922885+0000", 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3336000000000005e-05 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922910+0000", 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5072999999999999e-05 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926670+0000", 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003760191 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926730+0000", 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0126e-05 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:16:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.903789799, 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:16:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.898905723, 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.898118026000001, 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:16:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.891110584, 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:16:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:16:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:16:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:16:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:16:57.957 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:16:57.958 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:16:57.993 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:16:58.003 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:16:58.002+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:16:58.009 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:16:58.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:16:58.079 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:58.079 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:58.089 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:16:58.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:58.091+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:58.173 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:58.172+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:58.233 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:58.233 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:58.233 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:16:58.233 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:16:58.233 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:58.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:16:58.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:58.271+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:58.326 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:16:58.337 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-21T22:16:57.993851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649722141,"num_objects":496,"num_object_clones":0,"num_object_copies":992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":102323,"num_read_kb":562912,"num_write":13670,"num_write_kb":454744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1154,"num_bytes_recovered":137648407,"num_keys_recovered":223,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9284,"ondisk_log_size":9284,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":639276,"kb_used_data":333168,"kb_used_omap":15,"kb_used_meta":305904,"kb_avail":754335444,"statfs":{"total":773094113280,"available":772439494656,"internally_reserved":0,"allocated":341164032,"data_stored":334626683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":313246492},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43682165,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":1794,"num_read_kb":65391,"num_write":181,"num_write_kb":27399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.020017"},"pg_stats":[{"pgid":"3.1f","version":"95'412","reported_seq":9350,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.985885+0000","last_change":"2024-09-21T22:16:53.985885+0000","last_active":"2024-09-21T22:16:53.985885+0000","last_peered":"2024-09-21T22:16:53.985885+0000","last_clean":"2024-09-21T22:16:53.985885+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:16:53.985885+0000","last_undegraded":"2024-09-21T22:16:53.985885+0000","last_fullsized":"2024-09-21T22:16:53.985885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:24:45.083296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000413729,"stat_sum":{"num_bytes":39948669,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":9870,"num_read_kb":37335,"num_write":678,"num_write_kb":18836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1e","version":"95'346","reported_seq":2465,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.016666+0000","last_change":"2024-09-21T22:16:50.961553+0000","last_active":"2024-09-21T22:16:53.016666+0000","last_peered":"2024-09-21T22:16:53.016666+0000","last_clean":"2024-09-21T22:16:53.016666+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:16:53.016666+0000","last_undegraded":"2024-09-21T22:16:53.016666+0000","last_fullsized":"2024-09-21T22:16:53.016666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:21:50.664025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040109800000000001,"stat_sum":{"num_bytes":16476761,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":3105,"num_read_kb":14826,"num_write":344,"num_write_kb":10631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.1d","version":"95'191","reported_seq":6743,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.106008+0000","last_change":"2024-09-21T22:16:54.106216+0000","last_active":"2024-09-21T22:16:54.106008+0000","last_peered":"2024-09-21T22:16:54.106008+0000","last_clean":"2024-09-21T22:16:54.106008+0000","last_became_active":"2024-09-21T22:16:48.959075+0000","last_became_peered":"2024-09-21T22:16:48.959075+0000","last_unstale":"2024-09-21T22:16:54.106008+0000","last_undegraded":"2024-09-21T22:16:54.106008+0000","last_fullsized":"2024-09-21T22:16:54.106008+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:17.890361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050951999999999996,"stat_sum":{"num_bytes":50943552,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6430,"num_read_kb":39817,"num_write":304,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1c","version":"95'524","reported_seq":1513,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.106238+0000","last_change":"2024-09-21T22:16:54.105963+0000","last_active":"2024-09-21T22:16:54.106238+0000","last_peered":"2024-09-21T22:16:54.106238+0000","last_clean":"2024-09-21T22:16:54.106238+0000","last_became_active":"2024-09-21T22:16:48.959089+0000","last_became_peered":"2024-09-21T22:16:48.959089+0000","last_unstale":"2024-09-21T22:16:54.106238+0000","last_undegraded":"2024-09-21T22:16:54.106238+0000","last_fullsized":"2024-09-21T22:16:54.106238+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:03:05.649626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052192799999999995,"stat_sum":{"num_bytes":18989036,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":2223,"num_read_kb":19128,"num_write":953,"num_write_kb":19153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1b","version":"95'150","reported_seq":1140,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987361+0000","last_change":"2024-09-21T22:16:53.987765+0000","last_active":"2024-09-21T22:16:53.987361+0000","last_peered":"2024-09-21T22:16:53.987361+0000","last_clean":"2024-09-21T22:16:53.987361+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:16:53.987361+0000","last_undegraded":"2024-09-21T22:16:53.987361+0000","last_fullsized":"2024-09-21T22:16:53.987361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:50:10.557448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084166700000000004,"stat_sum":{"num_bytes":17869949,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":781,"num_read_kb":12522,"num_write":240,"num_write_kb":13018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1a","version":"96'134","reported_seq":1386,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.262941+0000","last_change":"2024-09-21T22:16:53.974680+0000","last_active":"2024-09-21T22:16:54.262941+0000","last_peered":"2024-09-21T22:16:54.262941+0000","last_clean":"2024-09-21T22:16:54.262941+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:16:54.262941+0000","last_undegraded":"2024-09-21T22:16:54.262941+0000","last_fullsized":"2024-09-21T22:16:54.262941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:02:55.438480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035682299999999998,"stat_sum":{"num_bytes":5162986,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1077,"num_read_kb":3375,"num_write":166,"num_write_kb":9582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.19","version":"95'342","reported_seq":1846,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984644+0000","last_change":"2024-09-21T22:16:53.980003+0000","last_active":"2024-09-21T22:16:54.984644+0000","last_peered":"2024-09-21T22:16:54.984644+0000","last_clean":"2024-09-21T22:16:54.984644+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:16:54.984644+0000","last_undegraded":"2024-09-21T22:16:54.984644+0000","last_fullsized":"2024-09-21T22:16:54.984644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:01:39.276867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044375300000000002,"stat_sum":{"num_bytes":11403353,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":2562,"num_read_kb":10238,"num_write":443,"num_write_kb":12749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.18","version":"95'505","reported_seq":1044,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.314058+0000","last_change":"2024-09-21T22:16:50.962040+0000","last_active":"2024-09-21T22:16:53.314058+0000","last_peered":"2024-09-21T22:16:53.314058+0000","last_clean":"2024-09-21T22:16:53.314058+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:16:53.314058+0000","last_undegraded":"2024-09-21T22:16:53.314058+0000","last_fullsized":"2024-09-21T22:16:53.314058+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:00:20.621374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064368300000000004,"stat_sum":{"num_bytes":20721344,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1669,"num_read_kb":14047,"num_write":724,"num_write_kb":19793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.17","version":"95'691","reported_seq":1749,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.986361+0000","last_change":"2024-09-21T22:16:53.986361+0000","last_active":"2024-09-21T22:16:53.986361+0000","last_peered":"2024-09-21T22:16:53.986361+0000","last_clean":"2024-09-21T22:16:53.986361+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:16:53.986361+0000","last_undegraded":"2024-09-21T22:16:53.986361+0000","last_fullsized":"2024-09-21T22:16:53.986361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:46:28.765276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068442999999999998,"stat_sum":{"num_bytes":12052514,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3811,"num_read_kb":15866,"num_write":1320,"num_write_kb":16241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.16","version":"83'138","reported_seq":13082,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984705+0000","last_change":"2024-09-21T22:16:53.981573+0000","last_active":"2024-09-21T22:16:54.984705+0000","last_peered":"2024-09-21T22:16:54.984705+0000","last_clean":"2024-09-21T22:16:54.984705+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:16:54.984705+0000","last_undegraded":"2024-09-21T22:16:54.984705+0000","last_fullsized":"2024-09-21T22:16:54.984705+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:52:28.921941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001412504,"stat_sum":{"num_bytes":40934626,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13488,"num_read_kb":43828,"num_write":223,"num_write_kb":11567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.15","version":"95'575","reported_seq":2533,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988259+0000","last_change":"2024-09-21T22:16:53.988466+0000","last_active":"2024-09-21T22:16:53.988259+0000","last_peered":"2024-09-21T22:16:53.988259+0000","last_clean":"2024-09-21T22:16:53.988259+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:16:53.988259+0000","last_undegraded":"2024-09-21T22:16:53.988259+0000","last_fullsized":"2024-09-21T22:16:53.988259+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:14:04.045090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044674100000000001,"stat_sum":{"num_bytes":43468110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3571,"num_read_kb":25284,"num_write":941,"num_write_kb":22880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.14","version":"95'217","reported_seq":1579,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.974778+0000","last_change":"2024-09-21T22:16:53.974942+0000","last_active":"2024-09-21T22:16:53.974778+0000","last_peered":"2024-09-21T22:16:53.974778+0000","last_clean":"2024-09-21T22:16:53.974778+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:16:53.974778+0000","last_undegraded":"2024-09-21T22:16:53.974778+0000","last_fullsized":"2024-09-21T22:16:53.974778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:12:26.992563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053372000000000001,"stat_sum":{"num_bytes":36424290,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1017,"num_read_kb":10309,"num_write":263,"num_write_kb":10796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.138060+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:16:54.138060+0000","last_peered":"2024-09-21T22:16:54.138060+0000","last_clean":"2024-09-21T22:16:54.138060+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:16:54.138060+0000","last_undegraded":"2024-09-21T22:16:54.138060+0000","last_fullsized":"2024-09-21T22:16:54.138060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"95'248","reported_seq":2028,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987379+0000","last_change":"2024-09-21T22:16:53.987379+0000","last_active":"2024-09-21T22:16:53.987379+0000","last_peered":"2024-09-21T22:16:53.987379+0000","last_clean":"2024-09-21T22:16:53.987379+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:16:53.987379+0000","last_undegraded":"2024-09-21T22:16:53.987379+0000","last_fullsized":"2024-09-21T22:16:53.987379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:07.315081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139012,"stat_sum":{"num_bytes":29363518,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2306,"num_read_kb":25977,"num_write":294,"num_write_kb":19744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984790+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:16:54.984790+0000","last_peered":"2024-09-21T22:16:54.984790+0000","last_clean":"2024-09-21T22:16:54.984790+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:16:54.984790+0000","last_undegraded":"2024-09-21T22:16:54.984790+0000","last_fullsized":"2024-09-21T22:16:54.984790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"95'205","reported_seq":1399,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.331292+0000","last_change":"2024-09-21T22:16:50.963055+0000","last_active":"2024-09-21T22:16:53.331292+0000","last_peered":"2024-09-21T22:16:53.331292+0000","last_clean":"2024-09-21T22:16:53.331292+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:16:53.331292+0000","last_undegraded":"2024-09-21T22:16:53.331292+0000","last_fullsized":"2024-09-21T22:16:53.331292+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:19:14.792866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039435300000000001,"stat_sum":{"num_bytes":22985902,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1293,"num_read_kb":13957,"num_write":264,"num_write_kb":12105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988058+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:16:53.988058+0000","last_peered":"2024-09-21T22:16:53.988058+0000","last_clean":"2024-09-21T22:16:53.988058+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:16:53.988058+0000","last_undegraded":"2024-09-21T22:16:53.988058+0000","last_fullsized":"2024-09-21T22:16:53.988058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"97'211","reported_seq":8787,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:55.006284+0000","last_change":"2024-09-21T22:16:53.981682+0000","last_active":"2024-09-21T22:16:55.006284+0000","last_peered":"2024-09-21T22:16:55.006284+0000","last_clean":"2024-09-21T22:16:55.006284+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:16:55.006284+0000","last_undegraded":"2024-09-21T22:16:55.006284+0000","last_fullsized":"2024-09-21T22:16:55.006284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:03.477607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016743249999999999,"stat_sum":{"num_bytes":33531737,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":8461,"num_read_kb":36977,"num_write":244,"num_write_kb":16438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984709+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:16:54.984709+0000","last_peered":"2024-09-21T22:16:54.984709+0000","last_clean":"2024-09-21T22:16:54.984709+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:16:54.984709+0000","last_undegraded":"2024-09-21T22:16:54.984709+0000","last_fullsized":"2024-09-21T22:16:54.984709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"96'145","reported_seq":1484,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.106030+0000","last_change":"2024-09-21T22:16:54.106030+0000","last_active":"2024-09-21T22:16:54.106030+0000","last_peered":"2024-09-21T22:16:54.106030+0000","last_clean":"2024-09-21T22:16:54.106030+0000","last_became_active":"2024-09-21T22:16:00.921655+0000","last_became_peered":"2024-09-21T22:16:00.921655+0000","last_unstale":"2024-09-21T22:16:54.106030+0000","last_undegraded":"2024-09-21T22:16:54.106030+0000","last_fullsized":"2024-09-21T22:16:54.106030+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:57:11.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052248799999999999,"stat_sum":{"num_bytes":18085375,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1035,"num_read_kb":17596,"num_write":256,"num_write_kb":11424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.3","version":"96'146","reported_seq":836,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.136763+0000","last_change":"2024-09-21T22:16:53.974912+0000","last_active":"2024-09-21T22:16:54.136763+0000","last_peered":"2024-09-21T22:16:54.136763+0000","last_clean":"2024-09-21T22:16:54.136763+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:16:54.136763+0000","last_undegraded":"2024-09-21T22:16:54.136763+0000","last_fullsized":"2024-09-21T22:16:54.136763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:54.192084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055758999999999995,"stat_sum":{"num_bytes":9100862,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":430,"num_read_kb":10027,"num_write":194,"num_write_kb":12126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":170,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.105416+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:16:54.105416+0000","last_peered":"2024-09-21T22:16:54.105416+0000","last_clean":"2024-09-21T22:16:54.105416+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:16:54.105416+0000","last_undegraded":"2024-09-21T22:16:54.105416+0000","last_fullsized":"2024-09-21T22:16:54.105416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"93'426","reported_seq":7372,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984611+0000","last_change":"2024-09-21T22:16:53.981045+0000","last_active":"2024-09-21T22:16:54.984611+0000","last_peered":"2024-09-21T22:16:54.984611+0000","last_clean":"2024-09-21T22:16:54.984611+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:16:54.984611+0000","last_undegraded":"2024-09-21T22:16:54.984611+0000","last_fullsized":"2024-09-21T22:16:54.984611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:51.767696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014541199999999999,"stat_sum":{"num_bytes":28409453,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":7730,"num_read_kb":30543,"num_write":603,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.981416+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:16:54.981416+0000","last_peered":"2024-09-21T22:16:54.981416+0000","last_clean":"2024-09-21T22:16:54.981416+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:16:54.981416+0000","last_undegraded":"2024-09-21T22:16:54.981416+0000","last_fullsized":"2024-09-21T22:16:54.981416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"95'174","reported_seq":1282,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.985607+0000","last_change":"2024-09-21T22:16:53.986088+0000","last_active":"2024-09-21T22:16:53.985607+0000","last_peered":"2024-09-21T22:16:53.985607+0000","last_clean":"2024-09-21T22:16:53.985607+0000","last_became_active":"2024-09-21T22:16:48.956575+0000","last_became_peered":"2024-09-21T22:16:48.956575+0000","last_unstale":"2024-09-21T22:16:53.985607+0000","last_undegraded":"2024-09-21T22:16:53.985607+0000","last_fullsized":"2024-09-21T22:16:53.985607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:32:51.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066476000000000003,"stat_sum":{"num_bytes":9370304,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":730,"num_read_kb":8340,"num_write":239,"num_write_kb":13790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6594455,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987831+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:16:53.987831+0000","last_peered":"2024-09-21T22:16:53.987831+0000","last_clean":"2024-09-21T22:16:53.987831+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:16:53.987831+0000","last_undegraded":"2024-09-21T22:16:53.987831+0000","last_fullsized":"2024-09-21T22:16:53.987831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"95'164","reported_seq":717,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.315738+0000","last_change":"2024-09-21T22:16:50.962765+0000","last_active":"2024-09-21T22:16:53.315738+0000","last_peered":"2024-09-21T22:16:53.315738+0000","last_clean":"2024-09-21T22:16:53.315738+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:16:53.315738+0000","last_undegraded":"2024-09-21T22:16:53.315738+0000","last_fullsized":"2024-09-21T22:16:53.315738+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:36:09.497302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343393,"stat_sum":{"num_bytes":17685219,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":485,"num_read_kb":13798,"num_write":223,"num_write_kb":19108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":169,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.105283+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:16:54.105283+0000","last_peered":"2024-09-21T22:16:54.105283+0000","last_clean":"2024-09-21T22:16:54.105283+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:16:54.105283+0000","last_undegraded":"2024-09-21T22:16:54.105283+0000","last_fullsized":"2024-09-21T22:16:54.105283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":319,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987928+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:16:53.987928+0000","last_peered":"2024-09-21T22:16:53.987928+0000","last_clean":"2024-09-21T22:16:53.987928+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:16:53.987928+0000","last_undegraded":"2024-09-21T22:16:53.987928+0000","last_fullsized":"2024-09-21T22:16:53.987928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"95'487","reported_seq":1238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.355886+0000","last_change":"2024-09-21T22:16:50.962259+0000","last_active":"2024-09-21T22:16:53.355886+0000","last_peered":"2024-09-21T22:16:53.355886+0000","last_clean":"2024-09-21T22:16:53.355886+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:16:53.355886+0000","last_undegraded":"2024-09-21T22:16:53.355886+0000","last_fullsized":"2024-09-21T22:16:53.355886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:56.746271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062274599999999998,"stat_sum":{"num_bytes":17100594,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":2064,"num_read_kb":8852,"num_write":816,"num_write_kb":14193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.9","version":"96'187","reported_seq":1153,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.974682+0000","last_change":"2024-09-21T22:16:53.974682+0000","last_active":"2024-09-21T22:16:53.974682+0000","last_peered":"2024-09-21T22:16:53.974682+0000","last_clean":"2024-09-21T22:16:53.974682+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:16:53.974682+0000","last_undegraded":"2024-09-21T22:16:53.974682+0000","last_fullsized":"2024-09-21T22:16:53.974682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:30:32.037894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035437199999999999,"stat_sum":{"num_bytes":11929723,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1303,"num_read_kb":9633,"num_write":303,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.a","version":"94'220","reported_seq":1441,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.140821+0000","last_change":"2024-09-21T22:16:54.141166+0000","last_active":"2024-09-21T22:16:54.140821+0000","last_peered":"2024-09-21T22:16:54.140821+0000","last_clean":"2024-09-21T22:16:54.140821+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:16:54.140821+0000","last_undegraded":"2024-09-21T22:16:54.140821+0000","last_fullsized":"2024-09-21T22:16:54.140821+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:52.059790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030173909999999999,"stat_sum":{"num_bytes":4161521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1752,"num_read_kb":5252,"num_write":237,"num_write_kb":9079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.b","version":"95'618","reported_seq":1772,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:52.966891+0000","last_change":"2024-09-21T22:16:50.961331+0000","last_active":"2024-09-21T22:16:52.966891+0000","last_peered":"2024-09-21T22:16:52.966891+0000","last_clean":"2024-09-21T22:16:52.966891+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:16:52.966891+0000","last_undegraded":"2024-09-21T22:16:52.966891+0000","last_fullsized":"2024-09-21T22:16:52.966891+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:30:09.057867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040501300000000002,"stat_sum":{"num_bytes":12654871,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4089,"num_read_kb":12505,"num_write":874,"num_write_kb":12241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.c","version":"86'91","reported_seq":658,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.138905+0000","last_change":"2024-09-21T22:16:54.105790+0000","last_active":"2024-09-21T22:16:54.138905+0000","last_peered":"2024-09-21T22:16:54.138905+0000","last_clean":"2024-09-21T22:16:54.138905+0000","last_became_active":"2024-09-21T22:16:00.921657+0000","last_became_peered":"2024-09-21T22:16:00.921657+0000","last_unstale":"2024-09-21T22:16:54.138905+0000","last_undegraded":"2024-09-21T22:16:54.138905+0000","last_fullsized":"2024-09-21T22:16:54.138905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:22:37.343079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036080699999999999,"stat_sum":{"num_bytes":10147696,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":391,"num_read_kb":15249,"num_write":102,"num_write_kb":10187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.d","version":"95'228","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.140731+0000","last_change":"2024-09-21T22:16:54.141129+0000","last_active":"2024-09-21T22:16:54.140731+0000","last_peered":"2024-09-21T22:16:54.140731+0000","last_clean":"2024-09-21T22:16:54.140731+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:16:54.140731+0000","last_undegraded":"2024-09-21T22:16:54.140731+0000","last_fullsized":"2024-09-21T22:16:54.140731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:38.069101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029797629999999999,"stat_sum":{"num_bytes":10321996,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":785,"num_read_kb":13568,"num_write":345,"num_write_kb":13540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.e","version":"96'95","reported_seq":666,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.136500+0000","last_change":"2024-09-21T22:16:53.988662+0000","last_active":"2024-09-21T22:16:54.136500+0000","last_peered":"2024-09-21T22:16:54.136500+0000","last_clean":"2024-09-21T22:16:54.136500+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:16:54.136500+0000","last_undegraded":"2024-09-21T22:16:54.136500+0000","last_fullsized":"2024-09-21T22:16:54.136500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:15:21.227854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051066900000000005,"stat_sum":{"num_bytes":4459101,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":159,"num_read_kb":6255,"num_write":170,"num_write_kb":9929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.f","version":"96'276","reported_seq":1309,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988867+0000","last_change":"2024-09-21T22:16:53.988867+0000","last_active":"2024-09-21T22:16:53.988867+0000","last_peered":"2024-09-21T22:16:53.988867+0000","last_clean":"2024-09-21T22:16:53.988867+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:16:53.988867+0000","last_undegraded":"2024-09-21T22:16:53.988867+0000","last_fullsized":"2024-09-21T22:16:53.988867+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:29:19.326590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065174600000000003,"stat_sum":{"num_bytes":11731551,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1176,"num_read_kb":9206,"num_write":352,"num_write_kb":12309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.10","version":"95'139","reported_seq":1262,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.138270+0000","last_change":"2024-09-21T22:16:54.138651+0000","last_active":"2024-09-21T22:16:54.138270+0000","last_peered":"2024-09-21T22:16:54.138270+0000","last_clean":"2024-09-21T22:16:54.138270+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:16:54.138270+0000","last_undegraded":"2024-09-21T22:16:54.138270+0000","last_fullsized":"2024-09-21T22:16:54.138270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:01.162021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052826000000000001,"stat_sum":{"num_bytes":20907480,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":849,"num_read_kb":15312,"num_write":168,"num_write_kb":8729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.11","version":"95'107","reported_seq":1019,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988204+0000","last_change":"2024-09-21T22:16:53.988401+0000","last_active":"2024-09-21T22:16:53.988204+0000","last_peered":"2024-09-21T22:16:53.988204+0000","last_clean":"2024-09-21T22:16:53.988204+0000","last_became_active":"2024-09-21T22:16:48.956681+0000","last_became_peered":"2024-09-21T22:16:48.956681+0000","last_unstale":"2024-09-21T22:16:53.988204+0000","last_undegraded":"2024-09-21T22:16:53.988204+0000","last_fullsized":"2024-09-21T22:16:53.988204+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:58:38.408331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046433599999999998,"stat_sum":{"num_bytes":10759225,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":452,"num_read_kb":10790,"num_write":117,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":11486398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.12","version":"96'305","reported_seq":5857,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.267325+0000","last_change":"2024-09-21T22:16:53.987291+0000","last_active":"2024-09-21T22:16:54.267325+0000","last_peered":"2024-09-21T22:16:54.267325+0000","last_clean":"2024-09-21T22:16:54.267325+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:16:54.267325+0000","last_undegraded":"2024-09-21T22:16:54.267325+0000","last_fullsized":"2024-09-21T22:16:54.267325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:41.577072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001487688,"stat_sum":{"num_bytes":15587996,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":6204,"num_read_kb":13821,"num_write":431,"num_write_kb":12909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.13","version":"93'467","reported_seq":10287,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988462+0000","last_change":"2024-09-21T22:16:53.988646+0000","last_active":"2024-09-21T22:16:53.988462+0000","last_peered":"2024-09-21T22:16:53.988462+0000","last_clean":"2024-09-21T22:16:53.988462+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:16:53.988462+0000","last_undegraded":"2024-09-21T22:16:53.988462+0000","last_fullsized":"2024-09-21T22:16:53.988462+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:56:00.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054593000000000003,"stat_sum":{"num_bytes":36442440,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":10909,"num_read_kb":38579,"num_write":678,"num_write_kb":13477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":649131754,"num_objects":492,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":102207,"num_read_kb":562812,"num_write":13509,"num_write_kb":452326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1154,"num_bytes_recovered":137648407,"num_keys_recovered":223,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331010048,"data_stored":329254332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9164,"ondisk_log_size":9164,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72992,"kb_used_data":33480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298848,"statfs":{"total":96636764160,"available":96562020352,"internally_reserved":0,"allocated":34283520,"data_stored":33465677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45632,"kb_used_data":14444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326208,"statfs":{"total":96636764160,"available":96590036992,"internally_reserved":0,"allocated":14790656,"data_stored":14108005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86284,"kb_used_data":46772,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94285556,"statfs":{"total":96636764160,"available":96548409344,"internally_reserved":0,"allocated":47894528,"data_stored":47057088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84592,"kb_used_data":57560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94287248,"statfs":{"total":96636764160,"available":96550141952,"internally_reserved":0,"allocated":58941440,"data_stored":58038787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528332,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92752,"kb_used_data":52156,"kb_used_omap":4,"kb_used_meta":40571,"kb_avail":94279088,"statfs":{"total":96636764160,"available":96541786112,"internally_reserved":0,"allocated":53407744,"data_stored":52493099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":41545394},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":24024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":24600576,"data_stored":23867269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78156,"kb_used_data":42812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94293684,"statfs":{"total":96636764160,"available":96556732416,"internally_reserved":0,"allocated":43839488,"data_stored":43030469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123632,"kb_used_data":61920,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94248208,"statfs":{"total":96636764160,"available":96510164992,"internally_reserved":0,"allocated":63406080,"data_stored":62566289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61693952,"data_stored":61450261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42700800,"data_stored":42492195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23449600,"data_stored":23322745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52281344,"data_stored":51961137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57876480,"data_stored":57563653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":46796800,"data_stored":46554951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13660160,"data_stored":13572352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32550912,"data_stored":32337038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:16:58.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:16:58.374 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:58.373+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1600 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1736704~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.820803748000003, 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010982052000000001, 2024-09-21T22:16:58.387 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1600 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564202+0000", 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5600000000000001e-07 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564205+0000", 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9299999999999999e-06 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564212+0000", 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4359999999999999e-06 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564218+0000", 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4420000000000003e-06 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.574964+0000", 2024-09-21T22:16:58.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010745813 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575046+0000", 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2076999999999994e-05 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575184+0000", 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013799799999999999 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.820761743000006, 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:16:58.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:16:58.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.395 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.820664281000006, 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.820609224999998, 2024-09-21T22:16:58.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:16:58.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.820567218999997, 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:16:58.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:16:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.820506621000007, 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.407 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.820484428, 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.819579621000003, 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 71.864144889000002, 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.419 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:16:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:16:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 71.861005646999999, 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.424 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:16:58.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:16:58.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:16:58.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 62.767992022000001, 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.428 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:58.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.812126730000003, 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.433 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:16:58.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:16:58.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.438 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.706288180000001, 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:58.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:16:58.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.705271605, 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:16:58.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:16:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 51.704903838999996, 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.18656154, 2024-09-21T22:16:58.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.184685659000003, 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.914943363999999, 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:16:58.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 29.799173532000001, 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.470 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 10.421360312000001, 2024-09-21T22:16:58.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:16:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:16:58.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:16:58.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:16:58.480 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:16:58.480 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:58.480 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:16:58.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:16:58.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:58.479+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:58.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:16:58.580+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:16:58.601 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:16:58.601 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:16:58.617 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:16:58.618 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:16:58.627 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:16:58.627 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:16:58.627 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:16:58.628 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:16:58.633 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:16:58.633 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:16:58.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:16:58.649 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:16:58.649 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:16:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:16:58.662 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:16:58.665 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:16:58.666 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:16:58.675 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-21T22:16:57.993851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649722141,"num_objects":496,"num_object_clones":0,"num_object_copies":992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":102323,"num_read_kb":562912,"num_write":13670,"num_write_kb":454744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1154,"num_bytes_recovered":137648407,"num_keys_recovered":223,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9284,"ondisk_log_size":9284,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":639276,"kb_used_data":333168,"kb_used_omap":15,"kb_used_meta":305904,"kb_avail":754335444,"statfs":{"total":773094113280,"available":772439494656,"internally_reserved":0,"allocated":341164032,"data_stored":334626683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":313246492},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43682165,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":1794,"num_read_kb":65391,"num_write":181,"num_write_kb":27399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.020017"},"pg_stats":[{"pgid":"3.1f","version":"95'412","reported_seq":9350,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.985885+0000","last_change":"2024-09-21T22:16:53.985885+0000","last_active":"2024-09-21T22:16:53.985885+0000","last_peered":"2024-09-21T22:16:53.985885+0000","last_clean":"2024-09-21T22:16:53.985885+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:16:53.985885+0000","last_undegraded":"2024-09-21T22:16:53.985885+0000","last_fullsized":"2024-09-21T22:16:53.985885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:24:45.083296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000413729,"stat_sum":{"num_bytes":39948669,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":9870,"num_read_kb":37335,"num_write":678,"num_write_kb":18836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1e","version":"95'346","reported_seq":2465,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.016666+0000","last_change":"2024-09-21T22:16:50.961553+0000","last_active":"2024-09-21T22:16:53.016666+0000","last_peered":"2024-09-21T22:16:53.016666+0000","last_clean":"2024-09-21T22:16:53.016666+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:16:53.016666+0000","last_undegraded":"2024-09-21T22:16:53.016666+0000","last_fullsized":"2024-09-21T22:16:53.016666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:21:50.664025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040109800000000001,"stat_sum":{"num_bytes":16476761,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":3105,"num_read_kb":14826,"num_write":344,"num_write_kb":10631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.1d","version":"95'191","reported_seq":6743,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.106008+0000","last_change":"2024-09-21T22:16:54.106216+0000","last_active":"2024-09-21T22:16:54.106008+0000","last_peered":"2024-09-21T22:16:54.106008+0000","last_clean":"2024-09-21T22:16:54.106008+0000","last_became_active":"2024-09-21T22:16:48.959075+0000","last_became_peered":"2024-09-21T22:16:48.959075+0000","last_unstale":"2024-09-21T22:16:54.106008+0000","last_undegraded":"2024-09-21T22:16:54.106008+0000","last_fullsized":"2024-09-21T22:16:54.106008+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:17.890361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050951999999999996,"stat_sum":{"num_bytes":50943552,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6430,"num_read_kb":39817,"num_write":304,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1c","version":"95'524","reported_seq":1513,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.106238+0000","last_change":"2024-09-21T22:16:54.105963+0000","last_active":"2024-09-21T22:16:54.106238+0000","last_peered":"2024-09-21T22:16:54.106238+0000","last_clean":"2024-09-21T22:16:54.106238+0000","last_became_active":"2024-09-21T22:16:48.959089+0000","last_became_peered":"2024-09-21T22:16:48.959089+0000","last_unstale":"2024-09-21T22:16:54.106238+0000","last_undegraded":"2024-09-21T22:16:54.106238+0000","last_fullsized":"2024-09-21T22:16:54.106238+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:03:05.649626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052192799999999995,"stat_sum":{"num_bytes":18989036,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":2223,"num_read_kb":19128,"num_write":953,"num_write_kb":19153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1b","version":"95'150","reported_seq":1140,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987361+0000","last_change":"2024-09-21T22:16:53.987765+0000","last_active":"2024-09-21T22:16:53.987361+0000","last_peered":"2024-09-21T22:16:53.987361+0000","last_clean":"2024-09-21T22:16:53.987361+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:16:53.987361+0000","last_undegraded":"2024-09-21T22:16:53.987361+0000","last_fullsized":"2024-09-21T22:16:53.987361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:50:10.557448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084166700000000004,"stat_sum":{"num_bytes":17869949,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":781,"num_read_kb":12522,"num_write":240,"num_write_kb":13018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.1a","version":"96'134","reported_seq":1386,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.262941+0000","last_change":"2024-09-21T22:16:53.974680+0000","last_active":"2024-09-21T22:16:54.262941+0000","last_peered":"2024-09-21T22:16:54.262941+0000","last_clean":"2024-09-21T22:16:54.262941+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:16:54.262941+0000","last_undegraded":"2024-09-21T22:16:54.262941+0000","last_fullsized":"2024-09-21T22:16:54.262941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:02:55.438480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035682299999999998,"stat_sum":{"num_bytes":5162986,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1077,"num_read_kb":3375,"num_write":166,"num_write_kb":9582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.19","version":"95'342","reported_seq":1846,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984644+0000","last_change":"2024-09-21T22:16:53.980003+0000","last_active":"2024-09-21T22:16:54.984644+0000","last_peered":"2024-09-21T22:16:54.984644+0000","last_clean":"2024-09-21T22:16:54.984644+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:16:54.984644+0000","last_undegraded":"2024-09-21T22:16:54.984644+0000","last_fullsized":"2024-09-21T22:16:54.984644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:01:39.276867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044375300000000002,"stat_sum":{"num_bytes":11403353,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":2562,"num_read_kb":10238,"num_write":443,"num_write_kb":12749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.18","version":"95'505","reported_seq":1044,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.314058+0000","last_change":"2024-09-21T22:16:50.962040+0000","last_active":"2024-09-21T22:16:53.314058+0000","last_peered":"2024-09-21T22:16:53.314058+0000","last_clean":"2024-09-21T22:16:53.314058+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:16:53.314058+0000","last_undegraded":"2024-09-21T22:16:53.314058+0000","last_fullsized":"2024-09-21T22:16:53.314058+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:00:20.621374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064368300000000004,"stat_sum":{"num_bytes":20721344,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1669,"num_read_kb":14047,"num_write":724,"num_write_kb":19793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.17","version":"95'691","reported_seq":1749,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.986361+0000","last_change":"2024-09-21T22:16:53.986361+0000","last_active":"2024-09-21T22:16:53.986361+0000","last_peered":"2024-09-21T22:16:53.986361+0000","last_clean":"2024-09-21T22:16:53.986361+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:16:53.986361+0000","last_undegraded":"2024-09-21T22:16:53.986361+0000","last_fullsized":"2024-09-21T22:16:53.986361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:46:28.765276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068442999999999998,"stat_sum":{"num_bytes":12052514,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3811,"num_read_kb":15866,"num_write":1320,"num_write_kb":16241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.16","version":"83'138","reported_seq":13082,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984705+0000","last_change":"2024-09-21T22:16:53.981573+0000","last_active":"2024-09-21T22:16:54.984705+0000","last_peered":"2024-09-21T22:16:54.984705+0000","last_clean":"2024-09-21T22:16:54.984705+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:16:54.984705+0000","last_undegraded":"2024-09-21T22:16:54.984705+0000","last_fullsized":"2024-09-21T22:16:54.984705+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:52:28.921941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001412504,"stat_sum":{"num_bytes":40934626,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13488,"num_read_kb":43828,"num_write":223,"num_write_kb":11567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.15","version":"95'575","reported_seq":2533,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988259+0000","last_change":"2024-09-21T22:16:53.988466+0000","last_active":"2024-09-21T22:16:53.988259+0000","last_peered":"2024-09-21T22:16:53.988259+0000","last_clean":"2024-09-21T22:16:53.988259+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:16:53.988259+0000","last_undegraded":"2024-09-21T22:16:53.988259+0000","last_fullsized":"2024-09-21T22:16:53.988259+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:14:04.045090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044674100000000001,"stat_sum":{"num_bytes":43468110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3571,"num_read_kb":25284,"num_write":941,"num_write_kb":22880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.14","version":"95'217","reported_seq":1579,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.974778+0000","last_change":"2024-09-21T22:16:53.974942+0000","last_active":"2024-09-21T22:16:53.974778+0000","last_peered":"2024-09-21T22:16:53.974778+0000","last_clean":"2024-09-21T22:16:53.974778+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:16:53.974778+0000","last_undegraded":"2024-09-21T22:16:53.974778+0000","last_fullsized":"2024-09-21T22:16:53.974778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:12:26.992563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053372000000000001,"stat_sum":{"num_bytes":36424290,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1017,"num_read_kb":10309,"num_write":263,"num_write_kb":10796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.138060+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:16:54.138060+0000","last_peered":"2024-09-21T22:16:54.138060+0000","last_clean":"2024-09-21T22:16:54.138060+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:16:54.138060+0000","last_undegraded":"2024-09-21T22:16:54.138060+0000","last_fullsized":"2024-09-21T22:16:54.138060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"95'248","reported_seq":2028,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987379+0000","last_change":"2024-09-21T22:16:53.987379+0000","last_active":"2024-09-21T22:16:53.987379+0000","last_peered":"2024-09-21T22:16:53.987379+0000","last_clean":"2024-09-21T22:16:53.987379+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:16:53.987379+0000","last_undegraded":"2024-09-21T22:16:53.987379+0000","last_fullsized":"2024-09-21T22:16:53.987379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:07.315081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139012,"stat_sum":{"num_bytes":29363518,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2306,"num_read_kb":25977,"num_write":294,"num_write_kb":19744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984790+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:16:54.984790+0000","last_peered":"2024-09-21T22:16:54.984790+0000","last_clean":"2024-09-21T22:16:54.984790+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:16:54.984790+0000","last_undegraded":"2024-09-21T22:16:54.984790+0000","last_fullsized":"2024-09-21T22:16:54.984790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"95'205","reported_seq":1399,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.331292+0000","last_change":"2024-09-21T22:16:50.963055+0000","last_active":"2024-09-21T22:16:53.331292+0000","last_peered":"2024-09-21T22:16:53.331292+0000","last_clean":"2024-09-21T22:16:53.331292+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:16:53.331292+0000","last_undegraded":"2024-09-21T22:16:53.331292+0000","last_fullsized":"2024-09-21T22:16:53.331292+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:19:14.792866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039435300000000001,"stat_sum":{"num_bytes":22985902,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1293,"num_read_kb":13957,"num_write":264,"num_write_kb":12105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988058+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:16:53.988058+0000","last_peered":"2024-09-21T22:16:53.988058+0000","last_clean":"2024-09-21T22:16:53.988058+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:16:53.988058+0000","last_undegraded":"2024-09-21T22:16:53.988058+0000","last_fullsized":"2024-09-21T22:16:53.988058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"97'211","reported_seq":8787,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:55.006284+0000","last_change":"2024-09-21T22:16:53.981682+0000","last_active":"2024-09-21T22:16:55.006284+0000","last_peered":"2024-09-21T22:16:55.006284+0000","last_clean":"2024-09-21T22:16:55.006284+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:16:55.006284+0000","last_undegraded":"2024-09-21T22:16:55.006284+0000","last_fullsized":"2024-09-21T22:16:55.006284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:03.477607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016743249999999999,"stat_sum":{"num_bytes":33531737,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":8461,"num_read_kb":36977,"num_write":244,"num_write_kb":16438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984709+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:16:54.984709+0000","last_peered":"2024-09-21T22:16:54.984709+0000","last_clean":"2024-09-21T22:16:54.984709+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:16:54.984709+0000","last_undegraded":"2024-09-21T22:16:54.984709+0000","last_fullsized":"2024-09-21T22:16:54.984709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"96'145","reported_seq":1484,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.106030+0000","last_change":"2024-09-21T22:16:54.106030+0000","last_active":"2024-09-21T22:16:54.106030+0000","last_peered":"2024-09-21T22:16:54.106030+0000","last_clean":"2024-09-21T22:16:54.106030+0000","last_became_active":"2024-09-21T22:16:00.921655+0000","last_became_peered":"2024-09-21T22:16:00.921655+0000","last_unstale":"2024-09-21T22:16:54.106030+0000","last_undegraded":"2024-09-21T22:16:54.106030+0000","last_fullsized":"2024-09-21T22:16:54.106030+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:57:11.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052248799999999999,"stat_sum":{"num_bytes":18085375,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1035,"num_read_kb":17596,"num_write":256,"num_write_kb":11424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.3","version":"96'146","reported_seq":836,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.136763+0000","last_change":"2024-09-21T22:16:53.974912+0000","last_active":"2024-09-21T22:16:54.136763+0000","last_peered":"2024-09-21T22:16:54.136763+0000","last_clean":"2024-09-21T22:16:54.136763+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:16:54.136763+0000","last_undegraded":"2024-09-21T22:16:54.136763+0000","last_fullsized":"2024-09-21T22:16:54.136763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:54.192084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055758999999999995,"stat_sum":{"num_bytes":9100862,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":430,"num_read_kb":10027,"num_write":194,"num_write_kb":12126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":170,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.105416+0000","last_change":"2024-09-21T22:15:28.404590+0000","last_active":"2024-09-21T22:16:54.105416+0000","last_peered":"2024-09-21T22:16:54.105416+0000","last_clean":"2024-09-21T22:16:54.105416+0000","last_became_active":"2024-09-21T22:15:26.399210+0000","last_became_peered":"2024-09-21T22:15:26.399210+0000","last_unstale":"2024-09-21T22:16:54.105416+0000","last_undegraded":"2024-09-21T22:16:54.105416+0000","last_fullsized":"2024-09-21T22:16:54.105416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:59.264524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"93'426","reported_seq":7372,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.984611+0000","last_change":"2024-09-21T22:16:53.981045+0000","last_active":"2024-09-21T22:16:54.984611+0000","last_peered":"2024-09-21T22:16:54.984611+0000","last_clean":"2024-09-21T22:16:54.984611+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:16:54.984611+0000","last_undegraded":"2024-09-21T22:16:54.984611+0000","last_fullsized":"2024-09-21T22:16:54.984611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:51.767696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014541199999999999,"stat_sum":{"num_bytes":28409453,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":7730,"num_read_kb":30543,"num_write":603,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.981416+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:16:54.981416+0000","last_peered":"2024-09-21T22:16:54.981416+0000","last_clean":"2024-09-21T22:16:54.981416+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:16:54.981416+0000","last_undegraded":"2024-09-21T22:16:54.981416+0000","last_fullsized":"2024-09-21T22:16:54.981416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"95'174","reported_seq":1282,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.985607+0000","last_change":"2024-09-21T22:16:53.986088+0000","last_active":"2024-09-21T22:16:53.985607+0000","last_peered":"2024-09-21T22:16:53.985607+0000","last_clean":"2024-09-21T22:16:53.985607+0000","last_became_active":"2024-09-21T22:16:48.956575+0000","last_became_peered":"2024-09-21T22:16:48.956575+0000","last_unstale":"2024-09-21T22:16:53.985607+0000","last_undegraded":"2024-09-21T22:16:53.985607+0000","last_fullsized":"2024-09-21T22:16:53.985607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:32:51.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066476000000000003,"stat_sum":{"num_bytes":9370304,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":730,"num_read_kb":8340,"num_write":239,"num_write_kb":13790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6594455,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987831+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:16:53.987831+0000","last_peered":"2024-09-21T22:16:53.987831+0000","last_clean":"2024-09-21T22:16:53.987831+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:16:53.987831+0000","last_undegraded":"2024-09-21T22:16:53.987831+0000","last_fullsized":"2024-09-21T22:16:53.987831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"95'164","reported_seq":717,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.315738+0000","last_change":"2024-09-21T22:16:50.962765+0000","last_active":"2024-09-21T22:16:53.315738+0000","last_peered":"2024-09-21T22:16:53.315738+0000","last_clean":"2024-09-21T22:16:53.315738+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:16:53.315738+0000","last_undegraded":"2024-09-21T22:16:53.315738+0000","last_fullsized":"2024-09-21T22:16:53.315738+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:36:09.497302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343393,"stat_sum":{"num_bytes":17685219,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":485,"num_read_kb":13798,"num_write":223,"num_write_kb":19108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":169,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.105283+0000","last_change":"2024-09-21T22:15:28.404062+0000","last_active":"2024-09-21T22:16:54.105283+0000","last_peered":"2024-09-21T22:16:54.105283+0000","last_clean":"2024-09-21T22:16:54.105283+0000","last_became_active":"2024-09-21T22:15:26.404561+0000","last_became_peered":"2024-09-21T22:15:26.404561+0000","last_unstale":"2024-09-21T22:16:54.105283+0000","last_undegraded":"2024-09-21T22:16:54.105283+0000","last_fullsized":"2024-09-21T22:16:54.105283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:37.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":319,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.987928+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:16:53.987928+0000","last_peered":"2024-09-21T22:16:53.987928+0000","last_clean":"2024-09-21T22:16:53.987928+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:16:53.987928+0000","last_undegraded":"2024-09-21T22:16:53.987928+0000","last_fullsized":"2024-09-21T22:16:53.987928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"95'487","reported_seq":1238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.355886+0000","last_change":"2024-09-21T22:16:50.962259+0000","last_active":"2024-09-21T22:16:53.355886+0000","last_peered":"2024-09-21T22:16:53.355886+0000","last_clean":"2024-09-21T22:16:53.355886+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:16:53.355886+0000","last_undegraded":"2024-09-21T22:16:53.355886+0000","last_fullsized":"2024-09-21T22:16:53.355886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:56.746271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062274599999999998,"stat_sum":{"num_bytes":17100594,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":2064,"num_read_kb":8852,"num_write":816,"num_write_kb":14193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.9","version":"96'187","reported_seq":1153,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.974682+0000","last_change":"2024-09-21T22:16:53.974682+0000","last_active":"2024-09-21T22:16:53.974682+0000","last_peered":"2024-09-21T22:16:53.974682+0000","last_clean":"2024-09-21T22:16:53.974682+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:16:53.974682+0000","last_undegraded":"2024-09-21T22:16:53.974682+0000","last_fullsized":"2024-09-21T22:16:53.974682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:30:32.037894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035437199999999999,"stat_sum":{"num_bytes":11929723,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1303,"num_read_kb":9633,"num_write":303,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.a","version":"94'220","reported_seq":1441,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.140821+0000","last_change":"2024-09-21T22:16:54.141166+0000","last_active":"2024-09-21T22:16:54.140821+0000","last_peered":"2024-09-21T22:16:54.140821+0000","last_clean":"2024-09-21T22:16:54.140821+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:16:54.140821+0000","last_undegraded":"2024-09-21T22:16:54.140821+0000","last_fullsized":"2024-09-21T22:16:54.140821+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:52.059790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030173909999999999,"stat_sum":{"num_bytes":4161521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1752,"num_read_kb":5252,"num_write":237,"num_write_kb":9079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.b","version":"95'618","reported_seq":1772,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-21T22:16:52.966891+0000","last_change":"2024-09-21T22:16:50.961331+0000","last_active":"2024-09-21T22:16:52.966891+0000","last_peered":"2024-09-21T22:16:52.966891+0000","last_clean":"2024-09-21T22:16:52.966891+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:16:52.966891+0000","last_undegraded":"2024-09-21T22:16:52.966891+0000","last_fullsized":"2024-09-21T22:16:52.966891+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:30:09.057867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040501300000000002,"stat_sum":{"num_bytes":12654871,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4089,"num_read_kb":12505,"num_write":874,"num_write_kb":12241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"}]},{"pgid":"3.c","version":"86'91","reported_seq":658,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.138905+0000","last_change":"2024-09-21T22:16:54.105790+0000","last_active":"2024-09-21T22:16:54.138905+0000","last_peered":"2024-09-21T22:16:54.138905+0000","last_clean":"2024-09-21T22:16:54.138905+0000","last_became_active":"2024-09-21T22:16:00.921657+0000","last_became_peered":"2024-09-21T22:16:00.921657+0000","last_unstale":"2024-09-21T22:16:54.138905+0000","last_undegraded":"2024-09-21T22:16:54.138905+0000","last_fullsized":"2024-09-21T22:16:54.138905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:22:37.343079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036080699999999999,"stat_sum":{"num_bytes":10147696,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":391,"num_read_kb":15249,"num_write":102,"num_write_kb":10187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.d","version":"95'228","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.140731+0000","last_change":"2024-09-21T22:16:54.141129+0000","last_active":"2024-09-21T22:16:54.140731+0000","last_peered":"2024-09-21T22:16:54.140731+0000","last_clean":"2024-09-21T22:16:54.140731+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:16:54.140731+0000","last_undegraded":"2024-09-21T22:16:54.140731+0000","last_fullsized":"2024-09-21T22:16:54.140731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:38.069101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029797629999999999,"stat_sum":{"num_bytes":10321996,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":785,"num_read_kb":13568,"num_write":345,"num_write_kb":13540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.e","version":"96'95","reported_seq":666,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.136500+0000","last_change":"2024-09-21T22:16:53.988662+0000","last_active":"2024-09-21T22:16:54.136500+0000","last_peered":"2024-09-21T22:16:54.136500+0000","last_clean":"2024-09-21T22:16:54.136500+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:16:54.136500+0000","last_undegraded":"2024-09-21T22:16:54.136500+0000","last_fullsized":"2024-09-21T22:16:54.136500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:15:21.227854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051066900000000005,"stat_sum":{"num_bytes":4459101,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":159,"num_read_kb":6255,"num_write":170,"num_write_kb":9929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.f","version":"96'276","reported_seq":1309,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988867+0000","last_change":"2024-09-21T22:16:53.988867+0000","last_active":"2024-09-21T22:16:53.988867+0000","last_peered":"2024-09-21T22:16:53.988867+0000","last_clean":"2024-09-21T22:16:53.988867+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:16:53.988867+0000","last_undegraded":"2024-09-21T22:16:53.988867+0000","last_fullsized":"2024-09-21T22:16:53.988867+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:29:19.326590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065174600000000003,"stat_sum":{"num_bytes":11731551,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1176,"num_read_kb":9206,"num_write":352,"num_write_kb":12309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.10","version":"95'139","reported_seq":1262,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.138270+0000","last_change":"2024-09-21T22:16:54.138651+0000","last_active":"2024-09-21T22:16:54.138270+0000","last_peered":"2024-09-21T22:16:54.138270+0000","last_clean":"2024-09-21T22:16:54.138270+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:16:54.138270+0000","last_undegraded":"2024-09-21T22:16:54.138270+0000","last_fullsized":"2024-09-21T22:16:54.138270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:01.162021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052826000000000001,"stat_sum":{"num_bytes":20907480,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":849,"num_read_kb":15312,"num_write":168,"num_write_kb":8729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.11","version":"95'107","reported_seq":1019,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988204+0000","last_change":"2024-09-21T22:16:53.988401+0000","last_active":"2024-09-21T22:16:53.988204+0000","last_peered":"2024-09-21T22:16:53.988204+0000","last_clean":"2024-09-21T22:16:53.988204+0000","last_became_active":"2024-09-21T22:16:48.956681+0000","last_became_peered":"2024-09-21T22:16:48.956681+0000","last_unstale":"2024-09-21T22:16:53.988204+0000","last_undegraded":"2024-09-21T22:16:53.988204+0000","last_fullsized":"2024-09-21T22:16:53.988204+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:58:38.408331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046433599999999998,"stat_sum":{"num_bytes":10759225,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":452,"num_read_kb":10790,"num_write":117,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":11486398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.12","version":"96'305","reported_seq":5857,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:54.267325+0000","last_change":"2024-09-21T22:16:53.987291+0000","last_active":"2024-09-21T22:16:54.267325+0000","last_peered":"2024-09-21T22:16:54.267325+0000","last_clean":"2024-09-21T22:16:54.267325+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:16:54.267325+0000","last_undegraded":"2024-09-21T22:16:54.267325+0000","last_fullsized":"2024-09-21T22:16:54.267325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:41.577072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001487688,"stat_sum":{"num_bytes":15587996,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":6204,"num_read_kb":13821,"num_write":431,"num_write_kb":12909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]},{"pgid":"3.13","version":"93'467","reported_seq":10287,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-21T22:16:53.988462+0000","last_change":"2024-09-21T22:16:53.988646+0000","last_active":"2024-09-21T22:16:53.988462+0000","last_peered":"2024-09-21T22:16:53.988462+0000","last_clean":"2024-09-21T22:16:53.988462+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:16:53.988462+0000","last_undegraded":"2024-09-21T22:16:53.988462+0000","last_fullsized":"2024-09-21T22:16:53.988462+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:56:00.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054593000000000003,"stat_sum":{"num_bytes":36442440,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":10909,"num_read_kb":38579,"num_write":678,"num_write_kb":13477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":649131754,"num_objects":492,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":102207,"num_read_kb":562812,"num_write":13509,"num_write_kb":452326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1154,"num_bytes_recovered":137648407,"num_keys_recovered":223,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331010048,"data_stored":329254332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9164,"ondisk_log_size":9164,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72992,"kb_used_data":33480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298848,"statfs":{"total":96636764160,"available":96562020352,"internally_reserved":0,"allocated":34283520,"data_stored":33465677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45632,"kb_used_data":14444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326208,"statfs":{"total":96636764160,"available":96590036992,"internally_reserved":0,"allocated":14790656,"data_stored":14108005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86284,"kb_used_data":46772,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94285556,"statfs":{"total":96636764160,"available":96548409344,"internally_reserved":0,"allocated":47894528,"data_stored":47057088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84592,"kb_used_data":57560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94287248,"statfs":{"total":96636764160,"available":96550141952,"internally_reserved":0,"allocated":58941440,"data_stored":58038787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528332,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92752,"kb_used_data":52156,"kb_used_omap":4,"kb_used_meta":40571,"kb_avail":94279088,"statfs":{"total":96636764160,"available":96541786112,"internally_reserved":0,"allocated":53407744,"data_stored":52493099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":41545394},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":24024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":24600576,"data_stored":23867269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78156,"kb_used_data":42812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94293684,"statfs":{"total":96636764160,"available":96556732416,"internally_reserved":0,"allocated":43839488,"data_stored":43030469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123632,"kb_used_data":61920,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94248208,"statfs":{"total":96636764160,"available":96510164992,"internally_reserved":0,"allocated":63406080,"data_stored":62566289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61693952,"data_stored":61450261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42700800,"data_stored":42492195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23449600,"data_stored":23322745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52281344,"data_stored":51961137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57876480,"data_stored":57563653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":46796800,"data_stored":46554951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13660160,"data_stored":13572352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32550912,"data_stored":32337038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:16:58.676 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:16:58.677 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:16:58.677 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T22:16:58.677 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.000000 2024-09-21T22:16:58.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0 2024-09-21T22:16:58.683 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:58.682+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:58.684 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:16:58.685 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:16:58.701 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:16:58.701 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:16:58.718 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:16:58.718 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:16:58.741 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:58.742 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:58.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:16:58.792 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:58.791+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:58.885 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:58.883+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:58.895 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:58.895 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:58.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:16:58.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:16:58.986 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:58.984+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:58.994 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.5 primary-affinity to 0 (802) 2024-09-21T22:16:59.010 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:59.010 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:59.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:16:59.088 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:59.087+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:59.123 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:59.123 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:59.132 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:16:59.216 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:16:59.215+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:16:59.276 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:59.276 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:59.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:16:59.290 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:59.288+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:59.390 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:16:59.390+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:16:59.430 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:59.430 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:59.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:16:59.523 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:16:59.522+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:16:59.583 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:59.583 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:59.592 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:16:59.593 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:59.590+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:59.692 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:16:59.691+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:16:59.735 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:59.736 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:59.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:16:59.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:59.791+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:59.852 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:16:59.852 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:16:59.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:16:59.902 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:16:59.900+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:16:59.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:16:59.992+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:16:59.999 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:17:00.008 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:00.008 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:00.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:00.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:00.106+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:00.170 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:00.170 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:00.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:00.196 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:00.195+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:00.296 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:00.296+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:00.322 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:00.322 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:00.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:00.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:00.396+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:00.435 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:00.435 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:00.444 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:00.529 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:00.527+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:00.589 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:00.589 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:00.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:00.639 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:00.637+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:00.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:00.698+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:00.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:00.742 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:00.742 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:00.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:00.800 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:00.800+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:00.852 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:00.852 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:00.869 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:00.869 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:00.885 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:00.885 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:00.899 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:00.899 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:00.899 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:00.899 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:00.899 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:00.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:00.899+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:00.901 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:00.902 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:00.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:00.921 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:00.921 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:00.938 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:00.938 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:00.955 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:00.955 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:00.972 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:01.002 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:01.001+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:01.030 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.113468351000002, 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:17:01.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:17:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44893 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1638400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990736549000001, 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057317179000000003, 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44893 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037236+0000", 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037238+0000", 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.392e-06 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037241+0000", 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.224e-06 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037243+0000", 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2469999999999998e-06 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094462+0000", 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057218453000000002 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094503+0000", 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1247e-05 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094553+0000", 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0405999999999998e-05 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990726733999999, 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990717194999998, 2024-09-21T22:17:01.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:17:01.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:17:01.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990708354999999, 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:17:01.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990699149000001, 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:17:01.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990690175000001, 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:17:01.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:17:01.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.99068127, 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:17:01.061 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990659529999999, 2024-09-21T22:17:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:17:01.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:17:01.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990650106, 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:17:01.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:17:01.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:17:01.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990641206999999, 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:01.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:01.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.990632254000001, 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:17:01.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:17:01.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.989137510999999, 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:17:01.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.989127394, 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:17:01.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:17:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.989117888999999, 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:01.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.989104149999999, 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:17:01.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:17:01.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.98909484, 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:01.103 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.129083841, 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:17:01.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:17:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:17:01.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:17:01.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.109 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.125462420000002, 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:17:01.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:17:01.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:17:01.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.116 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.542991885999999, 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:17:01.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.123 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:01.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:01.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:01.122+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:01.138 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-21T22:17:01.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:01.223+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:01.261 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:01.261 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:01.261 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:01.261 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:01.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:01.355 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:01.353+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:01.392 INFO:teuthology.orchestra.run.smithi134.stdout:3262 write 0xdda375f thru 0xddacf18 (0x97ba bytes) 2024-09-21T22:17:01.395 INFO:teuthology.orchestra.run.smithi134.stdout:3263 writesame 0x7b5db71 thru 0x7b67842 data_size 0x3(0x9cd2 bytes) 2024-09-21T22:17:01.403 INFO:teuthology.orchestra.run.smithi134.stdout:3265 punch from 0x2defbd9 to 0x2dfe1d5, (0xe5fc bytes) 2024-09-21T22:17:01.404 INFO:teuthology.orchestra.run.smithi134.stdout:3266 read 0xbb2c11 thru 0xbbdbf6 (0xafe6 bytes) 2024-09-21T22:17:01.406 INFO:teuthology.orchestra.run.smithi134.stdout:3267 read 0xb063139 thru 0xb06a381 (0x7249 bytes) 2024-09-21T22:17:01.419 INFO:teuthology.orchestra.run.smithi134.stdout:3268 trunc from 0xddacf19 to 0x32b66c1 2024-09-21T22:17:01.422 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:01.422 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:01.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:01.425+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:3269 read 0x289422e thru 0x289c417 (0x81ea bytes) 2024-09-21T22:17:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:3272 punch from 0x2586146 to 0x258ed98, (0x8c52 bytes) 2024-09-21T22:17:01.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:01.443 INFO:teuthology.orchestra.run.smithi134.stdout:3274 write 0x821758c thru 0x8224ea1 (0xd916 bytes) 2024-09-21T22:17:01.450 INFO:teuthology.orchestra.run.smithi134.stdout:3275 trunc from 0x8224ea2 to 0xcbc6778 2024-09-21T22:17:01.457 INFO:teuthology.orchestra.run.smithi134.stdout:3277 trunc from 0xcbc6778 to 0xcf9abf2 2024-09-21T22:17:01.462 INFO:teuthology.orchestra.run.smithi134.stdout:3278 writesame 0x3b7ef8e thru 0x3b7f07d data_size 0xa(0xf0 bytes) 2024-09-21T22:17:01.464 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.464 INFO:teuthology.orchestra.run.smithi134.stdout:3281 punch from 0x3c31797 to 0x3c33809, (0x2072 bytes) 2024-09-21T22:17:01.464 INFO:teuthology.orchestra.run.smithi134.stdout:3282 punch from 0x33806ae to 0x338e830, (0xe182 bytes) 2024-09-21T22:17:01.464 INFO:teuthology.orchestra.run.smithi134.stdout:3284 read 0x32aef36 thru 0x32b6748 (0x7813 bytes) 2024-09-21T22:17:01.471 INFO:teuthology.orchestra.run.smithi134.stdout:3285 writesame 0xe502650 thru 0xe50b8f7 data_size 0x68(0x92a8 bytes) 2024-09-21T22:17:01.471 INFO:teuthology.orchestra.run.smithi134.stdout:3286 write 0x2ba5eaa thru 0x2ba938f (0x34e6 bytes) 2024-09-21T22:17:01.479 INFO:teuthology.orchestra.run.smithi134.stdout:3287 trunc from 0xe50b8f8 to 0x91f47a3 2024-09-21T22:17:01.488 INFO:teuthology.orchestra.run.smithi134.stdout:3288 write 0x37df6f9 thru 0x37e9c16 (0xa51e bytes) 2024-09-21T22:17:01.490 INFO:teuthology.orchestra.run.smithi134.stdout:3290 write 0x761f623 thru 0x762dda3 (0xe781 bytes) 2024-09-21T22:17:01.504 INFO:teuthology.orchestra.run.smithi134.stdout:3291 write 0xde4e29c thru 0xde5dbbc (0xf921 bytes) 2024-09-21T22:17:01.508 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.508 INFO:teuthology.orchestra.run.smithi134.stdout:3294 trunc from 0xde5dbbd to 0xe2d4d34 2024-09-21T22:17:01.521 INFO:teuthology.orchestra.run.smithi134.stdout:3296 trunc from 0xe2d4d34 to 0x8c50939 2024-09-21T22:17:01.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:01.526+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:01.545 INFO:teuthology.orchestra.run.smithi134.stdout:3297 write 0xb7da87e thru 0xb7de871 (0x3ff4 bytes) 2024-09-21T22:17:01.548 INFO:teuthology.orchestra.run.smithi134.stdout:3298 writesame 0x4cf59e1 thru 0x4cfef2c data_size 0x62(0x954c bytes) 2024-09-21T22:17:01.551 INFO:teuthology.orchestra.run.smithi134.stdout:3299 write 0x2bee763 thru 0x2bfa3b2 (0xbc50 bytes) 2024-09-21T22:17:01.565 INFO:teuthology.orchestra.run.smithi134.stdout:3301 trunc from 0xb7de872 to 0x2d3d740 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.068724705999998, 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:17:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:17:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:17:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:17:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.053541246999998, 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:17:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.042094809000005, 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.492007580999996, 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:17:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:17:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:17:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.436919818, 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:17:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:17:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.165827129, 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:17:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:17:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:17:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:17:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.160920554999997, 2024-09-21T22:17:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:17:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:17:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:17:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:17:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:17:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.157709955999998, 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.152688259000001, 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:17:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.150700927000003, 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:17:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:17:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.626847335999997, 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:40247 3.0 e71/23 3:0688b99e:::rbd_data.118542b14bcd.0000000000000281:head v 71'358, mlcod=71'356)", 2024-09-21T22:17:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.335638121999999, 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039211389999999997, 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234378+0000", 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9500000000000001e-07 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234387+0000", 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2599999999999994e-06 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234398+0000", 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234405+0000", 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234460+0000", 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4975999999999997e-05 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234482+0000", 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1407e-05 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238263+0000", 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037812039999999998 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238298+0000", 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5419000000000001e-05 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.583685724999999, 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:17:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.582184984000001, 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:17:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:45992 3.16 e76/63 3:6be7cafa:::rbd_data.1185af582f87.0000000000000002:head v 76'119, mlcod=74'117)", 2024-09-21T22:17:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.302150906000001, 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038321589999999999, 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:17:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267865+0000", 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9500000000000002e-07 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268183+0000", 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000318239 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268202+0000", 2024-09-21T22:17:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8732e-05 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268210+0000", 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7810000000000005e-06 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268292+0000", 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1990000000000006e-05 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268316+0000", 2024-09-21T22:17:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3915999999999999e-05 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271655+0000", 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00333892 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271697+0000", 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1986000000000001e-05 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97072 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'409, mlcod=84'406)", 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.647237218000001, 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039520709999999997, 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922780+0000", 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3740000000000001e-06 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922789+0000", 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922808+0000", 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8481000000000001e-05 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922822+0000", 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922885+0000", 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3336000000000005e-05 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922910+0000", 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5072999999999999e-05 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926670+0000", 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003760191 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926730+0000", 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0126e-05 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.602497996, 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:17:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.597613920000001, 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:17:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:17:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.596826223000001, 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:17:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.589818780999998, 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:17:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:17:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:17:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:01.664 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:01.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:01.667 INFO:teuthology.orchestra.run.smithi134.stdout:3302 write 0x93117a0 thru 0x93177cb (0x602c bytes) 2024-09-21T22:17:01.667 INFO:teuthology.orchestra.run.smithi134.stdout:3303 read 0x927694e thru 0x928264b (0xbcfe bytes) 2024-09-21T22:17:01.667 INFO:teuthology.orchestra.run.smithi134.stdout:3304 write 0x21b57c7 thru 0x21c4645 (0xee7f bytes) 2024-09-21T22:17:01.667 INFO:teuthology.orchestra.run.smithi134.stdout:3305 read 0x56d3b17 thru 0x56d5c8f (0x2179 bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3306 read 0x415cb41 thru 0x41671e8 (0xa6a8 bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3308 writesame 0x63431b0 thru 0x6352c53 data_size 0x6(0xfaa4 bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3309 punch from 0x6847f8f to 0x684e97d, (0x69ee bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3312 punch from 0x9342b0 to 0x93f2cf, (0xb01f bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3314 write 0xe6c1d0b thru 0xe6c44ff (0x27f5 bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3315 trunc from 0xe6c4500 to 0x1658c4b 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3317 writesame 0xa1fec54 thru 0xa20604f data_size 0x1a(0x73fc bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3321 read 0xba0251 thru 0xba65a1 (0x6351 bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3322 read 0x8cad1d thru 0x8d582a (0xab0e bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3323 write 0x6090a6c thru 0x6093118 (0x26ad bytes) 2024-09-21T22:17:01.668 INFO:teuthology.orchestra.run.smithi134.stdout:3325 read 0x7ed1d30 thru 0x7ed6d74 (0x5045 bytes) 2024-09-21T22:17:01.669 INFO:teuthology.orchestra.run.smithi134.stdout:3326 punch from 0x134c048 to 0x13536be, (0x7676 bytes) 2024-09-21T22:17:01.669 INFO:teuthology.orchestra.run.smithi134.stdout:3327 read 0x830497 thru 0x83d94e (0xd4b8 bytes) 2024-09-21T22:17:01.669 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.669 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:01.664+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:01.670 INFO:teuthology.orchestra.run.smithi134.stdout:3329 trunc from 0xa206050 to 0x503129a 2024-09-21T22:17:01.677 INFO:teuthology.orchestra.run.smithi134.stdout:3330 read 0x300ab3e thru 0x3018024 (0xd4e7 bytes) 2024-09-21T22:17:01.677 INFO:teuthology.orchestra.run.smithi134.stdout:3331 read 0x2ea2742 thru 0x2ea6e76 (0x4735 bytes) 2024-09-21T22:17:01.684 INFO:teuthology.orchestra.run.smithi134.stdout:3332 writesame 0x66e3451 thru 0x66e874a data_size 0x2b(0x52fa bytes) 2024-09-21T22:17:01.685 INFO:teuthology.orchestra.run.smithi134.stdout:3333 punch from 0x4664c1a to 0x46678ad, (0x2c93 bytes) 2024-09-21T22:17:01.687 INFO:teuthology.orchestra.run.smithi134.stdout:3335 trunc from 0x66e874b to 0x5593203 2024-09-21T22:17:01.694 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.694 INFO:teuthology.orchestra.run.smithi134.stdout:3337 read 0x4b7555f thru 0x4b7a5ac (0x504e bytes) 2024-09-21T22:17:01.696 INFO:teuthology.orchestra.run.smithi134.stdout:3338 trunc from 0x5593203 to 0x6b6b91e 2024-09-21T22:17:01.716 INFO:teuthology.orchestra.run.smithi134.stdout:3339 write 0xd6dd78e thru 0xd6e7abb (0xa32e bytes) 2024-09-21T22:17:01.718 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.719 INFO:teuthology.orchestra.run.smithi134.stdout:3343 read 0xfb4739 thru 0xfbb363 (0x6c2b bytes) 2024-09-21T22:17:01.719 INFO:teuthology.orchestra.run.smithi134.stdout:3344 writesame 0x21d63a4 thru 0x21d98c2 data_size 0x3(0x351f bytes) 2024-09-21T22:17:01.722 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.722 INFO:teuthology.orchestra.run.smithi134.stdout:3346 punch from 0x45c6936 to 0x45d5180, (0xe84a bytes) 2024-09-21T22:17:01.722 INFO:teuthology.orchestra.run.smithi134.stdout:3347 punch from 0x73a3a11 to 0x73b2daf, (0xf39e bytes) 2024-09-21T22:17:01.722 INFO:teuthology.orchestra.run.smithi134.stdout:3348 read 0x5eaa5be thru 0x5eb89ac (0xe3ef bytes) 2024-09-21T22:17:01.725 INFO:teuthology.orchestra.run.smithi134.stdout:3349 trunc from 0xd6e7abc to 0xaee7447 2024-09-21T22:17:01.732 INFO:teuthology.orchestra.run.smithi134.stdout:3350 write 0x1730f0d thru 0x173f365 (0xe459 bytes) 2024-09-21T22:17:01.745 INFO:teuthology.orchestra.run.smithi134.stdout:3351 trunc from 0xaee7447 to 0x1836618 2024-09-21T22:17:01.755 INFO:teuthology.orchestra.run.smithi134.stdout:3352 read 0x1615bd9 thru 0x16231a8 (0xd5d0 bytes) 2024-09-21T22:17:01.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:01.763+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:01.769 INFO:teuthology.orchestra.run.smithi134.stdout:3353 write 0x8572d02 thru 0x85828f4 (0xfbf3 bytes) 2024-09-21T22:17:01.771 INFO:teuthology.orchestra.run.smithi134.stdout:3354 read 0x5ff4ae8 thru 0x6004a44 (0xff5d bytes) 2024-09-21T22:17:01.771 INFO:teuthology.orchestra.run.smithi134.stdout:3355 write 0x436c541 thru 0x43762ff (0x9dbf bytes) 2024-09-21T22:17:01.773 INFO:teuthology.orchestra.run.smithi134.stdout:3356 read 0x246aa89 thru 0x247655f (0xbad7 bytes) 2024-09-21T22:17:01.773 INFO:teuthology.orchestra.run.smithi134.stdout:3358 trunc from 0x85828f5 to 0x8d98279 2024-09-21T22:17:01.779 INFO:teuthology.orchestra.run.smithi134.stdout:3359 punch from 0x142f08e to 0x14310d0, (0x2042 bytes) 2024-09-21T22:17:01.779 INFO:teuthology.orchestra.run.smithi134.stdout:3361 read 0x6ca25f1 thru 0x6cb09ae (0xe3be bytes) 2024-09-21T22:17:01.779 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:01.779 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:01.780 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:01.780 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:01.780 INFO:teuthology.orchestra.run.smithi134.stdout:3362 read 0x62877b9 thru 0x628a1db (0x2a23 bytes) 2024-09-21T22:17:01.780 INFO:teuthology.orchestra.run.smithi134.stdout:3363 write 0x38be59c thru 0x38c92c0 (0xad25 bytes) 2024-09-21T22:17:01.781 INFO:teuthology.orchestra.run.smithi134.stdout:3364 read 0x26d92a0 thru 0x26d955a (0x2bb bytes) 2024-09-21T22:17:01.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:01.791 INFO:teuthology.orchestra.run.smithi134.stdout:3365 trunc from 0x8d98279 to 0xe71b34 2024-09-21T22:17:01.799 INFO:teuthology.orchestra.run.smithi134.stdout:3366 trunc from 0xe71b34 to 0x1fe0778 2024-09-21T22:17:01.810 INFO:teuthology.orchestra.run.smithi134.stdout:3367 trunc from 0x1fe0778 to 0x705b1cf 2024-09-21T22:17:01.815 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.815 INFO:teuthology.orchestra.run.smithi134.stdout:3369 read 0x2d1ea9a thru 0x2d25492 (0x69f9 bytes) 2024-09-21T22:17:01.816 INFO:teuthology.orchestra.run.smithi134.stdout:3370 writesame 0x19bdb3a thru 0x19c8ea4 data_size 0x1(0xb36b bytes) 2024-09-21T22:17:01.845 INFO:teuthology.orchestra.run.smithi134.stdout:3371 read 0x3908475 thru 0x391417c (0xbd08 bytes) 2024-09-21T22:17:01.845 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.855 INFO:teuthology.orchestra.run.smithi134.stdout:3374 write 0xa044510 thru 0xa04c5b1 (0x80a2 bytes) 2024-09-21T22:17:01.858 INFO:teuthology.orchestra.run.smithi134.stdout:3375 write 0x122a432 thru 0x1239194 (0xed63 bytes) 2024-09-21T22:17:01.859 INFO:teuthology.orchestra.run.smithi134.stdout:3376 read 0x835a662 thru 0x8366861 (0xc200 bytes) 2024-09-21T22:17:01.860 INFO:teuthology.orchestra.run.smithi134.stdout:3377 punch from 0x4b74c2d to 0x4b82e4c, (0xe21f bytes) 2024-09-21T22:17:01.866 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:01.865+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:01.869 INFO:teuthology.orchestra.run.smithi134.stdout:3378 trunc from 0xa04c5b2 to 0x266ddff 2024-09-21T22:17:01.881 INFO:teuthology.orchestra.run.smithi134.stdout:3379 trunc from 0x266ddff to 0x3ab27ee 2024-09-21T22:17:01.892 INFO:teuthology.orchestra.run.smithi134.stdout:3380 read 0x16a33ed thru 0x16ab970 (0x8584 bytes) 2024-09-21T22:17:01.892 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.892 INFO:teuthology.orchestra.run.smithi134.stdout:3383 read 0xffae40 thru 0x10061d4 (0xb395 bytes) 2024-09-21T22:17:01.892 INFO:teuthology.orchestra.run.smithi134.stdout:3384 punch from 0x114cf6e to 0x1157913, (0xa9a5 bytes) 2024-09-21T22:17:01.892 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.892 INFO:teuthology.orchestra.run.smithi134.stdout:3387 punch from 0xc587c4 to 0xc64594, (0xbdd0 bytes) 2024-09-21T22:17:01.899 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:01.899 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:01.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:01.911 INFO:teuthology.orchestra.run.smithi134.stdout:3388 writesame 0xd1bc017 thru 0xd1bcd1a data_size 0x7(0xd04 bytes) 2024-09-21T22:17:01.911 INFO:teuthology.orchestra.run.smithi134.stdout:3389 write 0x9fc640e thru 0x9fd027e (0x9e71 bytes) 2024-09-21T22:17:01.926 INFO:teuthology.orchestra.run.smithi134.stdout:3390 trunc from 0xd1bcd1b to 0x1546552 2024-09-21T22:17:01.933 INFO:teuthology.orchestra.run.smithi134.stdout:3392 write 0x103fcba thru 0x104765f (0x79a6 bytes) 2024-09-21T22:17:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:3394 writesame 0x31be20a thru 0x31c4148 data_size 0x1(0x5f3f bytes) 2024-09-21T22:17:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:3398 read 0xd508fb thru 0xd5cdbc (0xc4c2 bytes) 2024-09-21T22:17:01.958 INFO:teuthology.orchestra.run.smithi134.stdout:3399 trunc from 0x31c4149 to 0xda6348f 2024-09-21T22:17:01.963 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.963 INFO:teuthology.orchestra.run.smithi134.stdout:3402 read 0x16ef1c8 thru 0x16fd1ab (0xdfe4 bytes) 2024-09-21T22:17:01.967 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:01.965+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:01.968 INFO:teuthology.orchestra.run.smithi134.stdout:3403 trunc from 0xda6348f to 0x994df5d 2024-09-21T22:17:01.974 INFO:teuthology.orchestra.run.smithi134.stdout:3404 writesame 0x6df3d32 thru 0x6df9693 data_size 0x11(0x5962 bytes) 2024-09-21T22:17:01.987 INFO:teuthology.orchestra.run.smithi134.stdout:3406 writesame 0xdf07dd0 thru 0xdf09f4f data_size 0x40(0x2180 bytes) 2024-09-21T22:17:01.987 INFO:teuthology.orchestra.run.smithi134.stdout:3407 writesame 0x8d1b1d0 thru 0x8d22bdc data_size 0x5(0x7a0d bytes) 2024-09-21T22:17:01.989 INFO:teuthology.orchestra.run.smithi134.stdout:3408 writesame 0x209533c thru 0x20976f2 data_size 0x1(0x23b7 bytes) 2024-09-21T22:17:01.995 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:01.995 INFO:teuthology.orchestra.run.smithi134.stdout:3410 punch from 0x6675d46 to 0x6676e74, (0x112e bytes) 2024-09-21T22:17:01.995 INFO:teuthology.orchestra.run.smithi134.stdout:3411 writesame 0xcc6ebbd thru 0xcc700ba data_size 0x1(0x14fe bytes) 2024-09-21T22:17:01.999 INFO:teuthology.orchestra.run.smithi134.stdout:3412 writesame 0x70bbb49 thru 0x70bed1e data_size 0x1(0x31d6 bytes) 2024-09-21T22:17:02.014 INFO:teuthology.orchestra.run.smithi134.stdout:3413 trunc from 0xdf09f50 to 0x6d2c726 2024-09-21T22:17:02.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:17:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:3414 write 0x6695492 thru 0x66a4bac (0xf71b bytes) 2024-09-21T22:17:02.039 INFO:teuthology.orchestra.run.smithi134.stdout:3415 write 0x97f2e70 thru 0x97f7762 (0x48f3 bytes) 2024-09-21T22:17:02.040 INFO:teuthology.orchestra.run.smithi134.stdout:3416 writesame 0x40ed757 thru 0x40f5313 data_size 0x1(0x7bbd bytes) 2024-09-21T22:17:02.056 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:02.056 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:02.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:02.056 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.490191289999999, 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:17:02.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:17:02.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:02.061 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.490093827999999, 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:17:02.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:17:02.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.490038772000005, 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.066 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:17:02.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.489996766000004, 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:17:02.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.489936168, 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.075 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:02.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:17:02.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.079 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.489913974999993, 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.084 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1611 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.489009167999995, 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011204337, 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1611 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565426+0000", 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565427+0000", 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9599999999999998e-07 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565465+0000", 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8362999999999998e-05 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565575+0000", 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000110198 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.565584+0000", 2024-09-21T22:17:02.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0329999999999997e-06 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576542+0000", 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0109576 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576584+0000", 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2005999999999997e-05 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576630+0000", 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6341000000000002e-05 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 75.533574435999995, 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:17:02.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 75.530435194000006, 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:17:02.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:17:02.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:02.099 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.437421568999994, 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:02.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:17:02.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:17:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.481556276999996, 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:02.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.375717727000001, 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.374701152, 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.116 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:17:02.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.374333386000004, 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.122 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:17:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:17:02.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.855991087, 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.128 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:02.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:17:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.854115206000003, 2024-09-21T22:17:02.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:02.138 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.584372911000003, 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:17:02.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:17:02.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 33.468603078999998, 2024-09-21T22:17:02.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:17:02.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:17:02.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:17:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.090789858999999, 2024-09-21T22:17:02.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:17:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.238464067, 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:17:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:17:02.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.160 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.161 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.161 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:02.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:02.164 INFO:teuthology.orchestra.run.smithi134.stdout:3417 punch from 0x4dc5743 to 0x4dc9854, (0x4111 bytes) 2024-09-21T22:17:02.164 INFO:teuthology.orchestra.run.smithi134.stdout:3419 trunc from 0x97f7763 to 0x3ffc198 2024-09-21T22:17:02.164 INFO:teuthology.orchestra.run.smithi134.stdout:3421 read 0x23d4a3e thru 0x23dbe8d (0x7450 bytes) 2024-09-21T22:17:02.164 INFO:teuthology.orchestra.run.smithi134.stdout:3422 write 0xe879b7c thru 0xe87a74b (0xbd0 bytes) 2024-09-21T22:17:02.164 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:02.164 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3425 writesame 0x694eee5 thru 0x695a286 data_size 0x1(0xb3a2 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3426 write 0xe6461e0 thru 0xe64b6f3 (0x5514 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3427 read 0x50abd29 thru 0x50ad5df (0x18b7 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3430 read 0xc785cff thru 0xc789699 (0x399b bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3431 read 0xcb7a039 thru 0xcb88e39 (0xee01 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3432 writesame 0xb9bb78f thru 0xb9c941f data_size 0x17(0xdc91 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3433 read 0x113edac thru 0x1148a2d (0x9c82 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3436 trunc from 0xe87a74c to 0xe189948 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3437 write 0x6d1433f thru 0x6d1f305 (0xafc7 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3440 read 0xbf7d236 thru 0xbf86923 (0x96ee bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3442 write 0x5a66be6 thru 0x5a72769 (0xbb84 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3443 read 0x67c1059 thru 0x67c9d2e (0x8cd6 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3445 read 0x4dd27ee thru 0x4de1a49 (0xf25c bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3447 write 0x972c0d2 thru 0x9733ed5 (0x7e04 bytes) 2024-09-21T22:17:02.165 INFO:teuthology.orchestra.run.smithi134.stdout:3448 trunc from 0xe189948 to 0x1fc7cdb 2024-09-21T22:17:02.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:02.160+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:02.169 INFO:teuthology.orchestra.run.smithi134.stdout:3449 write 0x590161a thru 0x5906b62 (0x5549 bytes) 2024-09-21T22:17:02.170 INFO:teuthology.orchestra.run.smithi134.stdout:3451 punch from 0x4b7e7ed to 0x4b83faa, (0x57bd bytes) 2024-09-21T22:17:02.170 INFO:teuthology.orchestra.run.smithi134.stdout:3452 punch from 0x36abe04 to 0x36adc9d, (0x1e99 bytes) 2024-09-21T22:17:02.170 INFO:teuthology.orchestra.run.smithi134.stdout:3453 punch from 0x6d460b to 0x6d9809, (0x51fe bytes) 2024-09-21T22:17:02.184 INFO:teuthology.orchestra.run.smithi134.stdout:3454 write 0xc8356ea thru 0xc842ed1 (0xd7e8 bytes) 2024-09-21T22:17:02.188 INFO:teuthology.orchestra.run.smithi134.stdout:3455 read 0xb23ffab thru 0xb24441f (0x4475 bytes) 2024-09-21T22:17:02.188 INFO:teuthology.orchestra.run.smithi134.stdout:3456 read 0x2b858ca thru 0x2b8a344 (0x4a7b bytes) 2024-09-21T22:17:02.188 INFO:teuthology.orchestra.run.smithi134.stdout:3458 read 0x480ab33 thru 0x481279f (0x7c6d bytes) 2024-09-21T22:17:02.188 INFO:teuthology.orchestra.run.smithi134.stdout:3459 write 0x6aa270d thru 0x6aa57da (0x30ce bytes) 2024-09-21T22:17:02.189 INFO:teuthology.orchestra.run.smithi134.stdout:3460 read 0xd71abe thru 0xd76f19 (0x545c bytes) 2024-09-21T22:17:02.190 INFO:teuthology.orchestra.run.smithi134.stdout:3463 punch from 0x505ca7d to 0x5068d65, (0xc2e8 bytes) 2024-09-21T22:17:02.190 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:02.190 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:02.191 INFO:teuthology.orchestra.run.smithi134.stdout:3466 punch from 0x49c482 to 0x4a09f4, (0x4572 bytes) 2024-09-21T22:17:02.191 INFO:teuthology.orchestra.run.smithi134.stdout:3468 read 0xb206d97 thru 0xb212fd7 (0xc241 bytes) 2024-09-21T22:17:02.191 INFO:teuthology.orchestra.run.smithi134.stdout:3469 write 0x8131d56 thru 0x81340ae (0x2359 bytes) 2024-09-21T22:17:02.191 INFO:teuthology.orchestra.run.smithi134.stdout:3470 read 0x2a58167 thru 0x2a5a828 (0x26c2 bytes) 2024-09-21T22:17:02.192 INFO:teuthology.orchestra.run.smithi134.stdout:3471 clone 20 order 18 su 32768 sc 7 2024-09-21T22:17:02.263 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:02.262+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:02.269 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:02.269 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:02.269 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:02.269 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:02.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:02.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:02.363+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:02.422 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:02.422 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:02.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:02.475 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:02.474+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:02.536 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:02.536 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587341092000003, 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.537 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:02.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587320921, 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:02.541 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:02.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.545 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587301975000003, 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587282612000003, 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:02.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:02.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:02.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:02.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:02.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587249964000002, 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:02.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587198796999999, 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587172125000002, 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:02.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:02.567 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587147326, 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:02.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587116377999997, 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.572 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:02.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:02.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587092159999997, 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:02.576 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:02.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:02.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587067808, 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:02.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:02.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.584 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587043565000002, 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:02.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:02.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:02.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.587013829999997, 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:02.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:02.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.586978360000003, 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:02.593 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:02.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.596 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:02.597 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.549447154999999, 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:02.599 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:02.600 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.356579495999998, 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:02.602 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.603 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:02.605 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.606 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.351212963999998, 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.607 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.608 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.609 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.610 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.333648171, 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:02.611 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:02.613 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:02.614 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.301267178, 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:02.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:02.617 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.618 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.619 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.253463732, 2024-09-21T22:17:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:02.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.625 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:02.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:02.629 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:02.628+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:02.729 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:02.727+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:02.774 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:02.775 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:02.775 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:02.775 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:02.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:02.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:02.829+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:02.887 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:02.888 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:02.888 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:02.888 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:02.888 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:02.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:02.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:02.930+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:02.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.870089651000001, 2024-09-21T22:17:03.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:17:03.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:17:03.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.841029829999997, 2024-09-21T22:17:03.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:17:03.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:17:03.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:17:03.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.640816083999994, 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:17:03.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:17:03.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.489577268000005, 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:03.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 62.086634965000002, 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.027 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:17:03.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:17:03.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:17:03.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 62.086572109999999, 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.034 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:17:03.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:17:03.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.613068132000002, 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.044 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.613045878000001, 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:17:03.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.613021463999999, 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:03.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:17:03.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:17:03.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612991999000002, 2024-09-21T22:17:03.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:17:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:17:03.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612964855000001, 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:17:03.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612945752999998, 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:17:03.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:17:03.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612921600999996, 2024-09-21T22:17:03.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:17:03.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:17:03.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612897822999997, 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.071 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612878848000001, 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:17:03.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612860097999999, 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:17:03.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:17:03.083 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612828014999998, 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.084 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:17:03.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:17:03.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612815028, 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:17:03.088 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:17:03.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:17:03.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 57.612804779000001, 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:17:03.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:17:03.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:17:03.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97073 3.d 3:b30a3fcc:::rbd_data.11859a4b084.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 19.076245418999999, 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011897978999999999, 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:03.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97073 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924748+0000", 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.147e-06 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928499+0000", 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514219999999999 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928513+0000", 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4032000000000001e-05 2024-09-21T22:17:03.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928520+0000", 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3409999999999997e-06 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928582+0000", 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1748000000000006e-05 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928728+0000", 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000145523 2024-09-21T22:17:03.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928881+0000", 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015284599999999999 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.932050+0000", 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031697330000000001 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936518+0000", 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044676120000000001 2024-09-21T22:17:03.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936587+0000", 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8783999999999997e-05 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936644+0000", 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7791000000000003e-05 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.102 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:03.103 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:03.103 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:17:03.105 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:03.105 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:03.102+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:03.117 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:03.133 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:03.134 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:03.149 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:03.149 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:03.165 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:03.165 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:03.181 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:03.198 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:03.198 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:03.204 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:03.203+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:03.216 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:03.216 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:03.232 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:03.233 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:03.251 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:03.251 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:03.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:03.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:03.303+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:03.403 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:03.403 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:03.406 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:03.404+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:03.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:03.507 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:03.505+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:03.556 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:03.556 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:03.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:03.609 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:03.607+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:03.668 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:03.669 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:03.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:03.709 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:03.707+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:03.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:03.808+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:03.819 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:03.819 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:03.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:03.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:03.910+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:03.972 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:03.972 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:03.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:04.012 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:04.010+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:04.012 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:04.012 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:04.012 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-21T22:17:04.012 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T22:17:04.012 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T22:17:04.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-21T22:17:04.112 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:04.111+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:04.172 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:04.172 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T22:17:04.172 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:04.173 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:04.173 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:04.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:04.232 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:04.230+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:04.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:04.312+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:04.396 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:04.396 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:04.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:04.450 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:04.448+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:04.516 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:04.514+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:04.612 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:04.612 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:04.616 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:04.615+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:04.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:04.718 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:04.716+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:04.781 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:04.781 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:04.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:04.818 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:04.817+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:04.920 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:04.918+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:04.936 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:04.936 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:04.945 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:05.029 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:05.027+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:05.096 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:05.096 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:05.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:17:05.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:05.149 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:05.147+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:05.197 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-21T22:17:05.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:05.221+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:05.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:05.269 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:05.270 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:05.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:05.324 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:05.322+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:05.391 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:05.391 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:05.410 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:05.410 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:05.420 INFO:teuthology.orchestra.run.smithi134.stdout:3472 trunc from 0xc842ed2 to 0x2da48b4 2024-09-21T22:17:05.424 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:05.423+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:05.440 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:05.440 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:05.447 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:05.447 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:05.447 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:05.447 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:05.447 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:05.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:05.477 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:05.477 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:05.508 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:05.508 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:05.525 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:05.524+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:05.536 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:05.543 INFO:teuthology.orchestra.run.smithi134.stdout:3475 read 0x9028f9 thru 0x9065b4 (0x3cbc bytes) 2024-09-21T22:17:05.544 INFO:teuthology.orchestra.run.smithi134.stdout:3476 punch from 0x14f949e to 0x14fea74, (0x55d6 bytes) 2024-09-21T22:17:05.544 INFO:teuthology.orchestra.run.smithi134.stdout:3477 punch from 0x3e0a76 to 0x3e4260, (0x37ea bytes) 2024-09-21T22:17:05.554 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:05.554 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:05.556 INFO:teuthology.orchestra.run.smithi134.stdout:3479 writesame 0x82fc289 thru 0x830ae85 data_size 0x1(0xebfd bytes) 2024-09-21T22:17:05.556 INFO:teuthology.orchestra.run.smithi134.stdout:3480 write 0x4a1b3bf thru 0x4a2207b (0x6cbd bytes) 2024-09-21T22:17:05.563 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.563 INFO:teuthology.orchestra.run.smithi134.stdout:3482 read 0x589fd1c thru 0x58a7291 (0x7576 bytes) 2024-09-21T22:17:05.563 INFO:teuthology.orchestra.run.smithi134.stdout:3483 read 0x17a7bda thru 0x17b050c (0x8933 bytes) 2024-09-21T22:17:05.571 INFO:teuthology.orchestra.run.smithi134.stdout:3484 trunc from 0x830ae86 to 0xc60ae10 2024-09-21T22:17:05.572 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:05.573 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:05.577 INFO:teuthology.orchestra.run.smithi134.stdout:3486 write 0xb1705f1 thru 0xb176c03 (0x6613 bytes) 2024-09-21T22:17:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:3491 read 0x1628ebd thru 0x1636971 (0xdab5 bytes) 2024-09-21T22:17:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:3492 write 0x796dcd9 thru 0x7971e1f (0x4147 bytes) 2024-09-21T22:17:05.584 INFO:teuthology.orchestra.run.smithi134.stdout:3493 punch from 0x66b5a59 to 0x66b7d23, (0x22ca bytes) 2024-09-21T22:17:05.587 INFO:teuthology.orchestra.run.smithi134.stdout:3495 trunc from 0xc60ae10 to 0x9886324 2024-09-21T22:17:05.596 INFO:teuthology.orchestra.run.smithi134.stdout:3496 writesame 0x630f552 thru 0x63157d1 data_size 0x20(0x6280 bytes) 2024-09-21T22:17:05.600 INFO:teuthology.orchestra.run.smithi134.stdout:3497 punch from 0xa0163 to 0xa4c8b, (0x4b28 bytes) 2024-09-21T22:17:05.600 INFO:teuthology.orchestra.run.smithi134.stdout:3498 read 0x3c78ce2 thru 0x3c7f216 (0x6535 bytes) 2024-09-21T22:17:05.604 INFO:teuthology.orchestra.run.smithi134.stdout:3499 trunc from 0x9886324 to 0x631da00 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.103977232999995, 2024-09-21T22:17:05.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 79.088793773999996, 2024-09-21T22:17:05.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:17:05.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:17:05.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 79.077347336000003, 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:17:05.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:05.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.527260107999993, 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.472172344999997, 2024-09-21T22:17:05.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.201079655999997, 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:17:05.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:17:05.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:05.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.196173082000001, 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:05.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:17:05.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.192962483000002, 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:17:05.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.187940785999999, 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:17:05.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.185953454, 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:05.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:17:05.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:17:05.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.662099863000002, 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:05.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:17:05.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:17:05.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:40247 3.0 e71/23 3:0688b99e:::rbd_data.118542b14bcd.0000000000000281:head v 71'358, mlcod=71'356)", 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.370890649000003, 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039211389999999997, 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234378+0000", 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9500000000000001e-07 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234387+0000", 2024-09-21T22:17:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2599999999999994e-06 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234398+0000", 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234405+0000", 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234460+0000", 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4975999999999997e-05 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234482+0000", 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1407e-05 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238263+0000", 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037812039999999998 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238298+0000", 2024-09-21T22:17:05.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5419000000000001e-05 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.618938252, 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:17:05.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:17:05.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:17:05.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.617437510999999, 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:17:05.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:17:05.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:17:05.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:45992 3.16 e76/63 3:6be7cafa:::rbd_data.1185af582f87.0000000000000002:head v 76'119, mlcod=74'117)", 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.337403432999999, 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038321589999999999, 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:17:05.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267864+0000", 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.267865+0000", 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9500000000000002e-07 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268183+0000", 2024-09-21T22:17:05.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000318239 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268202+0000", 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8732e-05 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268210+0000", 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7810000000000005e-06 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268292+0000", 2024-09-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1990000000000006e-05 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.268316+0000", 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3915999999999999e-05 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271655+0000", 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00333892 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.271697+0000", 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1986000000000001e-05 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97072 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'409, mlcod=84'406)", 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.682489745000002, 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039520709999999997, 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922780+0000", 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3740000000000001e-06 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922789+0000", 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922808+0000", 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8481000000000001e-05 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922822+0000", 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922885+0000", 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3336000000000005e-05 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922910+0000", 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5072999999999999e-05 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926670+0000", 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003760191 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926730+0000", 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0126e-05 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.637750523000001, 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.632866447000001, 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:17:05.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.632078750000002, 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:17:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:17:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.625071307999999, 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:05.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:05.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:17:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:05.688 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:05.688 INFO:teuthology.orchestra.run.smithi134.stdout:3500 write 0x41e01e3 thru 0x41e26ad (0x24cb bytes) 2024-09-21T22:17:05.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3503 write 0x7dc332d thru 0x7dd017b (0xce4f bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3504 read 0x208723d thru 0x208fce5 (0x8aa9 bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3507 write 0xdb84de7 thru 0xdb8665d (0x1877 bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3509 writesame 0xc7142bc thru 0xc720c75 data_size 0x97(0xc9ba bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3510 read 0xa09d72 thru 0xa0ec5c (0x4eeb bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3513 read 0xd4b7cbe thru 0xd4c4831 (0xcb74 bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3514 writesame 0x3e3321e thru 0x3e3ed41 data_size 0x1d(0xbb24 bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3515 trunc from 0xdb8665e to 0x8cc37ee 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3519 write 0xd91474f thru 0xd91b5e9 (0x6e9b bytes) 2024-09-21T22:17:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:3520 read 0x2aa4221 thru 0x2aa45d6 (0x3b6 bytes) 2024-09-21T22:17:05.692 INFO:teuthology.orchestra.run.smithi134.stdout:3521 write 0xa9100e0 thru 0xa91edd0 (0xecf1 bytes) 2024-09-21T22:17:05.692 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:05.687+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:05.695 INFO:teuthology.orchestra.run.smithi134.stdout:3523 punch from 0x4993656 to 0x49a0814, (0xd1be bytes) 2024-09-21T22:17:05.696 INFO:teuthology.orchestra.run.smithi134.stdout:3524 write 0xc158839 thru 0xc15a164 (0x192c bytes) 2024-09-21T22:17:05.699 INFO:teuthology.orchestra.run.smithi134.stdout:3526 read 0x1a230c thru 0x1aaa44 (0x8739 bytes) 2024-09-21T22:17:05.700 INFO:teuthology.orchestra.run.smithi134.stdout:3527 read 0x131b34f thru 0x132212d (0x6ddf bytes) 2024-09-21T22:17:05.701 INFO:teuthology.orchestra.run.smithi134.stdout:3528 write 0x5ef6e5f thru 0x5f025be (0xb760 bytes) 2024-09-21T22:17:05.709 INFO:teuthology.orchestra.run.smithi134.stdout:3530 write 0xb006e1a thru 0xb00aab9 (0x3ca0 bytes) 2024-09-21T22:17:05.712 INFO:teuthology.orchestra.run.smithi134.stdout:3531 write 0x65bde3f thru 0x65c5dde (0x7fa0 bytes) 2024-09-21T22:17:05.717 INFO:teuthology.orchestra.run.smithi134.stdout:3532 read 0x7c51c4a thru 0x7c5d78b (0xbb42 bytes) 2024-09-21T22:17:05.717 INFO:teuthology.orchestra.run.smithi134.stdout:3533 write 0x6bda2fc thru 0x6be9d3c (0xfa41 bytes) 2024-09-21T22:17:05.723 INFO:teuthology.orchestra.run.smithi134.stdout:3534 write 0xa23079f thru 0xa231cc0 (0x1522 bytes) 2024-09-21T22:17:05.725 INFO:teuthology.orchestra.run.smithi134.stdout:3535 read 0x439aff7 thru 0x43a0fb0 (0x5fba bytes) 2024-09-21T22:17:05.725 INFO:teuthology.orchestra.run.smithi134.stdout:3538 read 0xd69f215 thru 0xd6aabe4 (0xb9d0 bytes) 2024-09-21T22:17:05.735 INFO:teuthology.orchestra.run.smithi134.stdout:3539 trunc from 0xd91b5ea to 0x5791a77 2024-09-21T22:17:05.747 INFO:teuthology.orchestra.run.smithi134.stdout:3540 writesame 0x4f2204f thru 0x4f2fed4 data_size 0x5b(0xde86 bytes) 2024-09-21T22:17:05.754 INFO:teuthology.orchestra.run.smithi134.stdout:3542 writesame 0x3452640 thru 0x3455ca0 data_size 0x1(0x3661 bytes) 2024-09-21T22:17:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:3545 write 0x70f2a6e thru 0x70f4fb8 (0x254b bytes) 2024-09-21T22:17:05.775 INFO:teuthology.orchestra.run.smithi134.stdout:3547 read 0x147e31e thru 0x148761a (0x92fd bytes) 2024-09-21T22:17:05.775 INFO:teuthology.orchestra.run.smithi134.stdout:3548 write 0x4e632d5 thru 0x4e6366e (0x39a bytes) 2024-09-21T22:17:05.789 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:05.788+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:05.793 INFO:teuthology.orchestra.run.smithi134.stdout:3549 write 0xda2e5f7 thru 0xda33374 (0x4d7e bytes) 2024-09-21T22:17:05.806 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:05.806 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:05.811 INFO:teuthology.orchestra.run.smithi134.stdout:3550 trunc from 0xda33375 to 0x42a767c 2024-09-21T22:17:05.816 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:05.822 INFO:teuthology.orchestra.run.smithi134.stdout:3551 punch from 0x125ba5d to 0x1264f62, (0x9505 bytes) 2024-09-21T22:17:05.822 INFO:teuthology.orchestra.run.smithi134.stdout:3552 read 0x595704 thru 0x59af20 (0x581d bytes) 2024-09-21T22:17:05.834 INFO:teuthology.orchestra.run.smithi134.stdout:3554 write 0xa00816c thru 0xa01684b (0xe6e0 bytes) 2024-09-21T22:17:05.838 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.839 INFO:teuthology.orchestra.run.smithi134.stdout:3556 read 0x8db3175 thru 0x8db8da8 (0x5c34 bytes) 2024-09-21T22:17:05.839 INFO:teuthology.orchestra.run.smithi134.stdout:3557 read 0x2a5b143 thru 0x2a5c622 (0x14e0 bytes) 2024-09-21T22:17:05.839 INFO:teuthology.orchestra.run.smithi134.stdout:3558 writesame 0x2fb4ac3 thru 0x2fc09fb data_size 0x1(0xbf39 bytes) 2024-09-21T22:17:05.858 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.858 INFO:teuthology.orchestra.run.smithi134.stdout:3562 write 0x98351bf thru 0x9842f6d (0xddaf bytes) 2024-09-21T22:17:05.863 INFO:teuthology.orchestra.run.smithi134.stdout:3565 read 0x82d5fdd thru 0x82dd0f2 (0x7116 bytes) 2024-09-21T22:17:05.863 INFO:teuthology.orchestra.run.smithi134.stdout:3567 punch from 0x1d1d62a to 0x1d23677, (0x604d bytes) 2024-09-21T22:17:05.874 INFO:teuthology.orchestra.run.smithi134.stdout:3568 trunc from 0xa01684c to 0xa15672 2024-09-21T22:17:05.900 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:05.898+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:3569 punch from 0x883acd to 0x890dab, (0xd2de bytes) 2024-09-21T22:17:05.926 INFO:teuthology.orchestra.run.smithi134.stdout:3570 write 0x33a1916 thru 0x33af3ae (0xda99 bytes) 2024-09-21T22:17:05.930 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.930 INFO:teuthology.orchestra.run.smithi134.stdout:3573 read 0x3021eb3 thru 0x302f637 (0xd785 bytes) 2024-09-21T22:17:05.948 INFO:teuthology.orchestra.run.smithi134.stdout:3574 write 0xd3af511 thru 0xd3b7932 (0x8422 bytes) 2024-09-21T22:17:05.955 INFO:teuthology.orchestra.run.smithi134.stdout:3575 read 0xd3554b2 thru 0xd35fcd5 (0xa824 bytes) 2024-09-21T22:17:05.955 INFO:teuthology.orchestra.run.smithi134.stdout:3577 punch from 0xcb0623b to 0xcb1393d, (0xd702 bytes) 2024-09-21T22:17:05.957 INFO:teuthology.orchestra.run.smithi134.stdout:3579 trunc from 0xd3b7933 to 0xb2d125d 2024-09-21T22:17:05.975 INFO:teuthology.orchestra.run.smithi134.stdout:3581 write 0xde76903 thru 0xde7c9de (0x60dc bytes) 2024-09-21T22:17:05.980 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:05.980 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:05.980 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:05.980 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:05.980 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:05.981 INFO:teuthology.orchestra.run.smithi134.stdout:3582 read 0x35db15 thru 0x36d324 (0xf810 bytes) 2024-09-21T22:17:05.984 INFO:teuthology.orchestra.run.smithi134.stdout:3584 trunc from 0xde7c9df to 0xd6063de 2024-09-21T22:17:05.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:05.994 INFO:teuthology.orchestra.run.smithi134.stdout:3586 read 0x7f572c4 thru 0x7f5e28f (0x6fcc bytes) 2024-09-21T22:17:05.994 INFO:teuthology.orchestra.run.smithi134.stdout:3587 read 0x78ac3f0 thru 0x78b0504 (0x4115 bytes) 2024-09-21T22:17:05.994 INFO:teuthology.orchestra.run.smithi134.stdout:3588 writesame 0x5b719a9 thru 0x5b793ec data_size 0x32(0x7a44 bytes) 2024-09-21T22:17:05.998 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:05.998 INFO:teuthology.orchestra.run.smithi134.stdout:3590 trunc from 0xd6063de to 0xd772795 2024-09-21T22:17:06.003 INFO:teuthology.orchestra.run.smithi134.stdout:3592 read 0x6b57ff5 thru 0x6b64ced (0xccf9 bytes) 2024-09-21T22:17:06.003 INFO:teuthology.orchestra.run.smithi134.stdout:3594 writesame 0xced95cb thru 0xcedc9f2 data_size 0x4(0x3428 bytes) 2024-09-21T22:17:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.007 INFO:teuthology.orchestra.run.smithi134.stdout:3597 write 0x1bed7d2 thru 0x1bf5496 (0x7cc5 bytes) 2024-09-21T22:17:06.010 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.011 INFO:teuthology.orchestra.run.smithi134.stdout:3599 write 0xbe0e5eb thru 0xbe1abe4 (0xc5fa bytes) 2024-09-21T22:17:06.015 INFO:teuthology.orchestra.run.smithi134.stdout:3600 writesame 0x782cd14 thru 0x782de37 data_size 0x2(0x1124 bytes) 2024-09-21T22:17:06.018 INFO:teuthology.orchestra.run.smithi134.stdout:3601 write 0x87c7b72 thru 0x87d2203 (0xa692 bytes) 2024-09-21T22:17:06.030 INFO:teuthology.orchestra.run.smithi134.stdout:3602 writesame 0xd94a7d3 thru 0xd95589b data_size 0x1(0xb0c9 bytes) 2024-09-21T22:17:06.030 INFO:teuthology.orchestra.run.smithi134.stdout:3603 write 0x63930db thru 0x63a2b0f (0xfa35 bytes) 2024-09-21T22:17:06.031 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:06.029+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:06.038 INFO:teuthology.orchestra.run.smithi134.stdout:3604 write 0x7eae10c thru 0x7ebb010 (0xcf05 bytes) 2024-09-21T22:17:06.047 INFO:teuthology.orchestra.run.smithi134.stdout:3605 write 0x7c48213 thru 0x7c4a532 (0x2320 bytes) 2024-09-21T22:17:06.050 INFO:teuthology.orchestra.run.smithi134.stdout:3606 writesame 0x35f4880 thru 0x35f52db data_size 0x11(0xa5c bytes) 2024-09-21T22:17:06.057 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:17:06.065 INFO:teuthology.orchestra.run.smithi134.stdout:3607 trunc from 0xd95589c to 0x41be6e4 2024-09-21T22:17:06.083 INFO:teuthology.orchestra.run.smithi134.stdout:3608 writesame 0x28ed8f0 thru 0x28f6eb9 data_size 0x9a(0x95ca bytes) 2024-09-21T22:17:06.089 INFO:teuthology.orchestra.run.smithi134.stdout:3609 read 0x31f415a thru 0x31f7520 (0x33c7 bytes) 2024-09-21T22:17:06.089 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.089 INFO:teuthology.orchestra.run.smithi134.stdout:3612 read 0xed8d52 thru 0xede3ae (0x565d bytes) 2024-09-21T22:17:06.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:06.089+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:06.099 INFO:teuthology.orchestra.run.smithi134.stdout:3613 write 0x82f315f thru 0x82f929a (0x613c bytes) 2024-09-21T22:17:06.115 INFO:teuthology.orchestra.run.smithi134.stdout:3614 trunc from 0x82f929b to 0xf8ac51 2024-09-21T22:17:06.135 INFO:teuthology.orchestra.run.smithi134.stdout:3616 trunc from 0xf8ac51 to 0x8abd170 2024-09-21T22:17:06.140 INFO:teuthology.orchestra.run.smithi134.stdout:3617 writesame 0x82ab68b thru 0x82b55ff data_size 0xb(0x9f75 bytes) 2024-09-21T22:17:06.147 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:06.147 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.581295404000002, 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.148 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:17:06.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:17:06.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.581197942000003, 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.152 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:06.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:17:06.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.581142885999995, 2024-09-21T22:17:06.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:06.160 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.581100879999994, 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:06.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.162 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.581040282000004, 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.165 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:17:06.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:17:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 82.581018088999997, 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:17:06.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.624678549999999, 2024-09-21T22:17:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:17:06.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:17:06.178 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.621539307999996, 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:06.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:17:06.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.528525682999998, 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:17:06.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:17:06.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:17:06.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.572660390999999, 2024-09-21T22:17:06.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:06.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:17:06.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:17:06.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:17:06.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.466821840999998, 2024-09-21T22:17:06.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:17:06.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.465805265999997, 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.201 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:17:06.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:17:06.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.4654375, 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.207 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:06.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:17:06.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.947095201000003, 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.94521932, 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:17:06.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.675477024999999, 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.223 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:17:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:06.228 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.559707193000001, 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:06.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:17:06.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:17:06.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:17:06.234 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.181893973000001, 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:17:06.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:17:06.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.329568181, 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.240 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:17:06.245 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.0540315659999999, 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.251 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:06.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3619 trunc from 0x8abd170 to 0xba2b61a 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3620 read 0x1ecf011 thru 0x1ed49a4 (0x5994 bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3621 read 0x3eac082 thru 0x3eb8ae0 (0xca5f bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3624 read 0xa5d49f thru 0xa6ad23 (0xd885 bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3625 read 0x386d404 thru 0x3872833 (0x5430 bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3627 writesame 0x613515e thru 0x6143178 data_size 0x1(0xe01b bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3629 trunc from 0xba2b61a to 0x7a150d 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3630 read 0x66092a thru 0x66acc8 (0xa39f bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3631 trunc from 0x7a150d to 0x8e506b8 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3633 read 0x78666d8 thru 0x786e5cb (0x7ef4 bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3635 write 0x5c096e9 thru 0x5c0ca10 (0x3328 bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3636 write 0xa05a688 thru 0xa06545b (0xadd4 bytes) 2024-09-21T22:17:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:3639 read 0x6871f9 thru 0x6907fe (0x9606 bytes) 2024-09-21T22:17:06.256 INFO:teuthology.orchestra.run.smithi134.stdout:3640 write 0x9882daa thru 0x9884719 (0x1970 bytes) 2024-09-21T22:17:06.256 INFO:teuthology.orchestra.run.smithi134.stdout:3641 read 0x162d120 thru 0x163acd9 (0xdbba bytes) 2024-09-21T22:17:06.256 INFO:teuthology.orchestra.run.smithi134.stdout:3645 writesame 0x6aa2f83 thru 0x6aad10c data_size 0x3a(0xa18a bytes) 2024-09-21T22:17:06.256 INFO:teuthology.orchestra.run.smithi134.stdout:3646 write 0x270328d thru 0x270f044 (0xbdb8 bytes) 2024-09-21T22:17:06.256 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.256 INFO:teuthology.orchestra.run.smithi134.stdout:3648 trunc from 0xa06545c to 0x935204a 2024-09-21T22:17:06.256 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:06.250+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:3653 punch from 0x20b6792 to 0x20c3719, (0xcf87 bytes) 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:3654 read 0x3f8bfe4 thru 0x3f8e5f2 (0x260f bytes) 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:3656 punch from 0x6973564 to 0x697a866, (0x7302 bytes) 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:3657 read 0x79e692d thru 0x79f21b1 (0xb885 bytes) 2024-09-21T22:17:06.259 INFO:teuthology.orchestra.run.smithi134.stdout:3659 write 0x259cf69 thru 0x259f4f3 (0x258b bytes) 2024-09-21T22:17:06.261 INFO:teuthology.orchestra.run.smithi134.stdout:3660 read 0x88d874 thru 0x89d506 (0xfc93 bytes) 2024-09-21T22:17:06.261 INFO:teuthology.orchestra.run.smithi134.stdout:3661 writesame 0x2d01026 thru 0x2d08e54 data_size 0x1(0x7e2f bytes) 2024-09-21T22:17:06.277 INFO:teuthology.orchestra.run.smithi134.stdout:3662 read 0x4bd59b3 thru 0x4be32a9 (0xd8f7 bytes) 2024-09-21T22:17:06.277 INFO:teuthology.orchestra.run.smithi134.stdout:3663 trunc from 0x935204a to 0x991e102 2024-09-21T22:17:06.283 INFO:teuthology.orchestra.run.smithi134.stdout:3664 writesame 0x1dfbe80 thru 0x1e01b01 data_size 0x3(0x5c82 bytes) 2024-09-21T22:17:06.290 INFO:teuthology.orchestra.run.smithi134.stdout:3665 read 0x59e5792 thru 0x59e8074 (0x28e3 bytes) 2024-09-21T22:17:06.299 INFO:teuthology.orchestra.run.smithi134.stdout:3670 writesame 0xc794d2a thru 0xc795c6e data_size 0x1(0xf45 bytes) 2024-09-21T22:17:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:3671 read 0x352a9b7 thru 0x35313cf (0x6a19 bytes) 2024-09-21T22:17:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:3672 punch from 0xaaef138 to 0xaafc280, (0xd148 bytes) 2024-09-21T22:17:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:3676 write 0x1f5dcce thru 0x1f5e1ea (0x51d bytes) 2024-09-21T22:17:06.302 INFO:teuthology.orchestra.run.smithi134.stdout:3678 writesame 0x47289d7 thru 0x4732366 data_size 0x54(0x9990 bytes) 2024-09-21T22:17:06.306 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.306 INFO:teuthology.orchestra.run.smithi134.stdout:3680 read 0xbc26c9e thru 0xbc2b9a1 (0x4d04 bytes) 2024-09-21T22:17:06.306 INFO:teuthology.orchestra.run.smithi134.stdout:3681 read 0xa963e1c thru 0xa96e6d3 (0xa8b8 bytes) 2024-09-21T22:17:06.306 INFO:teuthology.orchestra.run.smithi134.stdout:3682 write 0x3c9fe91 thru 0x3ca168b (0x17fb bytes) 2024-09-21T22:17:06.310 INFO:teuthology.orchestra.run.smithi134.stdout:3683 trunc from 0xc795c6f to 0xc1efa0d 2024-09-21T22:17:06.315 INFO:teuthology.orchestra.run.smithi134.stdout:3684 write 0x749082f thru 0x7492e9f (0x2671 bytes) 2024-09-21T22:17:06.318 INFO:teuthology.orchestra.run.smithi134.stdout:3685 punch from 0x2c8aa17 to 0x2c9888a, (0xde73 bytes) 2024-09-21T22:17:06.323 INFO:teuthology.orchestra.run.smithi134.stdout:3686 trunc from 0xc1efa0d to 0x82992a7 2024-09-21T22:17:06.329 INFO:teuthology.orchestra.run.smithi134.stdout:3688 write 0x695835e thru 0x6966aff (0xe7a2 bytes) 2024-09-21T22:17:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:3690 punch from 0x42802e3 to 0x4284831, (0x454e bytes) 2024-09-21T22:17:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:3692 read 0x529cbb9 thru 0x529db6d (0xfb5 bytes) 2024-09-21T22:17:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:3694 writesame 0x782c8ed thru 0x7837b9a data_size 0x1(0xb2ae bytes) 2024-09-21T22:17:06.353 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:06.351+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:06.362 INFO:teuthology.orchestra.run.smithi134.stdout:3695 trunc from 0x82992a7 to 0x68dc2b 2024-09-21T22:17:06.374 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:06.374 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:06.374 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:06.374 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:06.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:06.387 INFO:teuthology.orchestra.run.smithi134.stdout:3696 write 0xee94e1 thru 0xef4de9 (0xb909 bytes) 2024-09-21T22:17:06.392 INFO:teuthology.orchestra.run.smithi134.stdout:3697 punch from 0x4e7ac6 to 0x4f061b, (0x8b55 bytes) 2024-09-21T22:17:06.392 INFO:teuthology.orchestra.run.smithi134.stdout:3698 read 0x9d43d2 thru 0x9d8263 (0x3e92 bytes) 2024-09-21T22:17:06.403 INFO:teuthology.orchestra.run.smithi134.stdout:3701 trunc from 0xef4dea to 0xa277e5f 2024-09-21T22:17:06.408 INFO:teuthology.orchestra.run.smithi134.stdout:3703 write 0x3272c1d thru 0x3281e9d (0xf281 bytes) 2024-09-21T22:17:06.420 INFO:teuthology.orchestra.run.smithi134.stdout:3704 trunc from 0xa277e5f to 0xe6899da 2024-09-21T22:17:06.438 INFO:teuthology.orchestra.run.smithi134.stdout:3705 trunc from 0xe6899da to 0x3e8441e 2024-09-21T22:17:06.444 INFO:teuthology.orchestra.run.smithi134.stdout:3707 write 0x3a0d0a0 thru 0x3a10ccb (0x3c2c bytes) 2024-09-21T22:17:06.453 INFO:teuthology.orchestra.run.smithi134.stdout:3708 trunc from 0x3e8441e to 0x83e0c48 2024-09-21T22:17:06.454 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:06.452+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:06.458 INFO:teuthology.orchestra.run.smithi134.stdout:3709 read 0x1d0b4f1 thru 0x1d0fa93 (0x45a3 bytes) 2024-09-21T22:17:06.468 INFO:teuthology.orchestra.run.smithi134.stdout:3710 write 0xb14f740 thru 0xb15401c (0x48dd bytes) 2024-09-21T22:17:06.471 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.471 INFO:teuthology.orchestra.run.smithi134.stdout:3714 writesame 0x645b801 thru 0x6465dee data_size 0x43(0xa5ee bytes) 2024-09-21T22:17:06.475 INFO:teuthology.orchestra.run.smithi134.stdout:3715 punch from 0x79b664c to 0x79bf0e7, (0x8a9b bytes) 2024-09-21T22:17:06.487 INFO:teuthology.orchestra.run.smithi134.stdout:3717 trunc from 0xb15401d to 0x1787cdf 2024-09-21T22:17:06.499 INFO:teuthology.orchestra.run.smithi134.stdout:3718 read 0x174f7ba thru 0x1756cd2 (0x7519 bytes) 2024-09-21T22:17:06.516 INFO:teuthology.orchestra.run.smithi134.stdout:3720 write 0x9d301f9 thru 0x9d39aae (0x98b6 bytes) 2024-09-21T22:17:06.521 INFO:teuthology.orchestra.run.smithi134.stdout:3721 read 0x1ba21b2 thru 0x1ba8724 (0x6573 bytes) 2024-09-21T22:17:06.521 INFO:teuthology.orchestra.run.smithi134.stdout:3722 punch from 0x8f522f1 to 0x8f5b6a6, (0x93b5 bytes) 2024-09-21T22:17:06.531 INFO:teuthology.orchestra.run.smithi134.stdout:3724 writesame 0xd54733d thru 0xd553a2b data_size 0x1(0xc6ef bytes) 2024-09-21T22:17:06.531 INFO:teuthology.orchestra.run.smithi134.stdout:3725 write 0xc763d81 thru 0xc765b29 (0x1da9 bytes) 2024-09-21T22:17:06.534 INFO:teuthology.orchestra.run.smithi134.stdout:3726 punch from 0x91f2c6e to 0x92015bd, (0xe94f bytes) 2024-09-21T22:17:06.534 INFO:teuthology.orchestra.run.smithi134.stdout:3728 punch from 0x60332ea to 0x6040393, (0xd0a9 bytes) 2024-09-21T22:17:06.536 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:06.536 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:06.536 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:06.536 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:06.536 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:06.541 INFO:teuthology.orchestra.run.smithi134.stdout:3730 writesame 0xe4e7087 thru 0xe4f0a6b data_size 0x1(0x99e5 bytes) 2024-09-21T22:17:06.541 INFO:teuthology.orchestra.run.smithi134.stdout:3731 writesame 0xb05df6 thru 0xb112e7 data_size 0x35(0xb4f2 bytes) 2024-09-21T22:17:06.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:06.546 INFO:teuthology.orchestra.run.smithi134.stdout:3733 read 0xc79fc2e thru 0xc7a42c6 (0x4699 bytes) 2024-09-21T22:17:06.547 INFO:teuthology.orchestra.run.smithi134.stdout:3735 write 0x2109293 thru 0x2110ad7 (0x7845 bytes) 2024-09-21T22:17:06.550 INFO:teuthology.orchestra.run.smithi134.stdout:3736 read 0x2b1cbd6 thru 0x2b1f4f4 (0x291f bytes) 2024-09-21T22:17:06.550 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.550 INFO:teuthology.orchestra.run.smithi134.stdout:3740 write 0x16586e5 thru 0x16608b0 (0x81cc bytes) 2024-09-21T22:17:06.554 INFO:teuthology.orchestra.run.smithi134.stdout:3741 write 0xaa9136e thru 0xaa94b12 (0x37a5 bytes) 2024-09-21T22:17:06.554 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:06.552+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:06.557 INFO:teuthology.orchestra.run.smithi134.stdout:3742 write 0x6c8416 thru 0x6d35ef (0xb1da bytes) 2024-09-21T22:17:06.558 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.559 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.559 INFO:teuthology.orchestra.run.smithi134.stdout:3747 punch from 0x5c201d2 to 0x5c2e22d, (0xe05b bytes) 2024-09-21T22:17:06.559 INFO:teuthology.orchestra.run.smithi134.stdout:3748 write 0x952ff73 thru 0x9535533 (0x55c1 bytes) 2024-09-21T22:17:06.562 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.562 INFO:teuthology.orchestra.run.smithi134.stdout:3752 read 0x266b138 thru 0x266deba (0x2d83 bytes) 2024-09-21T22:17:06.562 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.563 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.563 INFO:teuthology.orchestra.run.smithi134.stdout:3757 read 0xd24560e thru 0xd24f785 (0xa178 bytes) 2024-09-21T22:17:06.563 INFO:teuthology.orchestra.run.smithi134.stdout:3758 write 0xc1eeadc thru 0xc1f64f9 (0x7a1e bytes) 2024-09-21T22:17:06.566 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.566 INFO:teuthology.orchestra.run.smithi134.stdout:3761 write 0xa135fe3 thru 0xa13d310 (0x732e bytes) 2024-09-21T22:17:06.570 INFO:teuthology.orchestra.run.smithi134.stdout:3762 write 0xdb7b53c thru 0xdb7f823 (0x42e8 bytes) 2024-09-21T22:17:06.589 INFO:teuthology.orchestra.run.smithi134.stdout:3763 trunc from 0xe4f0a6c to 0x7f5492 2024-09-21T22:17:06.602 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.612 INFO:teuthology.orchestra.run.smithi134.stdout:3765 trunc from 0x7f5492 to 0x8db7760 2024-09-21T22:17:06.617 INFO:teuthology.orchestra.run.smithi134.stdout:3773 read 0x833185c thru 0x833a95d (0x9102 bytes) 2024-09-21T22:17:06.617 INFO:teuthology.orchestra.run.smithi134.stdout:3774 write 0x6767c6a thru 0x6769917 (0x1cae bytes) 2024-09-21T22:17:06.621 INFO:teuthology.orchestra.run.smithi134.stdout:3777 read 0x68957c4 thru 0x68a1221 (0xba5e bytes) 2024-09-21T22:17:06.621 INFO:teuthology.orchestra.run.smithi134.stdout:3778 read 0x59f670a thru 0x5a05a6c (0xf363 bytes) 2024-09-21T22:17:06.621 INFO:teuthology.orchestra.run.smithi134.stdout:3779 read 0x7cd27f7 thru 0x7cd68ed (0x40f7 bytes) 2024-09-21T22:17:06.621 INFO:teuthology.orchestra.run.smithi134.stdout:3781 write 0x843711 thru 0x84c8dc (0x91cc bytes) 2024-09-21T22:17:06.632 INFO:teuthology.orchestra.run.smithi134.stdout:3782 trunc from 0x8db7760 to 0x32e46a6 2024-09-21T22:17:06.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:06.653+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:3783 write 0xc3735e7 thru 0xc374acc (0x14e6 bytes) 2024-09-21T22:17:06.660 INFO:teuthology.orchestra.run.smithi134.stdout:3785 read 0x1a8586e thru 0x1a8c672 (0x6e05 bytes) 2024-09-21T22:17:06.660 INFO:teuthology.orchestra.run.smithi134.stdout:3786 punch from 0x61da71e to 0x61e520d, (0xaaef bytes) 2024-09-21T22:17:06.660 INFO:teuthology.orchestra.run.smithi134.stdout:3787 write 0x4d6f38b thru 0x4d7e682 (0xf2f8 bytes) 2024-09-21T22:17:06.662 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:06.662 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:06.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:06.662 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:06.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.662 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712942706, 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:06.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:06.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:06.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712922534999997, 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:06.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:06.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712903589, 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:06.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:06.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:06.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.674 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712884226, 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.678 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712851577999999, 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:06.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712800411000003, 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:06.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:06.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.686 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712773738999999, 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:06.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:06.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:06.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712748939999997, 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712717992000002, 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.695 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712693774000002, 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.702 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712669421999998, 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.703 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712645178999999, 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.707 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:06.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:06.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712615444000001, 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:06.711 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:06.715 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.712579974000001, 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:06.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.675048769, 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.482181109999999, 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.724 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:06.728 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.476814578000003, 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.729 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:06.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:06.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.459249784999997, 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:06.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:06.738 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.426868792, 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.379065345999997, 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:06.743 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:06.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:06.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:06.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.750 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:06.750 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:06.750 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:06.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:06.754 INFO:teuthology.orchestra.run.smithi134.stdout:3788 read 0xbe97671 thru 0xbe98aa2 (0x1432 bytes) 2024-09-21T22:17:06.754 INFO:teuthology.orchestra.run.smithi134.stdout:3789 write 0x3e1225b thru 0x3e145da (0x2380 bytes) 2024-09-21T22:17:06.754 INFO:teuthology.orchestra.run.smithi134.stdout:3790 read 0xa58626c thru 0xa58a3eb (0x4180 bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3791 writesame 0x56afac4 thru 0x56b10c1 data_size 0x5(0x15fe bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3792 write 0x8522216 thru 0x8527abf (0x58aa bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3793 writesame 0xb9d1b77 thru 0xb9d2592 data_size 0x2(0xa1c bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3794 punch from 0xab39792 to 0xab44b95, (0xb403 bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3796 punch from 0x671b1d2 to 0x6728844, (0xd672 bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3797 writesame 0xc62856c thru 0xc63562a data_size 0x2f(0xd0bf bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3798 read 0xaea8723 thru 0xaea9463 (0xd41 bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3799 read 0x8b2300d thru 0x8b30f78 (0xdf6c bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3800 read 0xb29fc5d thru 0xb2a75e0 (0x7984 bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3801 read 0x3625c05 thru 0x362ede7 (0x91e3 bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3803 write 0x9254a25 thru 0x9262140 (0xd71c bytes) 2024-09-21T22:17:06.755 INFO:teuthology.orchestra.run.smithi134.stdout:3805 write 0x1b24d35 thru 0x1b2db5a (0x8e26 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3806 write 0x6d2e278 thru 0x6d37d7e (0x9b07 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3811 write 0xaff1738 thru 0xaff92e8 (0x7bb1 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3812 writesame 0x9505244 thru 0x9506b05 data_size 0x1(0x18c2 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3815 write 0x1d74423 thru 0x1d80376 (0xbf54 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3816 writesame 0x9c2ed thru 0x9f6a1 data_size 0x7(0x33b5 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3817 read 0x2c98a28 thru 0x2c9fdfd (0x73d6 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3818 read 0x4ec0def thru 0x4ec2461 (0x1673 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3819 read 0x723ffbd thru 0x7249f59 (0x9f9d bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3821 read 0xc08499c thru 0xc0870eb (0x2750 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3823 trunc from 0xc63562b to 0xcd09646 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3824 punch from 0x892b483 to 0x892eae1, (0x365e bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3825 read 0x1bc43cb thru 0x1bd301f (0xec55 bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3826 read 0x39c32f2 thru 0x39ca0ef (0x6dfe bytes) 2024-09-21T22:17:06.756 INFO:teuthology.orchestra.run.smithi134.stdout:3827 read 0x3f5e041 thru 0x3f6ab33 (0xcaf3 bytes) 2024-09-21T22:17:06.757 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.757 INFO:teuthology.orchestra.run.smithi134.stdout:3830 read 0x533040e thru 0x53345c2 (0x41b5 bytes) 2024-09-21T22:17:06.757 INFO:teuthology.orchestra.run.smithi134.stdout:3831 trunc from 0xcd09646 to 0xd585e8e 2024-09-21T22:17:06.757 INFO:teuthology.orchestra.run.smithi134.stdout:3832 write 0x6bc52dd thru 0x6bd48c2 (0xf5e6 bytes) 2024-09-21T22:17:06.757 INFO:teuthology.orchestra.run.smithi134.stdout:3834 trunc from 0xd585e8e to 0x144c437 2024-09-21T22:17:06.758 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:06.756+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:06.763 INFO:teuthology.orchestra.run.smithi134.stdout:3835 read 0x586e67 thru 0x58840a (0x15a4 bytes) 2024-09-21T22:17:06.764 INFO:teuthology.orchestra.run.smithi134.stdout:3836 punch from 0xeeb1ee to 0xef3cac, (0x8abe bytes) 2024-09-21T22:17:06.764 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.764 INFO:teuthology.orchestra.run.smithi134.stdout:3839 trunc from 0x144c437 to 0x189d3e3 2024-09-21T22:17:06.770 INFO:teuthology.orchestra.run.smithi134.stdout:3840 read 0xb3dd42 thru 0xb4aa70 (0xcd2f bytes) 2024-09-21T22:17:06.770 INFO:teuthology.orchestra.run.smithi134.stdout:3841 read 0x3e9438 thru 0x3f5818 (0xc3e1 bytes) 2024-09-21T22:17:06.770 INFO:teuthology.orchestra.run.smithi134.stdout:3846 write 0x1627cc8 thru 0x16357c2 (0xdafb bytes) 2024-09-21T22:17:06.779 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.779 INFO:teuthology.orchestra.run.smithi134.stdout:3849 trunc from 0x189d3e3 to 0x1750e1c 2024-09-21T22:17:06.784 INFO:teuthology.orchestra.run.smithi134.stdout:3850 punch from 0x1653827 to 0x1658e9e, (0x5677 bytes) 2024-09-21T22:17:06.785 INFO:teuthology.orchestra.run.smithi134.stdout:3851 punch from 0xf7e266 to 0xf82d4e, (0x4ae8 bytes) 2024-09-21T22:17:06.790 INFO:teuthology.orchestra.run.smithi134.stdout:3852 trunc from 0x1750e1c to 0x67a2286 2024-09-21T22:17:06.811 INFO:teuthology.orchestra.run.smithi134.stdout:3853 writesame 0xdbb73ab thru 0xdbbafb9 data_size 0x29(0x3c0f bytes) 2024-09-21T22:17:06.816 INFO:teuthology.orchestra.run.smithi134.stdout:3854 trunc from 0xdbbafba to 0x95c3a3d 2024-09-21T22:17:06.822 INFO:teuthology.orchestra.run.smithi134.stdout:3857 writesame 0x3c58b8d thru 0x3c5db3c data_size 0x78(0x4fb0 bytes) 2024-09-21T22:17:06.825 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.837 INFO:teuthology.orchestra.run.smithi134.stdout:3865 write 0xe2abe56 thru 0xe2b6a90 (0xac3b bytes) 2024-09-21T22:17:06.842 INFO:teuthology.orchestra.run.smithi134.stdout:3866 punch from 0x4acb420 to 0x4ace63f, (0x321f bytes) 2024-09-21T22:17:06.842 INFO:teuthology.orchestra.run.smithi134.stdout:3867 write 0xaa80556 thru 0xaa8f7a4 (0xf24f bytes) 2024-09-21T22:17:06.858 INFO:teuthology.orchestra.run.smithi134.stdout:3868 trunc from 0xe2b6a91 to 0x5a37a6a 2024-09-21T22:17:06.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:06.857+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:06.867 INFO:teuthology.orchestra.run.smithi134.stdout:3869 write 0x48619c7 thru 0x486c699 (0xacd3 bytes) 2024-09-21T22:17:06.867 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:06.867 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:06.870 INFO:teuthology.orchestra.run.smithi134.stdout:3870 read 0x7489dd thru 0x756e91 (0xe4b5 bytes) 2024-09-21T22:17:06.873 INFO:teuthology.orchestra.run.smithi134.stdout:3871 trunc from 0x5a37a6a to 0x7509f78 2024-09-21T22:17:06.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:06.878 INFO:teuthology.orchestra.run.smithi134.stdout:3872 read 0x52568a7 thru 0x52667c0 (0xff1a bytes) 2024-09-21T22:17:06.878 INFO:teuthology.orchestra.run.smithi134.stdout:3873 write 0x16e6709 thru 0x16ed457 (0x6d4f bytes) 2024-09-21T22:17:06.896 INFO:teuthology.orchestra.run.smithi134.stdout:3874 write 0xe06c7ef thru 0xe076616 (0x9e28 bytes) 2024-09-21T22:17:06.904 INFO:teuthology.orchestra.run.smithi134.stdout:3875 punch from 0x5283158 to 0x5284538, (0x13e0 bytes) 2024-09-21T22:17:06.904 INFO:teuthology.orchestra.run.smithi134.stdout:3876 read 0xa4eb7c2 thru 0xa4f457f (0x8dbe bytes) 2024-09-21T22:17:06.904 INFO:teuthology.orchestra.run.smithi134.stdout:3877 writesame 0xb3dc5e9 thru 0xb3e169e data_size 0x1(0x50b6 bytes) 2024-09-21T22:17:06.914 INFO:teuthology.orchestra.run.smithi134.stdout:3878 writesame 0x430fffc thru 0x4314dc0 data_size 0x1(0x4dc5 bytes) 2024-09-21T22:17:06.927 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.940 INFO:teuthology.orchestra.run.smithi134.stdout:3880 trunc from 0xe076617 to 0x2a81c53 2024-09-21T22:17:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:3882 read 0x692bfb thru 0x6931b9 (0x5bf bytes) 2024-09-21T22:17:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:3883 read 0x320093 thru 0x32f6c6 (0xf634 bytes) 2024-09-21T22:17:06.959 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:06.958+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:06.968 INFO:teuthology.orchestra.run.smithi134.stdout:3884 write 0xa981e2a thru 0xa98edfa (0xcfd1 bytes) 2024-09-21T22:17:06.973 INFO:teuthology.orchestra.run.smithi134.stdout:3885 read 0x5d0186 thru 0x5de67b (0xe4f6 bytes) 2024-09-21T22:17:06.974 INFO:teuthology.orchestra.run.smithi134.stdout:3887 write 0x4165e56 thru 0x4166450 (0x5fb bytes) 2024-09-21T22:17:06.977 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.977 INFO:teuthology.orchestra.run.smithi134.stdout:3889 write 0x9314c42 thru 0x931735b (0x271a bytes) 2024-09-21T22:17:06.980 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.988 INFO:teuthology.orchestra.run.smithi134.stdout:3891 write 0xd43c9d2 thru 0xd441c20 (0x524f bytes) 2024-09-21T22:17:06.991 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:06.991 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:06.994 INFO:teuthology.orchestra.run.smithi134.stdout:3892 read 0x6f32a7f thru 0x6f38dce (0x6350 bytes) 2024-09-21T22:17:06.994 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:06.994 INFO:teuthology.orchestra.run.smithi134.stdout:3894 read 0xc197e1a thru 0xc19c45f (0x4646 bytes) 2024-09-21T22:17:07.000 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:07.003 INFO:teuthology.orchestra.run.smithi134.stdout:3895 trunc from 0xd441c21 to 0x5d2b19e 2024-09-21T22:17:07.022 INFO:teuthology.orchestra.run.smithi134.stdout:3896 write 0x8ea44d7 thru 0x8ea5642 (0x116c bytes) 2024-09-21T22:17:07.025 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.037 INFO:teuthology.orchestra.run.smithi134.stdout:3898 write 0xea225ca thru 0xea256ba (0x30f1 bytes) 2024-09-21T22:17:07.040 INFO:teuthology.orchestra.run.smithi134.stdout:3899 writesame 0x7bb9c04 thru 0x7bbe30d data_size 0x15(0x470a bytes) 2024-09-21T22:17:07.044 INFO:teuthology.orchestra.run.smithi134.stdout:3900 write 0x9b2ef09 thru 0x9b36b9e (0x7c96 bytes) 2024-09-21T22:17:07.049 INFO:teuthology.orchestra.run.smithi134.stdout:3901 writesame 0x30f0f08 thru 0x30f2a2c data_size 0x1(0x1b25 bytes) 2024-09-21T22:17:07.059 INFO:teuthology.orchestra.run.smithi134.stdout:3902 trunc from 0xea256bb to 0xaa6d1ba 2024-09-21T22:17:07.060 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:07.059+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:07.069 INFO:teuthology.orchestra.run.smithi134.stdout:3903 write 0x7eb11e9 thru 0x7ec0984 (0xf79c bytes) 2024-09-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi134.stdout:3904 read 0x71cdc76 thru 0x71d0b7d (0x2f08 bytes) 2024-09-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi134.stdout:3905 read 0x82ca29f thru 0x82d5928 (0xb68a bytes) 2024-09-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi134.stdout:3909 punch from 0x2dd35e1 to 0x2dd5793, (0x21b2 bytes) 2024-09-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi134.stdout:3910 punch from 0x55fd347 to 0x56099fa, (0xc6b3 bytes) 2024-09-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi134.stdout:3911 write 0x922b0e5 thru 0x923935b (0xe277 bytes) 2024-09-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi134.stdout:3912 read 0x1220094 thru 0x122d3aa (0xd317 bytes) 2024-09-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi134.stdout:3916 writesame 0xa3af3c4 thru 0xa3b0142 data_size 0x1(0xd7f bytes) 2024-09-21T22:17:07.083 INFO:teuthology.orchestra.run.smithi134.stdout:3917 read 0x9e0ece7 thru 0x9e1a624 (0xb93e bytes) 2024-09-21T22:17:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:3920 trunc from 0xaa6d1ba to 0x24bc1f6 2024-09-21T22:17:07.105 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.105 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.105 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.105 INFO:teuthology.orchestra.run.smithi134.stdout:3925 punch from 0x45ed49 to 0x4682c8, (0x957f bytes) 2024-09-21T22:17:07.124 INFO:teuthology.orchestra.run.smithi134.stdout:3926 writesame 0xcfb4e5f thru 0xcfb57cd data_size 0x5(0x96f bytes) 2024-09-21T22:17:07.124 INFO:teuthology.orchestra.run.smithi134.stdout:3927 punch from 0x461c8dd to 0x4620a2f, (0x4152 bytes) 2024-09-21T22:17:07.124 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.131 INFO:teuthology.orchestra.run.smithi134.stdout:3931 trunc from 0xcfb57ce to 0x62f71fc 2024-09-21T22:17:07.138 INFO:teuthology.orchestra.run.smithi134.stdout:3932 read 0x3e0e4bf thru 0x3e1d029 (0xeb6b bytes) 2024-09-21T22:17:07.138 INFO:teuthology.orchestra.run.smithi134.stdout:3933 read 0x4e7909d thru 0x4e87d60 (0xecc4 bytes) 2024-09-21T22:17:07.151 INFO:teuthology.orchestra.run.smithi134.stdout:3934 write 0xcd26cde thru 0xcd2c073 (0x5396 bytes) 2024-09-21T22:17:07.155 INFO:teuthology.orchestra.run.smithi134.stdout:3935 writesame 0x172fb7b thru 0x17332ec data_size 0x2(0x3772 bytes) 2024-09-21T22:17:07.156 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:07.156 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 75.023673172000002, 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.157 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:17:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:17:07.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:17:07.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:17:07.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.994613350999998, 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:17:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:17:07.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:07.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.167 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.794399604999995, 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.168 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:17:07.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:17:07.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:17:07.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:17:07.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.643160789000007, 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:17:07.173 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:17:07.178 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.240218486000003, 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.179 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:07.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.240155630999993, 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.186 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:17:07.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:17:07.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:17:07.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:17:07.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:17:07.191 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766651652999997, 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.192 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766629399000003, 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:17:07.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:17:07.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766604985000001, 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.200 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:17:07.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:17:07.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766575520000004, 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.204 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:17:07.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:17:07.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766548376000003, 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.208 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:07.212 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766529274, 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:17:07.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:07.216 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766505121999998, 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:17:07.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:17:07.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766481343999999, 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.224 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766462369000003, 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.225 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:17:07.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:17:07.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766443619, 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:17:07.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:07.233 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766411536, 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:17:07.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766398549000002, 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:17:07.241 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.766388300000003, 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:17:07.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97073 3.d 3:b30a3fcc:::rbd_data.11859a4b084.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.229828940000001, 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011897978999999999, 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97073 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924748+0000", 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.147e-06 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928499+0000", 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514219999999999 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928513+0000", 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4032000000000001e-05 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928520+0000", 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3409999999999997e-06 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928582+0000", 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1748000000000006e-05 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928728+0000", 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000145523 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928881+0000", 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015284599999999999 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.932050+0000", 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031697330000000001 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936518+0000", 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044676120000000001 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936587+0000", 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8783999999999997e-05 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936644+0000", 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7791000000000003e-05 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.251 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:07.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:07.254 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:07.251+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:07.255 INFO:teuthology.orchestra.run.smithi134.stdout:3936 punch from 0x60107bf to 0x6016048, (0x5889 bytes) 2024-09-21T22:17:07.255 INFO:teuthology.orchestra.run.smithi134.stdout:3937 read 0x9aa5bd0 thru 0x9aad0a3 (0x74d4 bytes) 2024-09-21T22:17:07.255 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.255 INFO:teuthology.orchestra.run.smithi134.stdout:3939 writesame 0xc7c7f9e thru 0xc7cb33f data_size 0x3(0x33a2 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3941 punch from 0x5599675 to 0x55a297f, (0x930a bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3942 read 0x56843ab thru 0x568b271 (0x6ec7 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3943 write 0x5d78890 thru 0x5d7c28f (0x3a00 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3944 write 0x79d1e33 thru 0x79dd7b8 (0xb986 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3945 read 0x7fa06ea thru 0x7facd8b (0xc6a2 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3946 read 0x942da66 thru 0x9433eeb (0x6486 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3947 read 0x2e2d86b thru 0x2e35b30 (0x82c6 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3948 write 0xb7591d2 thru 0xb75dca7 (0x4ad6 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3951 write 0x157a18d thru 0x1589097 (0xef0b bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3952 read 0x327239b thru 0x32743de (0x2044 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3953 punch from 0xa695b16 to 0xa698f79, (0x3463 bytes) 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:3954 trunc from 0xcd2c074 to 0x44bc8b0 2024-09-21T22:17:07.256 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.257 INFO:teuthology.orchestra.run.smithi134.stdout:3957 writesame 0x3db03e4 thru 0x3dbe978 data_size 0x27(0xe595 bytes) 2024-09-21T22:17:07.257 INFO:teuthology.orchestra.run.smithi134.stdout:3958 read 0x13e6f3c thru 0x13eda76 (0x6b3b bytes) 2024-09-21T22:17:07.257 INFO:teuthology.orchestra.run.smithi134.stdout:3959 write 0x7df7619 thru 0x7e01b8b (0xa573 bytes) 2024-09-21T22:17:07.257 INFO:teuthology.orchestra.run.smithi134.stdout:3960 read 0x661f74e thru 0x6620cfc (0x15af bytes) 2024-09-21T22:17:07.257 INFO:teuthology.orchestra.run.smithi134.stdout:3961 writesame 0xecc633f thru 0xecc88b2 data_size 0x2f(0x2574 bytes) 2024-09-21T22:17:07.257 INFO:teuthology.orchestra.run.smithi134.stdout:3962 trunc from 0xecc88b3 to 0x791b675 2024-09-21T22:17:07.262 INFO:teuthology.orchestra.run.smithi134.stdout:3964 write 0xe033618 thru 0xe033ff6 (0x9df bytes) 2024-09-21T22:17:07.265 INFO:teuthology.orchestra.run.smithi134.stdout:3967 write 0xb62d3d9 thru 0xb63ab8f (0xd7b7 bytes) 2024-09-21T22:17:07.271 INFO:teuthology.orchestra.run.smithi134.stdout:3969 read 0xbeaa85a thru 0xbead69a (0x2e41 bytes) 2024-09-21T22:17:07.271 INFO:teuthology.orchestra.run.smithi134.stdout:3970 punch from 0x2792c4a to 0x2793489, (0x83f bytes) 2024-09-21T22:17:07.271 INFO:teuthology.orchestra.run.smithi134.stdout:3971 write 0xc26a8a0 thru 0xc26bf5c (0x16bd bytes) 2024-09-21T22:17:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:3972 read 0x8cbae63 thru 0x8cc2735 (0x78d3 bytes) 2024-09-21T22:17:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:3973 read 0xae6e08e thru 0xae7d019 (0xef8c bytes) 2024-09-21T22:17:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:3974 punch from 0xd8e1180 to 0xd8ed29d, (0xc11d bytes) 2024-09-21T22:17:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:3977 read 0x2b0282f thru 0x2b029d3 (0x1a5 bytes) 2024-09-21T22:17:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:3978 write 0xa43a88b thru 0xa43ba2d (0x11a3 bytes) 2024-09-21T22:17:07.276 INFO:teuthology.orchestra.run.smithi134.stdout:3979 write 0x4e54ffd thru 0x4e5de3f (0x8e43 bytes) 2024-09-21T22:17:07.279 INFO:teuthology.orchestra.run.smithi134.stdout:3981 writesame 0x93d9ffb thru 0x93e4152 data_size 0xc(0xa158 bytes) 2024-09-21T22:17:07.284 INFO:teuthology.orchestra.run.smithi134.stdout:3982 read 0x37141ef thru 0x371c686 (0x8498 bytes) 2024-09-21T22:17:07.284 INFO:teuthology.orchestra.run.smithi134.stdout:3983 write 0x7b8cab4 thru 0x7b8ebda (0x2127 bytes) 2024-09-21T22:17:07.287 INFO:teuthology.orchestra.run.smithi134.stdout:3984 writesame 0x9d7296e thru 0x9d7c08a data_size 0x5(0x971d bytes) 2024-09-21T22:17:07.293 INFO:teuthology.orchestra.run.smithi134.stdout:3985 write 0xcabe018 thru 0xcac6d08 (0x8cf1 bytes) 2024-09-21T22:17:07.299 INFO:teuthology.orchestra.run.smithi134.stdout:3986 read 0x6b19c86 thru 0x6b2604d (0xc3c8 bytes) 2024-09-21T22:17:07.299 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.299 INFO:teuthology.orchestra.run.smithi134.stdout:3988 write 0x7ef254 thru 0x7f7afd (0x88aa bytes) 2024-09-21T22:17:07.304 INFO:teuthology.orchestra.run.smithi134.stdout:3989 write 0xd4f611e thru 0xd50227a (0xc15d bytes) 2024-09-21T22:17:07.314 INFO:teuthology.orchestra.run.smithi134.stdout:3990 writesame 0x44e91c4 thru 0x44f09fb data_size 0x4(0x7838 bytes) 2024-09-21T22:17:07.320 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.320 INFO:teuthology.orchestra.run.smithi134.stdout:3993 read 0x4864fdd thru 0x4874a08 (0xfa2c bytes) 2024-09-21T22:17:07.330 INFO:teuthology.orchestra.run.smithi134.stdout:3996 trunc from 0xe033ff7 to 0x5712471 2024-09-21T22:17:07.344 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:07.353 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:07.351+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:07.354 INFO:teuthology.orchestra.run.smithi134.stdout:3998 writesame 0xa043624 thru 0xa052dd6 data_size 0x17(0xf7b3 bytes) 2024-09-21T22:17:07.360 INFO:teuthology.orchestra.run.smithi134.stdout:4000 write 0xac9404b thru 0xaca04a9 (0xc45f bytes) 2024-09-21T22:17:07.367 INFO:teuthology.orchestra.run.smithi134.stdout:4001 trunc from 0xaca04aa to 0xbb3643b 2024-09-21T22:17:07.372 INFO:teuthology.orchestra.run.smithi134.stdout:4002 write 0x102a1ba thru 0x1030537 (0x637e bytes) 2024-09-21T22:17:07.376 INFO:teuthology.orchestra.run.smithi134.stdout:4003 read 0x488ad20 thru 0x4898edc (0xe1bd bytes) 2024-09-21T22:17:07.376 INFO:teuthology.orchestra.run.smithi134.stdout:4004 write 0xaa9fa64 thru 0xaaa0bfd (0x119a bytes) 2024-09-21T22:17:07.379 INFO:teuthology.orchestra.run.smithi134.stdout:4005 punch from 0x8a248e9 to 0x8a2ed6f, (0xa486 bytes) 2024-09-21T22:17:07.379 INFO:teuthology.orchestra.run.smithi134.stdout:4006 trunc from 0xbb3643b to 0xb7fd100 2024-09-21T22:17:07.385 INFO:teuthology.orchestra.run.smithi134.stdout:4007 read 0x3fe213e thru 0x3fe7fd5 (0x5e98 bytes) 2024-09-21T22:17:07.385 INFO:teuthology.orchestra.run.smithi134.stdout:4008 clone 21 order 18 su 65536 sc 6 2024-09-21T22:17:07.407 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:07.407 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:07.407 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:07.407 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:07.415 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:07.454 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:07.453+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:07.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:07.554+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:07.558 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:07.558 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:07.558 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:07.558 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:07.559 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:07.567 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:07.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:07.655 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:07.654+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:07.671 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269987708999999, 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.672 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:07.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.676 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269942090000001, 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.677 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:17:07.680 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269869356999997, 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.681 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.683 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269822480000002, 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.685 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.687 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269757740000003, 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:07.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:17:07.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:17:07.693 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269721511, 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.694 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269627583999998, 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.698 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:07.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:17:07.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:17:07.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269603816, 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:17:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:17:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269538945000001, 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:17:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:17:07.710 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269501321999996, 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.711 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.713 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269460529, 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.715 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:07.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:17:07.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:17:07.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269385067999998, 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:17:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269314694999998, 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:07.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:17:07.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:17:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269281020000001, 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.731 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269212267999997, 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:17:07.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:07.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:17:07.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:17:07.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269167871999997, 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269076923999997, 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.740 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:17:07.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:17:07.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269048400000003, 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:17:07.744 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:07.748 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.269016106000002, 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:17:07.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.268977972999998, 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:07.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:17:07.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:17:07.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:17:07.756 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:07.757 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:07.757 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:07.758 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:07.758 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:07.759 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:07.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:07.760 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:07.756+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:07.760 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:07.760 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:07.760 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:07.761 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:07.770 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:07.770 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:07.787 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:07.787 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:07.804 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:07.804 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:07.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:07.835 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:07.877 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:07.877 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:07.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:07.876+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:07.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:07.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:07.969+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:08.029 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:08.029 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:08.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:08.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:17:08.080 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:08.079+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:08.161 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:08.160+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:08.189 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:08.189 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:08.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:08.262 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:08.261+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:08.344 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:08.344 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:08.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:08.397 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:08.396+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:08.456 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:08.456 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:08.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:08.465 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:08.463+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:08.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:08.565+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:08.608 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:08.608 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:08.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:08.666 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:08.665+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:08.760 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:08.760 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:08.768 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:08.766+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:08.769 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:08.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:08.868+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:08.871 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:08.871 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:08.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:08.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:08.968+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:09.023 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:09.023 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:09.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:09.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:09.071+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:09.080 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:17:09.171 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:09.170+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:09.189 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:09.189 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:09.189 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:17:09.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:17:09.223 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:09.223 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:09.233 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:09.274 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:09.273+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:09.373 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:09.372+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:09.380 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:09.380 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:09.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:09.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:09.473+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 111, 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:17:09.072401+0000", 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:59.900683+0000", 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:16:44.923178+0000", 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5799936, 2024-09-21T22:17:09.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 5, 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 3, 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:17:09.489 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "luminous", 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:09.490 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:09.491 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:09.492 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:09.493 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:09.494 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 6.9000000953674316, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 6.9000000953674316, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.28999999165534973, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:17:09.495 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:09.496 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:09.497 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:17:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:17:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:17:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 2.630000114440918, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 2.630000114440918, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "pool_client.0", 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:34.502611+0000", 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 32, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 32, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 32, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 32, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 32, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "111", 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 44, 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 111, 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.75, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.75, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1.1399999856948853, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:17:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 13, 2024-09-21T22:17:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 26, 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 45, 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 27, 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:17:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:17:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/704257458", 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/704257458", 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/704257458", 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/704257458", 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 0, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:17:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 27 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:17:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:17:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [ 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.d", 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: 6, 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: 0 2024-09-21T22:17:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.16", 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: 2 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:17:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [ 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:17:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 40, 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 42, 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [], 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [], 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:17:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:09.560 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:09.561 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:09.562 INFO:tasks.thrashosds.thrasher:j is {'epoch': 111, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:17:09.072401+0000', 'last_up_change': '2024-09-21T22:15:59.900683+0000', 'last_in_change': '2024-09-21T22:16:44.923178+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:15:34.502611+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 44, 'snap_epoch': 111, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 26, 'up_from': 45, 'up_thru': 101, 'down_at': 27, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 704257458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 704257458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 704257458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 704257458}]}, 'public_addr': '172.21.15.134:6809/704257458', 'cluster_addr': '172.21.15.134:6811/704257458', 'heartbeat_back_addr': '172.21.15.134:6815/704257458', 'heartbeat_front_addr': '172.21.15.134:6813/704257458', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 27}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.d', 'osds': [6, 0]}, {'pgid': '3.16', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 40, 'length': 1}, {'begin': 42, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:17:09.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:17:09.563 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:09.607 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:09.605+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:09.670 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:09.670 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:09.676 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:09.675+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:09.679 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:09.778 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:09.776+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:09.822 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:09.823 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:09.831 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:09.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:09.876 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:17:09.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:09.877+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:09.888 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-21T22:17:09.190754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":799057887,"num_objects":801,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":801,"num_whiteouts":0,"num_read":110496,"num_read_kb":684227,"num_write":15511,"num_write_kb":541308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1154,"num_bytes_recovered":137648407,"num_keys_recovered":223,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10737,"ondisk_log_size":10737,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":729452,"kb_used_data":427040,"kb_used_omap":15,"kb_used_meta":301744,"kb_avail":754245268,"statfs":{"total":773094113280,"available":772347154432,"internally_reserved":0,"allocated":437288960,"data_stored":430052985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":308986652},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5403214,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":1950,"num_read_kb":15551,"num_write":586,"num_write_kb":22622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000700"},"pg_stats":[{"pgid":"3.1f","version":"106'713","reported_seq":9752,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.425827+0000","last_change":"2024-09-21T22:17:01.029024+0000","last_active":"2024-09-21T22:17:04.425827+0000","last_peered":"2024-09-21T22:17:04.425827+0000","last_clean":"2024-09-21T22:17:04.425827+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:17:04.425827+0000","last_undegraded":"2024-09-21T22:17:04.425827+0000","last_fullsized":"2024-09-21T22:17:04.425827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:50:04.017102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067276100000000002,"stat_sum":{"num_bytes":45421161,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":11368,"num_read_kb":41647,"num_write":1266,"num_write_kb":23153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1e","version":"109'409","reported_seq":3385,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.073995+0000","last_change":"2024-09-21T22:17:05.056340+0000","last_active":"2024-09-21T22:17:08.073995+0000","last_peered":"2024-09-21T22:17:08.073995+0000","last_clean":"2024-09-21T22:17:08.073995+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:17:08.073995+0000","last_undegraded":"2024-09-21T22:17:08.073995+0000","last_fullsized":"2024-09-21T22:17:08.073995+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:34.210584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011658250000000001,"stat_sum":{"num_bytes":25324622,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3906,"num_read_kb":23064,"num_write":412,"num_write_kb":16416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.1d","version":"106'199","reported_seq":6551,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.307554+0000","last_change":"2024-09-21T22:17:01.122740+0000","last_active":"2024-09-21T22:17:04.307554+0000","last_peered":"2024-09-21T22:17:04.307554+0000","last_clean":"2024-09-21T22:17:04.307554+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:17:04.307554+0000","last_undegraded":"2024-09-21T22:17:04.307554+0000","last_fullsized":"2024-09-21T22:17:04.307554+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:34:40.134691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041494399999999999,"stat_sum":{"num_bytes":52713024,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":6202,"num_read_kb":39394,"num_write":312,"num_write_kb":24600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1c","version":"106'535","reported_seq":1620,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.278218+0000","last_change":"2024-09-21T22:17:01.122960+0000","last_active":"2024-09-21T22:17:04.278218+0000","last_peered":"2024-09-21T22:17:04.278218+0000","last_clean":"2024-09-21T22:17:04.278218+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:17:04.278218+0000","last_undegraded":"2024-09-21T22:17:04.278218+0000","last_fullsized":"2024-09-21T22:17:04.278218+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:29:48.617523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000652295,"stat_sum":{"num_bytes":22528035,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2286,"num_read_kb":22208,"num_write":964,"num_write_kb":22325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1b","version":"106'196","reported_seq":1394,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.375088+0000","last_change":"2024-09-21T22:17:01.029299+0000","last_active":"2024-09-21T22:17:04.375088+0000","last_peered":"2024-09-21T22:17:04.375088+0000","last_clean":"2024-09-21T22:17:04.375088+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:17:04.375088+0000","last_undegraded":"2024-09-21T22:17:04.375088+0000","last_fullsized":"2024-09-21T22:17:04.375088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:30:13.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081707999999999998,"stat_sum":{"num_bytes":21834877,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1155,"num_read_kb":16930,"num_write":283,"num_write_kb":16721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1a","version":"106'197","reported_seq":1667,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.387330+0000","last_change":"2024-09-21T22:17:01.123260+0000","last_active":"2024-09-21T22:17:04.387330+0000","last_peered":"2024-09-21T22:17:04.387330+0000","last_clean":"2024-09-21T22:17:04.387330+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:17:04.387330+0000","last_undegraded":"2024-09-21T22:17:04.387330+0000","last_fullsized":"2024-09-21T22:17:04.387330+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:07.817667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065032000000000002,"stat_sum":{"num_bytes":8833002,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1506,"num_read_kb":8767,"num_write":279,"num_write_kb":12785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.19","version":"107'395","reported_seq":2038,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.185738+0000","last_change":"2024-09-21T22:17:05.060800+0000","last_active":"2024-09-21T22:17:05.185738+0000","last_peered":"2024-09-21T22:17:05.185738+0000","last_clean":"2024-09-21T22:17:05.185738+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:17:05.185738+0000","last_undegraded":"2024-09-21T22:17:05.185738+0000","last_fullsized":"2024-09-21T22:17:05.185738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:03:07.187280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001314586,"stat_sum":{"num_bytes":17028320,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2762,"num_read_kb":13078,"num_write":496,"num_write_kb":16145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.18","version":"109'629","reported_seq":1668,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.074190+0000","last_change":"2024-09-21T22:17:05.055813+0000","last_active":"2024-09-21T22:17:08.074190+0000","last_peered":"2024-09-21T22:17:08.074190+0000","last_clean":"2024-09-21T22:17:08.074190+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:17:08.074190+0000","last_undegraded":"2024-09-21T22:17:08.074190+0000","last_fullsized":"2024-09-21T22:17:08.074190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:05:01.667556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069726100000000002,"stat_sum":{"num_bytes":21442256,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2758,"num_read_kb":20818,"num_write":845,"num_write_kb":21615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.17","version":"106'701","reported_seq":1819,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.275463+0000","last_change":"2024-09-21T22:17:01.029134+0000","last_active":"2024-09-21T22:17:04.275463+0000","last_peered":"2024-09-21T22:17:04.275463+0000","last_clean":"2024-09-21T22:17:04.275463+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:17:04.275463+0000","last_undegraded":"2024-09-21T22:17:04.275463+0000","last_fullsized":"2024-09-21T22:17:04.275463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:56:29.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000653734,"stat_sum":{"num_bytes":13494306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":3835,"num_read_kb":16922,"num_write":1332,"num_write_kb":17493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.16","version":"106'149","reported_seq":13133,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.059741+0000","last_change":"2024-09-21T22:17:05.059951+0000","last_active":"2024-09-21T22:17:05.059741+0000","last_peered":"2024-09-21T22:17:05.059741+0000","last_clean":"2024-09-21T22:17:05.059741+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:17:05.059741+0000","last_undegraded":"2024-09-21T22:17:05.059741+0000","last_fullsized":"2024-09-21T22:17:05.059741+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:31.193536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046352200000000001,"stat_sum":{"num_bytes":42376418,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":13488,"num_read_kb":43828,"num_write":235,"num_write_kb":12623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.15","version":"106'588","reported_seq":2618,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.398061+0000","last_change":"2024-09-21T22:17:01.190357+0000","last_active":"2024-09-21T22:17:04.398061+0000","last_peered":"2024-09-21T22:17:04.398061+0000","last_clean":"2024-09-21T22:17:04.398061+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:17:04.398061+0000","last_undegraded":"2024-09-21T22:17:04.398061+0000","last_fullsized":"2024-09-21T22:17:04.398061+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:42:53.403468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024231779999999998,"stat_sum":{"num_bytes":46515667,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":3609,"num_read_kb":26340,"num_write":954,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.14","version":"106'251","reported_seq":2147,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.409205+0000","last_change":"2024-09-21T22:17:01.122690+0000","last_active":"2024-09-21T22:17:04.409205+0000","last_peered":"2024-09-21T22:17:04.409205+0000","last_clean":"2024-09-21T22:17:04.409205+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:17:04.409205+0000","last_undegraded":"2024-09-21T22:17:04.409205+0000","last_fullsized":"2024-09-21T22:17:04.409205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:02.792022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039516699999999998,"stat_sum":{"num_bytes":45369954,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1515,"num_read_kb":18338,"num_write":299,"num_write_kb":16806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.058476+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:17:04.058476+0000","last_peered":"2024-09-21T22:17:04.058476+0000","last_clean":"2024-09-21T22:17:04.058476+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:17:04.058476+0000","last_undegraded":"2024-09-21T22:17:04.058476+0000","last_fullsized":"2024-09-21T22:17:04.058476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"106'263","reported_seq":2142,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.367011+0000","last_change":"2024-09-21T22:17:01.028758+0000","last_active":"2024-09-21T22:17:04.367011+0000","last_peered":"2024-09-21T22:17:04.367011+0000","last_clean":"2024-09-21T22:17:04.367011+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:17:04.367011+0000","last_undegraded":"2024-09-21T22:17:04.367011+0000","last_fullsized":"2024-09-21T22:17:04.367011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:58.100857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041125999999999999,"stat_sum":{"num_bytes":34278718,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":2369,"num_read_kb":29360,"num_write":310,"num_write_kb":21601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":191,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.059470+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:17:05.059470+0000","last_peered":"2024-09-21T22:17:05.059470+0000","last_clean":"2024-09-21T22:17:05.059470+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:17:05.059470+0000","last_undegraded":"2024-09-21T22:17:05.059470+0000","last_fullsized":"2024-09-21T22:17:05.059470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'259","reported_seq":1581,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.074009+0000","last_change":"2024-09-21T22:17:05.057188+0000","last_active":"2024-09-21T22:17:08.074009+0000","last_peered":"2024-09-21T22:17:08.074009+0000","last_clean":"2024-09-21T22:17:08.074009+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:17:08.074009+0000","last_undegraded":"2024-09-21T22:17:08.074009+0000","last_fullsized":"2024-09-21T22:17:08.074009+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:04.386091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014858339999999999,"stat_sum":{"num_bytes":27022323,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1389,"num_read_kb":17779,"num_write":316,"num_write_kb":15443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.067992+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:17:04.067992+0000","last_peered":"2024-09-21T22:17:04.067992+0000","last_clean":"2024-09-21T22:17:04.067992+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:17:04.067992+0000","last_undegraded":"2024-09-21T22:17:04.067992+0000","last_fullsized":"2024-09-21T22:17:04.067992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"106'323","reported_seq":8974,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.059683+0000","last_change":"2024-09-21T22:17:05.059900+0000","last_active":"2024-09-21T22:17:05.059683+0000","last_peered":"2024-09-21T22:17:05.059683+0000","last_clean":"2024-09-21T22:17:05.059683+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:17:05.059683+0000","last_undegraded":"2024-09-21T22:17:05.059683+0000","last_fullsized":"2024-09-21T22:17:05.059683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:34:51.394336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421056,"stat_sum":{"num_bytes":37955454,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":8836,"num_read_kb":37532,"num_write":379,"num_write_kb":19643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":191,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.059440+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:17:05.059440+0000","last_peered":"2024-09-21T22:17:05.059440+0000","last_clean":"2024-09-21T22:17:05.059440+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:17:05.059440+0000","last_undegraded":"2024-09-21T22:17:05.059440+0000","last_fullsized":"2024-09-21T22:17:05.059440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"109'203","reported_seq":1627,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.073990+0000","last_change":"2024-09-21T22:17:05.056742+0000","last_active":"2024-09-21T22:17:08.073990+0000","last_peered":"2024-09-21T22:17:08.073990+0000","last_clean":"2024-09-21T22:17:08.073990+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:17:08.073990+0000","last_undegraded":"2024-09-21T22:17:08.073990+0000","last_fullsized":"2024-09-21T22:17:08.073990+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:10:30.670387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269556,"stat_sum":{"num_bytes":18502719,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1069,"num_read_kb":18876,"num_write":315,"num_write_kb":13124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.3","version":"106'178","reported_seq":1448,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.409197+0000","last_change":"2024-09-21T22:17:01.123205+0000","last_active":"2024-09-21T22:17:04.409197+0000","last_peered":"2024-09-21T22:17:04.409197+0000","last_clean":"2024-09-21T22:17:04.409197+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:17:04.409197+0000","last_undegraded":"2024-09-21T22:17:04.409197+0000","last_fullsized":"2024-09-21T22:17:04.409197+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:39:13.710603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083054899999999998,"stat_sum":{"num_bytes":19619390,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":974,"num_read_kb":17913,"num_write":227,"num_write_kb":16863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":38,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.059411+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:17:05.059411+0000","last_peered":"2024-09-21T22:17:05.059411+0000","last_clean":"2024-09-21T22:17:05.059411+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:17:05.059411+0000","last_undegraded":"2024-09-21T22:17:05.059411+0000","last_fullsized":"2024-09-21T22:17:05.059411+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"106'473","reported_seq":8171,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.060651+0000","last_change":"2024-09-21T22:17:05.060814+0000","last_active":"2024-09-21T22:17:05.060651+0000","last_peered":"2024-09-21T22:17:05.060651+0000","last_clean":"2024-09-21T22:17:05.060651+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:17:05.060651+0000","last_undegraded":"2024-09-21T22:17:05.060651+0000","last_fullsized":"2024-09-21T22:17:05.060651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:13:14.174585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087497,"stat_sum":{"num_bytes":36961901,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":8442,"num_read_kb":37980,"num_write":650,"num_write_kb":22590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":194,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.077958+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:17:05.077958+0000","last_peered":"2024-09-21T22:17:05.077958+0000","last_clean":"2024-09-21T22:17:05.077958+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:17:05.077958+0000","last_undegraded":"2024-09-21T22:17:05.077958+0000","last_fullsized":"2024-09-21T22:17:05.077958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"106'188","reported_seq":1375,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.342208+0000","last_change":"2024-09-21T22:17:01.028887+0000","last_active":"2024-09-21T22:17:04.342208+0000","last_peered":"2024-09-21T22:17:04.342208+0000","last_clean":"2024-09-21T22:17:04.342208+0000","last_became_active":"2024-09-21T22:16:48.956575+0000","last_became_peered":"2024-09-21T22:16:48.956575+0000","last_unstale":"2024-09-21T22:17:04.342208+0000","last_undegraded":"2024-09-21T22:17:04.342208+0000","last_fullsized":"2024-09-21T22:17:04.342208+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:02.111424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062623099999999999,"stat_sum":{"num_bytes":11270848,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":773,"num_read_kb":10748,"num_write":253,"num_write_kb":15370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6594455,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.067730+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:17:04.067730+0000","last_peered":"2024-09-21T22:17:04.067730+0000","last_clean":"2024-09-21T22:17:04.067730+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:17:04.067730+0000","last_undegraded":"2024-09-21T22:17:04.067730+0000","last_fullsized":"2024-09-21T22:17:04.067730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"109'207","reported_seq":864,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.073792+0000","last_change":"2024-09-21T22:17:05.057265+0000","last_active":"2024-09-21T22:17:08.073792+0000","last_peered":"2024-09-21T22:17:08.073792+0000","last_clean":"2024-09-21T22:17:08.073792+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:17:08.073792+0000","last_undegraded":"2024-09-21T22:17:08.073792+0000","last_fullsized":"2024-09-21T22:17:08.073792+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:47.799463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001305968,"stat_sum":{"num_bytes":18261335,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":532,"num_read_kb":21395,"num_write":266,"num_write_kb":20979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":27,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-21T22:17:05.077814+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:17:05.077814+0000","last_peered":"2024-09-21T22:17:05.077814+0000","last_clean":"2024-09-21T22:17:05.077814+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:17:05.077814+0000","last_undegraded":"2024-09-21T22:17:05.077814+0000","last_fullsized":"2024-09-21T22:17:05.077814+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":339,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.067776+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:17:04.067776+0000","last_peered":"2024-09-21T22:17:04.067776+0000","last_clean":"2024-09-21T22:17:04.067776+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:17:04.067776+0000","last_undegraded":"2024-09-21T22:17:04.067776+0000","last_fullsized":"2024-09-21T22:17:04.067776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"109'536","reported_seq":1428,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.074206+0000","last_change":"2024-09-21T22:17:05.056558+0000","last_active":"2024-09-21T22:17:08.074206+0000","last_peered":"2024-09-21T22:17:08.074206+0000","last_clean":"2024-09-21T22:17:08.074206+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:17:08.074206+0000","last_undegraded":"2024-09-21T22:17:08.074206+0000","last_fullsized":"2024-09-21T22:17:08.074206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:43:28.951802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198064,"stat_sum":{"num_bytes":19891516,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2179,"num_read_kb":11304,"num_write":864,"num_write_kb":15605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.9","version":"106'221","reported_seq":2074,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.409992+0000","last_change":"2024-09-21T22:17:01.122990+0000","last_active":"2024-09-21T22:17:04.409992+0000","last_peered":"2024-09-21T22:17:04.409992+0000","last_clean":"2024-09-21T22:17:04.409992+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:17:04.409992+0000","last_undegraded":"2024-09-21T22:17:04.409992+0000","last_fullsized":"2024-09-21T22:17:04.409992+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:01:53.307457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061650799999999999,"stat_sum":{"num_bytes":42125610,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2154,"num_read_kb":28753,"num_write":340,"num_write_kb":16871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.a","version":"106'241","reported_seq":1545,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.398109+0000","last_change":"2024-09-21T22:17:01.021796+0000","last_active":"2024-09-21T22:17:04.398109+0000","last_peered":"2024-09-21T22:17:04.398109+0000","last_clean":"2024-09-21T22:17:04.398109+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:17:04.398109+0000","last_undegraded":"2024-09-21T22:17:04.398109+0000","last_fullsized":"2024-09-21T22:17:04.398109+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:15:54.560356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041285200000000001,"stat_sum":{"num_bytes":17968872,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1801,"num_read_kb":9670,"num_write":259,"num_write_kb":12517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.b","version":"109'674","reported_seq":1901,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.073929+0000","last_change":"2024-09-21T22:17:05.056258+0000","last_active":"2024-09-21T22:17:08.073929+0000","last_peered":"2024-09-21T22:17:08.073929+0000","last_clean":"2024-09-21T22:17:08.073929+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:17:08.073929+0000","last_undegraded":"2024-09-21T22:17:08.073929+0000","last_fullsized":"2024-09-21T22:17:08.073929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:41:46.371806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001097495,"stat_sum":{"num_bytes":12654871,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4105,"num_read_kb":15065,"num_write":931,"num_write_kb":14691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.c","version":"109'141","reported_seq":777,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-21T22:17:08.074011+0000","last_change":"2024-09-21T22:17:05.055609+0000","last_active":"2024-09-21T22:17:08.074011+0000","last_peered":"2024-09-21T22:17:08.074011+0000","last_clean":"2024-09-21T22:17:08.074011+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:17:08.074011+0000","last_undegraded":"2024-09-21T22:17:08.074011+0000","last_fullsized":"2024-09-21T22:17:08.074011+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:29:52.326722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046359500000000002,"stat_sum":{"num_bytes":11098461,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":409,"num_read_kb":15281,"num_write":152,"num_write_kb":11714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.d","version":"106'241","reported_seq":977,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.376589+0000","last_change":"2024-09-21T22:17:01.021842+0000","last_active":"2024-09-21T22:17:04.376589+0000","last_peered":"2024-09-21T22:17:04.376589+0000","last_clean":"2024-09-21T22:17:04.376589+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:17:04.376589+0000","last_undegraded":"2024-09-21T22:17:04.376589+0000","last_fullsized":"2024-09-21T22:17:04.376589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:46:52.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043972899999999998,"stat_sum":{"num_bytes":13566028,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":848,"num_read_kb":16160,"num_write":358,"num_write_kb":15224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.e","version":"106'110","reported_seq":768,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.335652+0000","last_change":"2024-09-21T22:17:01.191504+0000","last_active":"2024-09-21T22:17:04.335652+0000","last_peered":"2024-09-21T22:17:04.335652+0000","last_clean":"2024-09-21T22:17:04.335652+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:17:04.335652+0000","last_undegraded":"2024-09-21T22:17:04.335652+0000","last_fullsized":"2024-09-21T22:17:04.335652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:28:36.831525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003721551,"stat_sum":{"num_bytes":8096349,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":210,"num_read_kb":8228,"num_write":185,"num_write_kb":12873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.f","version":"106'299","reported_seq":1393,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.377876+0000","last_change":"2024-09-21T22:17:01.191916+0000","last_active":"2024-09-21T22:17:04.377876+0000","last_peered":"2024-09-21T22:17:04.377876+0000","last_clean":"2024-09-21T22:17:04.377876+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:17:04.377876+0000","last_undegraded":"2024-09-21T22:17:04.377876+0000","last_fullsized":"2024-09-21T22:17:04.377876+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:03:31.908387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030590740000000002,"stat_sum":{"num_bytes":13533791,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1228,"num_read_kb":10252,"num_write":382,"num_write_kb":13403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.10","version":"106'182","reported_seq":1388,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.359783+0000","last_change":"2024-09-21T22:17:01.022086+0000","last_active":"2024-09-21T22:17:04.359783+0000","last_peered":"2024-09-21T22:17:04.359783+0000","last_clean":"2024-09-21T22:17:04.359783+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:17:04.359783+0000","last_undegraded":"2024-09-21T22:17:04.359783+0000","last_fullsized":"2024-09-21T22:17:04.359783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:38.580634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066290299999999995,"stat_sum":{"num_bytes":24089535,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":998,"num_read_kb":16998,"num_write":221,"num_write_kb":10529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.11","version":"106'126","reported_seq":1098,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.372118+0000","last_change":"2024-09-21T22:17:01.191640+0000","last_active":"2024-09-21T22:17:04.372118+0000","last_peered":"2024-09-21T22:17:04.372118+0000","last_clean":"2024-09-21T22:17:04.372118+0000","last_became_active":"2024-09-21T22:16:48.956681+0000","last_became_peered":"2024-09-21T22:16:48.956681+0000","last_unstale":"2024-09-21T22:17:04.372118+0000","last_undegraded":"2024-09-21T22:17:04.372118+0000","last_fullsized":"2024-09-21T22:17:04.372118+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:05:15.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032917290000000002,"stat_sum":{"num_bytes":12823845,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":479,"num_read_kb":11815,"num_write":138,"num_write_kb":14051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":11486398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.12","version":"106'317","reported_seq":5953,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.333485+0000","last_change":"2024-09-21T22:17:01.029401+0000","last_active":"2024-09-21T22:17:04.333485+0000","last_peered":"2024-09-21T22:17:04.333485+0000","last_clean":"2024-09-21T22:17:04.333485+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:17:04.333485+0000","last_undegraded":"2024-09-21T22:17:04.333485+0000","last_fullsized":"2024-09-21T22:17:04.333485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:41:03.355978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078752200000000003,"stat_sum":{"num_bytes":16636572,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6256,"num_read_kb":15905,"num_write":443,"num_write_kb":13655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.13","version":"106'473","reported_seq":10359,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-21T22:17:04.242976+0000","last_change":"2024-09-21T22:17:01.191955+0000","last_active":"2024-09-21T22:17:04.242976+0000","last_peered":"2024-09-21T22:17:04.242976+0000","last_clean":"2024-09-21T22:17:04.242976+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:17:04.242976+0000","last_undegraded":"2024-09-21T22:17:04.242976+0000","last_fullsized":"2024-09-21T22:17:04.242976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:16:47.640994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002970412,"stat_sum":{"num_bytes":39227720,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10939,"num_read_kb":41779,"num_write":684,"num_write_kb":16117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"1"},{"start":"28","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":798467500,"num_objects":797,"num_object_clones":0,"num_object_copies":1594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":797,"num_whiteouts":0,"num_read":110380,"num_read_kb":684127,"num_write":15350,"num_write_kb":538890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1154,"num_bytes_recovered":137648407,"num_keys_recovered":223,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":475299840,"data_stored":473372997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10617,"ondisk_log_size":10617,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90576,"kb_used_data":51060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94281264,"statfs":{"total":96636764160,"available":96544014336,"internally_reserved":0,"allocated":52285440,"data_stored":51392924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55800,"kb_used_data":19992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94316040,"statfs":{"total":96636764160,"available":96579624960,"internally_reserved":0,"allocated":20471808,"data_stored":19712330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90576,"kb_used_data":51060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94281264,"statfs":{"total":96636764160,"available":96544014336,"internally_reserved":0,"allocated":52285440,"data_stored":51376782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105940,"kb_used_data":78908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94265900,"statfs":{"total":96636764160,"available":96528281600,"internally_reserved":0,"allocated":80801792,"data_stored":79789179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528335,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100588,"kb_used_data":59988,"kb_used_omap":4,"kb_used_meta":40571,"kb_avail":94271252,"statfs":{"total":96636764160,"available":96533762048,"internally_reserved":0,"allocated":61427712,"data_stored":60385443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":41545394},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71844,"kb_used_data":36496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94299996,"statfs":{"total":96636764160,"available":96563195904,"internally_reserved":0,"allocated":37371904,"data_stored":36555435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99604,"kb_used_data":60092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94272236,"statfs":{"total":96636764160,"available":96534769664,"internally_reserved":0,"allocated":61534208,"data_stored":60646042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114524,"kb_used_data":69444,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94257316,"statfs":{"total":96636764160,"available":96519491584,"internally_reserved":0,"allocated":71110656,"data_stored":70194850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84901888,"data_stored":84640862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61513728,"data_stored":61290770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36098048,"data_stored":35948681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":60116992,"data_stored":59760558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":95825920,"data_stored":95474438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59686912,"data_stored":59433559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25415680,"data_stored":25311290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":51740672,"data_stored":51512839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:17:09.891 INFO:tasks.thrashosds.thrasher:Setting 3.11 to [1, 7] 2024-09-21T22:17:09.891 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.11', '1', '7'] 2024-09-21T22:17:09.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.11 1 7 2024-09-21T22:17:09.970 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:09.971 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:09.977 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:09.977 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:09.979 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:09.978+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:09.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:09.988 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:09.989 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:10.005 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:10.005 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:10.021 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:10.021 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:10.038 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:10.056 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:10.056 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:10.073 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:10.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:10.079+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:10.096 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:10.096 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:10.134 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:10.135 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:10.135 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:10.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:10.181 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:10.180+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:10.209 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-21T22:17:10.249 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:10.249 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:10.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:10.302 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:10.300+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417237956999998, 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417217785999995, 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:10.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.374 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417198839999998, 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:10.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417179477000005, 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417146829000004, 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417095661999994, 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417068990000004, 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:10.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417044191000002, 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:10.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.417013243, 2024-09-21T22:17:10.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:10.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.416989025000007, 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.402 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.416964672999995, 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:10.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.416940429999997, 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.410 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:10.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.413 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.416910694999999, 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:10.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.416875224999998, 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.421 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.379344019999998, 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:10.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:10.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:10.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.186476360999997, 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.426 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.181109829, 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:10.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:10.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:10.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:10.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.163545036000002, 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.435 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.131164042999998, 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:10.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:10.444 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.083360597000002, 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:10.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.451 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.451 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:10.452 INFO:teuthology.orchestra.run.smithi134.stdout:4009 write 0x663ee06 thru 0x6648f59 (0xa154 bytes) 2024-09-21T22:17:10.452 INFO:teuthology.orchestra.run.smithi134.stdout:4010 read 0x71e6578 thru 0x71ee7f9 (0x8282 bytes) 2024-09-21T22:17:10.452 INFO:teuthology.orchestra.run.smithi134.stdout:4011 trunc from 0xb7fd100 to 0x6a5e5c6 2024-09-21T22:17:10.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:10.453 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:10.450+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:10.480 INFO:teuthology.orchestra.run.smithi134.stdout:4012 writesame 0xca998cc thru 0xca9f6c5 data_size 0x17(0x5dfa bytes) 2024-09-21T22:17:10.480 INFO:teuthology.orchestra.run.smithi134.stdout:4013 punch from 0xb27d784 to 0xb28bb2f, (0xe3ab bytes) 2024-09-21T22:17:10.480 INFO:teuthology.orchestra.run.smithi134.stdout:4014 punch from 0x5de3c62 to 0x5dea7a9, (0x6b47 bytes) 2024-09-21T22:17:10.480 INFO:teuthology.orchestra.run.smithi134.stdout:4015 punch from 0x3f9d213 to 0x3fa78b5, (0xa6a2 bytes) 2024-09-21T22:17:10.486 INFO:teuthology.orchestra.run.smithi134.stdout:4017 writesame 0xd262e9d thru 0xd269059 data_size 0x1(0x61bd bytes) 2024-09-21T22:17:10.486 INFO:teuthology.orchestra.run.smithi134.stdout:4019 writesame 0x73ddd75 thru 0x73e9881 data_size 0x3d(0xbb0d bytes) 2024-09-21T22:17:10.491 INFO:teuthology.orchestra.run.smithi134.stdout:4021 writesame 0xa49bf9b thru 0xa4a726a data_size 0x8(0xb2d0 bytes) 2024-09-21T22:17:10.496 INFO:teuthology.orchestra.run.smithi134.stdout:4022 write 0xcbacb3f thru 0xcbb9463 (0xc925 bytes) 2024-09-21T22:17:10.502 INFO:teuthology.orchestra.run.smithi134.stdout:4023 punch from 0x7aced6c to 0x7ad1e7a, (0x310e bytes) 2024-09-21T22:17:10.502 INFO:teuthology.orchestra.run.smithi134.stdout:4024 read 0x2e68e16 thru 0x2e6aa52 (0x1c3d bytes) 2024-09-21T22:17:10.502 INFO:teuthology.orchestra.run.smithi134.stdout:4026 read 0x9f10836 thru 0x9f1d3b5 (0xcb80 bytes) 2024-09-21T22:17:10.502 INFO:teuthology.orchestra.run.smithi134.stdout:4027 read 0x82f4e6f thru 0x82f57b1 (0x943 bytes) 2024-09-21T22:17:10.502 INFO:teuthology.orchestra.run.smithi134.stdout:4030 read 0x4a90f36 thru 0x4a98274 (0x733f bytes) 2024-09-21T22:17:10.503 INFO:teuthology.orchestra.run.smithi134.stdout:4031 punch from 0x960a43a to 0x96169cb, (0xc591 bytes) 2024-09-21T22:17:10.503 INFO:teuthology.orchestra.run.smithi134.stdout:4032 clone 22 order 25 su 262144 sc 2 2024-09-21T22:17:10.553 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:10.551+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:10.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:10.655 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:10.653+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:10.750 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:10.750 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:10.750 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:10.750 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:10.750 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:10.755 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:10.754+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:10.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:10.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:10.855+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.77279661, 2024-09-21T22:17:10.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:17:10.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.743736788999996, 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.912 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:10.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:17:10.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:17:10.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:17:10.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.543523042999993, 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:17:10.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:17:10.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:10.923 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.392284227000005, 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.928 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.989341924000001, 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.929 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:17:10.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:17:10.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:17:10.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:17:10.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:17:10.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.937 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.989279069000006, 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:17:10.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:17:10.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:17:10.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:10.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515775090999995, 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.944 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:17:10.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:17:10.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515752836999994, 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.949 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:17:10.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:17:10.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515728422999999, 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:17:10.953 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:17:10.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:17:10.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515698958000002, 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:17:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:17:10.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515671814000001, 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.962 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:10.966 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515652712000005, 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:10.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:17:10.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515628559999996, 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:17:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:10.975 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515604781999997, 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:10.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:17:10.979 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515585806999994, 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:17:10.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:17:10.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:10.984 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515567056999998, 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:17:10.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:17:10.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515534974000005, 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:17:10.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:10.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515521987, 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.993 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:17:10.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.515511738000001, 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:10.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:17:10.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:17:11.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97073 3.d 3:b30a3fcc:::rbd_data.11859a4b084.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.978952377999999, 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011897978999999999, 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97073 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:11.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924748+0000", 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.147e-06 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928499+0000", 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514219999999999 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928513+0000", 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4032000000000001e-05 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928520+0000", 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3409999999999997e-06 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928582+0000", 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1748000000000006e-05 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928728+0000", 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000145523 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928881+0000", 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015284599999999999 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.932050+0000", 2024-09-21T22:17:11.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031697330000000001 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936518+0000", 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044676120000000001 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936587+0000", 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8783999999999997e-05 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936644+0000", 2024-09-21T22:17:11.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7791000000000003e-05 2024-09-21T22:17:11.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.008 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:11.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:11.010 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:11.008+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:11.086 INFO:teuthology.orchestra.run.smithi134.stderr:set 3.11 pg_upmap mapping to [1,7] 2024-09-21T22:17:11.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:17:11.110 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:11.108+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:11.163 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:11.163 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:11.163 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:11.163 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:11.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:11.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:11.209+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:11.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:11.310+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:11.314 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:11.314 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:11.314 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:11.314 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:11.314 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:11.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:11.412 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:11.411+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:11.428 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:11.428 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:11.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:11.428 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:11.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026658411, 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:17:11.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.432 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026612792000002, 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.433 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026540058999998, 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.437 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:11.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:17:11.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:11.441 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026493182000003, 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:11.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:17:11.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026428441999997, 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:17:11.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:17:11.449 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026392213000001, 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:17:11.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:17:11.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:17:11.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:17:11.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026298285999999, 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:17:11.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026274518000001, 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026209647000002, 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.462 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:11.466 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026172023999997, 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:17:11.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026131231000001, 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.471 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:11.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:17:11.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:17:11.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.026055769999999, 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.475 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:17:11.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:17:11.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025985396999999, 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:17:11.479 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.483 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025951722000002, 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:11.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025882969999998, 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:17:11.491 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025838573999998, 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.492 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:17:11.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025747625999998, 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025719101999996, 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:17:11.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025686808000003, 2024-09-21T22:17:11.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:11.508 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.025648674999999, 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:17:11.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:17:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:11.512 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:11.513 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:11.514 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:11.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:11.513+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:11.615 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:11.614+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:11.618 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:11.618 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:11.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:11.716 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:11.715+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:11.770 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:11.770 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:11.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:11.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:11.819+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:17:11.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:11.916+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:11.954 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.039669974999995, 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:17:11.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:17:11.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.037047901999998, 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.961 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:17:11.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.751511207999997, 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:11.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:11.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:17:11.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.751488093999995, 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:17:11.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:17:11.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:17:11.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:17:11.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.750813906999994, 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:17:11.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:17:11.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:11.979 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.730368652999999, 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.730353543999996, 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.984 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:11.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:17:11.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:17:11.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.730335249999996, 2024-09-21T22:17:11.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:17:11.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:17:11.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.729678515000003, 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.749195217999997, 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:11.997 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:17:11.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:17:12.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.281735300000001, 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:17:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:17:12.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:17:12.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:12.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:12.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.582005268000003, 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:17:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.581958743000001, 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:17:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:17:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:17:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:17:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:97229 3.b 3:d168bffe:::rbd_data.11859a4b084.0000000000000007:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.989840696000002, 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018200561000000001, 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 97229 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960015+0000", 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2400000000000002e-06 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960890+0000", 2024-09-21T22:17:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087496899999999996 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960913+0000", 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2918e-05 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960932+0000", 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8484000000000001e-05 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961011+0000", 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9240999999999996e-05 2024-09-21T22:17:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961165+0000", 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154036 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961308+0000", 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014330699999999999 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977902+0000", 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016593469 2024-09-21T22:17:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978092+0000", 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019035600000000001 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978169+0000", 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6588000000000006e-05 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978214+0000", 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4953000000000001e-05 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97171 3.c e86/45 3:30c3e70a:::rbd_data.11859a4b084.0000000000000005:head v 86'91, mlcod=84'89)", 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.988505193999998, 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017387495999999999, 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961350+0000", 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.47e-07 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966000+0000", 2024-09-21T22:17:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046502469999999997 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966013+0000", 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.343e-05 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966021+0000", 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5650000000000004e-06 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966094+0000", 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2758999999999999e-05 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966119+0000", 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5287999999999999e-05 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978684+0000", 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012564745 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978736+0000", 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2614999999999997e-05 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101043 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.826519533999999, 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018053537000000001, 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101043 2024-09-21T22:17:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123335+0000", 2024-09-21T22:17:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123340+0000", 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6700000000000002e-06 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123353+0000", 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2779000000000001e-05 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123360+0000", 2024-09-21T22:17:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3499999999999999e-06 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126073+0000", 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027131360000000001 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126157+0000", 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3319000000000006e-05 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126924+0000", 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000767303 2024-09-21T22:17:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136269+0000", 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093453049999999999 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141278+0000", 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050086949999999996 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141336+0000", 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7901e-05 2024-09-21T22:17:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141388+0000", 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2135999999999997e-05 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101044 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.825287063000001, 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017384295000000001, 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101044 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124568+0000", 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0599999999999999e-07 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124573+0000", 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0329999999999999e-06 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124584+0000", 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1569999999999999e-05 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124595+0000", 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0471e-05 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127509+0000", 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002914374 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127599+0000", 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9827000000000006e-05 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127978+0000", 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037899500000000003 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136277+0000", 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082993419999999995 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141448+0000", 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051706950000000003 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141521+0000", 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3114999999999994e-05 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141951+0000", 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043006700000000001 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101058 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.823921192, 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018654467000000001, 2024-09-21T22:17:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101058 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125934+0000", 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0400000000000005e-07 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125940+0000", 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125951+0000", 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1600000000000001e-05 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125958+0000", 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0910000000000004e-06 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129088+0000", 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003129452 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129173+0000", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4979000000000001e-05 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129877+0000", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070436399999999997 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137342+0000", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074651630000000004 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144517+0000", 2024-09-21T22:17:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071743989999999997 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144563+0000", 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6304000000000003e-05 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144587+0000", 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4158000000000001e-05 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101063 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.822722491, 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017538194999999999, 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101063 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127132+0000", 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0200000000000001e-07 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127136+0000", 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3000000000000003e-06 2024-09-21T22:17:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127145+0000", 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1950000000000003e-06 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127150+0000", 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4589999999999997e-06 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130331+0000", 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031804670000000002 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130404+0000", 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3003999999999994e-05 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130969+0000", 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056533799999999997 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137356+0000", 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063868520000000002 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144623+0000", 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072671100000000002 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144649+0000", 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5876000000000001e-05 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144670+0000", 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0891999999999999e-05 2024-09-21T22:17:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:115491 3.c 3:3744ba9d:::rbd_data.1185a576a45b.0000000000000184:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7853998310000003, 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017507090999999999, 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 115491 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164455+0000", 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2500000000000005e-07 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164459+0000", 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164470+0000", 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696999999999999e-05 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164475+0000", 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6339999999999998e-06 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164523+0000", 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7370999999999998e-05 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164575+0000", 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2265000000000002e-05 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.168121+0000", 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035460930000000002 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181840+0000", 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013718895 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181883+0000", 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2870000000000001e-05 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181923+0000", 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197000000000002e-05 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181961+0000", 2024-09-21T22:17:12.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8071000000000002e-05 2024-09-21T22:17:12.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:12.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:12.056 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:12.057 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:12.056+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:12.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:12.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:12.185 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:12.184+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:12.205 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:12.205 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:12.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:12.259 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:12.257+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:12.263 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:12.280 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:12.281 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:12.297 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:12.314 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:12.331 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:12.332 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:12.348 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:12.349 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:12.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:12.359+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:12.361 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:12.361 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:12.365 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:12.365 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:12.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:12.382 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:12.383 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:12.461 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:12.459+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:12.485 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:12.486 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:12.494 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:12.561 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:12.560+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:12.598 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:12.598 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:12.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:12.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:12.662+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:12.709 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:12.709 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:12.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:12.764 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:12.762+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:12.860 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:12.861 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:12.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:12.863+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:12.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:12.964 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:12.963+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:13.028 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.028 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:13.078 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:13.077+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:13.166 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:13.164+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:13.181 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.181 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:13.266 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:13.265+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:13.293 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.293 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.303 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:13.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:13.367+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:13.410 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.410 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:13.469 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:13.467+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:13.523 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.523 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.532 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:13.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:13.568+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:13.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:13.669+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:13.676 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.677 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:13.771 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:13.770+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:13.789 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.789 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:13.872 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:13.871+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:13.906 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:13.906 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:13.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:17:13.915 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:13.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:13.971+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:14.019 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:14.019 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:14.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:14.045 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-21T22:17:14.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:14.073+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:14.139 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:14.140 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:14.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:14.175 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:14.174+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:14.252 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:14.252 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:14.261 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:14.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:14.274+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:14.365 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:14.365 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:14.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:14.376 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:14.375+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:14.395 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:14.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:14.476+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:14.478 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:14.478 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:14.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:14.514 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:14.515 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:14.531 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:14.547 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:14.547 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:14.563 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:14.563 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:14.578 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:14.576+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:14.580 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:14.580 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:14.591 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:14.591 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:14.596 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:14.596 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:14.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:14.612 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:14.612 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:14.629 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:14.629 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:14.681 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:14.680+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:14.746 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344582416000002, 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.751 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344536797000004, 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:17:14.755 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344464064, 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.756 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:14.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:17:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344417186999998, 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.761 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:17:14.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:14.765 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344352446999999, 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.769 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344316218000003, 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:17:14.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:17:14.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:17:14.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344222291000001, 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.775 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:14.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344198523000003, 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.780 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344133651999996, 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.784 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:17:14.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:17:14.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.788 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344096028999999, 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.789 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.344055236000003, 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.794 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:14.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.798 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343979775000001, 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.799 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:17:14.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:14.803 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343909402000001, 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:14.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:14.808 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343875726999997, 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:14.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:14.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:17:14.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343806975, 2024-09-21T22:17:14.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:17:14.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343762579, 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:17:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:17:14.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.822 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343671630999999, 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:14.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:14.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:17:14.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343643106999998, 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:17:14.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:17:14.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:17:14.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343610812999998, 2024-09-21T22:17:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:17:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:17:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 39.343572680000001, 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:17:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:14.844 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:14.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:14.846 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:14.844+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:14.902 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:17:14.945 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:14.944+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:14.960 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:14.960 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:14.960 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:14.960 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:14.970 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:15.046 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:15.044+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:15.071 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.071 INFO:teuthology.orchestra.run.smithi134.stdout:4035 read 0x8014622 thru 0x801cdc2 (0x87a1 bytes) 2024-09-21T22:17:15.074 INFO:teuthology.orchestra.run.smithi134.stdout:4036 trunc from 0xd26905a to 0xedcce0a 2024-09-21T22:17:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:4037 writesame 0xe5f4da5 thru 0xe601684 data_size 0x10(0xc8e0 bytes) 2024-09-21T22:17:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:4038 read 0xd32e984 thru 0xd336e63 (0x84e0 bytes) 2024-09-21T22:17:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:4039 trunc from 0xedcce0a to 0xbc74beb 2024-09-21T22:17:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:4041 punch from 0x96a4409 to 0x96a9093, (0x4c8a bytes) 2024-09-21T22:17:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:4042 punch from 0x7132183 to 0x7132372, (0x1ef bytes) 2024-09-21T22:17:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:4043 write 0x34bf2bb thru 0x34cca98 (0xd7de bytes) 2024-09-21T22:17:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:4044 write 0x31c4017 thru 0x31c7d63 (0x3d4d bytes) 2024-09-21T22:17:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:4045 punch from 0xac60784 to 0xac64bd9, (0x4455 bytes) 2024-09-21T22:17:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:4046 punch from 0xaea1c23 to 0xaeac781, (0xab5e bytes) 2024-09-21T22:17:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:4047 read 0xdf0565 thru 0xdfd5b5 (0xd051 bytes) 2024-09-21T22:17:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:4050 trunc from 0xbc74beb to 0xae903dd 2024-09-21T22:17:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.120 INFO:teuthology.orchestra.run.smithi134.stdout:4053 trunc from 0xae903dd to 0x632dffa 2024-09-21T22:17:15.122 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:15.123 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:15.131 INFO:teuthology.orchestra.run.smithi134.stdout:4054 write 0x78b231 thru 0x795f5e (0xad2e bytes) 2024-09-21T22:17:15.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:15.135 INFO:teuthology.orchestra.run.smithi134.stdout:4056 trunc from 0x632dffa to 0x45ebea5 2024-09-21T22:17:15.141 INFO:teuthology.orchestra.run.smithi134.stdout:4058 read 0x20345a3 thru 0x2039a93 (0x54f1 bytes) 2024-09-21T22:17:15.141 INFO:teuthology.orchestra.run.smithi134.stdout:4059 punch from 0x40a6665 to 0x40b5a76, (0xf411 bytes) 2024-09-21T22:17:15.142 INFO:teuthology.orchestra.run.smithi134.stdout:4060 read 0x75d87f thru 0x7686b3 (0xae35 bytes) 2024-09-21T22:17:15.147 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:15.145+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:15.150 INFO:teuthology.orchestra.run.smithi134.stdout:4061 trunc from 0x45ebea5 to 0xa746e70 2024-09-21T22:17:15.155 INFO:teuthology.orchestra.run.smithi134.stdout:4062 punch from 0x7f7979d to 0x7f7d04e, (0x38b1 bytes) 2024-09-21T22:17:15.155 INFO:teuthology.orchestra.run.smithi134.stdout:4063 writesame 0x6c7fcaa thru 0x6c83c3b data_size 0x4f(0x3f92 bytes) 2024-09-21T22:17:15.157 INFO:teuthology.orchestra.run.smithi134.stdout:4065 trunc from 0xa746e70 to 0xb45aa91 2024-09-21T22:17:15.162 INFO:teuthology.orchestra.run.smithi134.stdout:4066 read 0x5fc8a11 thru 0x5fd35fa (0xabea bytes) 2024-09-21T22:17:15.163 INFO:teuthology.orchestra.run.smithi134.stdout:4067 read 0x17f61e3 thru 0x17f6b1e (0x93c bytes) 2024-09-21T22:17:15.163 INFO:teuthology.orchestra.run.smithi134.stdout:4068 punch from 0x991f073 to 0x992341b, (0x43a8 bytes) 2024-09-21T22:17:15.163 INFO:teuthology.orchestra.run.smithi134.stdout:4070 write 0x9b2ef8b thru 0x9b2fe75 (0xeeb bytes) 2024-09-21T22:17:15.166 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.166 INFO:teuthology.orchestra.run.smithi134.stdout:4072 punch from 0x12a75fd to 0x12ae7cf, (0x71d2 bytes) 2024-09-21T22:17:15.166 INFO:teuthology.orchestra.run.smithi134.stdout:4073 read 0x6fa1747 thru 0x6fa57ec (0x40a6 bytes) 2024-09-21T22:17:15.166 INFO:teuthology.orchestra.run.smithi134.stdout:4076 read 0xa6b65ac thru 0xa6bdf5c (0x79b1 bytes) 2024-09-21T22:17:15.166 INFO:teuthology.orchestra.run.smithi134.stdout:4077 write 0x5e61fb5 thru 0x5e6bee9 (0x9f35 bytes) 2024-09-21T22:17:15.168 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.168 INFO:teuthology.orchestra.run.smithi134.stdout:4079 writesame 0xd8147f thru 0xd86943 data_size 0x1(0x54c5 bytes) 2024-09-21T22:17:15.179 INFO:teuthology.orchestra.run.smithi134.stdout:4080 read 0x7788adf thru 0x7797561 (0xea83 bytes) 2024-09-21T22:17:15.179 INFO:teuthology.orchestra.run.smithi134.stdout:4081 writesame 0xa2b08ff thru 0xa2b2327 data_size 0x1(0x1a29 bytes) 2024-09-21T22:17:15.183 INFO:teuthology.orchestra.run.smithi134.stdout:4082 trunc from 0xb45aa91 to 0xb074875 2024-09-21T22:17:15.196 INFO:teuthology.orchestra.run.smithi134.stdout:4083 writesame 0xc127c52 thru 0xc133dcd data_size 0x74(0xc17c bytes) 2024-09-21T22:17:15.196 INFO:teuthology.orchestra.run.smithi134.stdout:4085 write 0x5cc9256 thru 0x5cca906 (0x16b1 bytes) 2024-09-21T22:17:15.197 INFO:teuthology.orchestra.run.smithi134.stdout:4086 read 0x95ebbe thru 0x9655f7 (0x6a3a bytes) 2024-09-21T22:17:15.198 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.198 INFO:teuthology.orchestra.run.smithi134.stdout:4089 read 0x9eba81f thru 0x9ebc661 (0x1e43 bytes) 2024-09-21T22:17:15.198 INFO:teuthology.orchestra.run.smithi134.stdout:4090 read 0xa91fb03 thru 0xa92b6c4 (0xbbc2 bytes) 2024-09-21T22:17:15.204 INFO:teuthology.orchestra.run.smithi134.stdout:4092 write 0xc4b171a thru 0xc4bb86c (0xa153 bytes) 2024-09-21T22:17:15.207 INFO:teuthology.orchestra.run.smithi134.stdout:4094 punch from 0x90c7d1b to 0x90c7f0c, (0x1f1 bytes) 2024-09-21T22:17:15.207 INFO:teuthology.orchestra.run.smithi134.stdout:4095 writesame 0xa7670c3 thru 0xa76ddd7 data_size 0x5(0x6d15 bytes) 2024-09-21T22:17:15.211 INFO:teuthology.orchestra.run.smithi134.stdout:4097 read 0xa30554c thru 0xa305d27 (0x7dc bytes) 2024-09-21T22:17:15.212 INFO:teuthology.orchestra.run.smithi134.stdout:4098 writesame 0xa271908 thru 0xa278cdd data_size 0x1(0x73d6 bytes) 2024-09-21T22:17:15.238 INFO:teuthology.orchestra.run.smithi134.stdout:4099 trunc from 0xc4bb86d to 0x275795d 2024-09-21T22:17:15.248 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:15.246+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:15.250 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:15.250 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.338247965999997, 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:17:15.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.256 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.335625893, 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:17:15.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:17:15.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:15.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.050089198999999, 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:17:15.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:17:15.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.050066084999997, 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:17:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:17:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14162 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:17:15.270 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.049391897999996, 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016005585999999999, 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14162 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199040+0000", 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199041+0000", 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199046+0000", 2024-09-21T22:17:15.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.87e-06 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199058+0000", 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2058999999999999e-05 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.199066+0000", 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214886+0000", 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015820955000000001 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214965+0000", 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8956999999999996e-05 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.215046+0000", 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0160999999999994e-05 2024-09-21T22:17:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.028946644000001, 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.028931534999998, 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.028913240999998, 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:17:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:17:15.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.028256506000005, 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:17:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:17:15.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.047773208999999, 2024-09-21T22:17:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:17:15.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:15.298 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.580313291000003, 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:17:15.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:15.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.880583258999998, 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:17:15.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.880536734000003, 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.311 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:17:15.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:97229 3.b 3:d168bffe:::rbd_data.11859a4b084.0000000000000007:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:15.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.288418687, 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018200561000000001, 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 97229 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960015+0000", 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2400000000000002e-06 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960890+0000", 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087496899999999996 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960913+0000", 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2918e-05 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960932+0000", 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8484000000000001e-05 2024-09-21T22:17:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961011+0000", 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9240999999999996e-05 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961165+0000", 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154036 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961308+0000", 2024-09-21T22:17:15.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014330699999999999 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977902+0000", 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016593469 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978092+0000", 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019035600000000001 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978169+0000", 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6588000000000006e-05 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978214+0000", 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4953000000000001e-05 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97171 3.c e86/45 3:30c3e70a:::rbd_data.11859a4b084.0000000000000005:head v 86'91, mlcod=84'89)", 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:15.322 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.287083185, 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017387495999999999, 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:15.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961350+0000", 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.47e-07 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966000+0000", 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046502469999999997 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966013+0000", 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.343e-05 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966021+0000", 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5650000000000004e-06 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966094+0000", 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2758999999999999e-05 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966119+0000", 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5287999999999999e-05 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978684+0000", 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012564745 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978736+0000", 2024-09-21T22:17:15.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2614999999999997e-05 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101043 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.125097525000001, 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018053537000000001, 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101043 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123335+0000", 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123340+0000", 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6700000000000002e-06 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123353+0000", 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2779000000000001e-05 2024-09-21T22:17:15.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123360+0000", 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3499999999999999e-06 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126073+0000", 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027131360000000001 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126157+0000", 2024-09-21T22:17:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3319000000000006e-05 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126924+0000", 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000767303 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136269+0000", 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093453049999999999 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141278+0000", 2024-09-21T22:17:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050086949999999996 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141336+0000", 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7901e-05 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141388+0000", 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2135999999999997e-05 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101044 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.123865053999999, 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017384295000000001, 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101044 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124568+0000", 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0599999999999999e-07 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124573+0000", 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0329999999999999e-06 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124584+0000", 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1569999999999999e-05 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124595+0000", 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0471e-05 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127509+0000", 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002914374 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127599+0000", 2024-09-21T22:17:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9827000000000006e-05 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127978+0000", 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037899500000000003 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136277+0000", 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082993419999999995 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141448+0000", 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051706950000000003 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141521+0000", 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3114999999999994e-05 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141951+0000", 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043006700000000001 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101058 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.122499182999999, 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018654467000000001, 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101058 2024-09-21T22:17:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125934+0000", 2024-09-21T22:17:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0400000000000005e-07 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125940+0000", 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125951+0000", 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1600000000000001e-05 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125958+0000", 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0910000000000004e-06 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129088+0000", 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003129452 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129173+0000", 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4979000000000001e-05 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129877+0000", 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070436399999999997 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137342+0000", 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074651630000000004 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144517+0000", 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071743989999999997 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144563+0000", 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6304000000000003e-05 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144587+0000", 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4158000000000001e-05 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101063 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.121300481999999, 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017538194999999999, 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101063 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127132+0000", 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0200000000000001e-07 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127136+0000", 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3000000000000003e-06 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127145+0000", 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1950000000000003e-06 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127150+0000", 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4589999999999997e-06 2024-09-21T22:17:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130331+0000", 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031804670000000002 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130404+0000", 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3003999999999994e-05 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130969+0000", 2024-09-21T22:17:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056533799999999997 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137356+0000", 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063868520000000002 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144623+0000", 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072671100000000002 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144649+0000", 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5876000000000001e-05 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144670+0000", 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0891999999999999e-05 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:115491 3.c 3:3744ba9d:::rbd_data.1185a576a45b.0000000000000184:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0839778219999996, 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017507090999999999, 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 115491 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164455+0000", 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2500000000000005e-07 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164459+0000", 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164470+0000", 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696999999999999e-05 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164475+0000", 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6339999999999998e-06 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164523+0000", 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7370999999999998e-05 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164575+0000", 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2265000000000002e-05 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.168121+0000", 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035460930000000002 2024-09-21T22:17:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181840+0000", 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013718895 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181883+0000", 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2870000000000001e-05 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181923+0000", 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197000000000002e-05 2024-09-21T22:17:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181961+0000", 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8071000000000002e-05 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.356 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:15.357 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.357 INFO:teuthology.orchestra.run.smithi134.stdout:4102 read 0x1a38669 thru 0x1a4680a (0xe1a2 bytes) 2024-09-21T22:17:15.357 INFO:teuthology.orchestra.run.smithi134.stdout:4103 write 0x28047d thru 0x2889cf (0x8553 bytes) 2024-09-21T22:17:15.357 INFO:teuthology.orchestra.run.smithi134.stdout:4104 read 0x16885f3 thru 0x16944da (0xbee8 bytes) 2024-09-21T22:17:15.358 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:15.361 INFO:teuthology.orchestra.run.smithi134.stdout:4105 write 0xbe690b4 thru 0xbe78b88 (0xfad5 bytes) 2024-09-21T22:17:15.361 INFO:teuthology.orchestra.run.smithi134.stdout:4106 read 0x54cc609 thru 0x54cd4f9 (0xef1 bytes) 2024-09-21T22:17:15.361 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4109 punch from 0x1ed4f8b to 0x1ee12c8, (0xc33d bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4112 read 0xb3a2079 thru 0xb3addd8 (0xbd60 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4113 read 0x1c6053e thru 0x1c61193 (0xc56 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4114 write 0x7745b24 thru 0x774ff73 (0xa450 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4115 writesame 0xd484b83 thru 0xd485f09 data_size 0x1(0x1387 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4118 trunc from 0xd485f0a to 0x2d3e50c 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4122 punch from 0x261efc3 to 0x2627137, (0x8174 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4125 write 0x8be609b thru 0x8bf580c (0xf772 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4131 writesame 0xb82095e thru 0xb82da94 data_size 0x21(0xd137 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4132 punch from 0x85895ac to 0x859272f, (0x9183 bytes) 2024-09-21T22:17:15.362 INFO:teuthology.orchestra.run.smithi134.stdout:4133 punch from 0x5e366cb to 0x5e465cd, (0xff02 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4134 write 0x67a6e59 thru 0x67a8b85 (0x1d2d bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4135 punch from 0x7771561 to 0x7777d67, (0x6806 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4136 writesame 0x9e8f574 thru 0x9e99188 data_size 0x13(0x9c15 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4137 write 0x9df1fe8 thru 0x9dff07c (0xd095 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4138 punch from 0x2ff2406 to 0x2ff28b7, (0x4b1 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4145 read 0x867f257 thru 0x86863cd (0x7177 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4146 writesame 0x4437d67 thru 0x44446f6 data_size 0x81(0xc990 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4147 read 0x812f6a thru 0x81570d (0x27a4 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4148 punch from 0xae7bc11 to 0xae7c965, (0xd54 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4149 punch from 0x944133 to 0x949ec8, (0x5d95 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4150 read 0x95a1617 thru 0x95b040a (0xedf4 bytes) 2024-09-21T22:17:15.363 INFO:teuthology.orchestra.run.smithi134.stdout:4153 read 0x2dc4ed6 thru 0x2dc50c1 (0x1ec bytes) 2024-09-21T22:17:15.364 INFO:teuthology.orchestra.run.smithi134.stdout:4154 punch from 0x8e131a6 to 0x8e20ef9, (0xdd53 bytes) 2024-09-21T22:17:15.364 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:15.364 INFO:teuthology.orchestra.run.smithi134.stdout:4158 write 0xb955441 thru 0xb955c7f (0x83f bytes) 2024-09-21T22:17:15.364 INFO:teuthology.orchestra.run.smithi134.stdout:4160 punch from 0x56bd6b2 to 0x56be4d4, (0xe22 bytes) 2024-09-21T22:17:15.364 INFO:teuthology.orchestra.run.smithi134.stdout:4161 read 0x2cc8d92 thru 0x2cd2464 (0x96d3 bytes) 2024-09-21T22:17:15.364 INFO:teuthology.orchestra.run.smithi134.stdout:4163 clone 23 order 21 su 262144 sc 13 2024-09-21T22:17:15.364 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:15.358+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:15.462 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:15.460+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:15.501 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:15.501 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:15.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:15.563 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:15.562+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:15.614 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:15.614 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:15.614 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:15.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:15.664 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:15.662+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:15.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:15.764+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:15.767 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:15.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:15.767 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62618 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2596864~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.468096150999997, 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046851039999999997, 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62618 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297855+0000", 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297861+0000", 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297869+0000", 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4229999999999999e-06 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344498+0000", 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046629275999999997 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344580+0000", 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.229e-05 2024-09-21T22:17:15.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344704+0000", 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012379399999999999 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62619 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2625536~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.468073220000001, 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047029327000000003, 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62619 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297878+0000", 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297884+0000", 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8420000000000001e-06 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297889+0000", 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0529999999999997e-06 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344750+0000", 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046860589000000001 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344799+0000", 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9259999999999999e-05 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344905+0000", 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106023 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62620 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2654208~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.468053574999999, 2024-09-21T22:17:15.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047262419999999999, 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62620 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297896+0000", 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297900+0000", 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-21T22:17:15.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297906+0000", 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0499999999999997e-06 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297911+0000", 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6070000000000001e-06 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344949+0000", 2024-09-21T22:17:15.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047038468999999999 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345037+0000", 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7664999999999995e-05 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345158+0000", 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121206 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62621 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2682880~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.468032600999997, 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047537283, 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62621 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297917+0000", 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297919+0000", 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297925+0000", 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1970000000000001e-06 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297930+0000", 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5619999999999997e-06 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345251+0000", 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047321410000000001 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345344+0000", 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3447000000000002e-05 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345454+0000", 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010932700000000001 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62622 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2711552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.468011070000003, 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047769796000000003, 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62622 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297941+0000", 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.137e-06 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297946+0000", 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297951+0000", 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345499+0000", 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047547865000000002 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345601+0000", 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101671 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345708+0000", 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107141 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62623 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2740224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467986861, 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047987992, 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62623 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:15.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297963+0000", 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297971+0000", 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9009999999999994e-06 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297977+0000", 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5590000000000002e-06 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297989+0000", 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.183e-05 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345742+0000", 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047753035999999999 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345846+0000", 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103859 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345950+0000", 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104388 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62624 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2768896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467952640999997, 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048201194000000003, 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62624 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297997+0000", 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297999+0000", 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2620000000000001e-06 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298005+0000", 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298011+0000", 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1789999999999999e-06 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345994+0000", 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983959 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346078+0000", 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3830000000000002e-05 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346198+0000", 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119311 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62625 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2797568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467719768000002, 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048206511, 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62625 2024-09-21T22:17:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298230+0000", 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298233+0000", 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.371e-06 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298240+0000", 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1790000000000002e-06 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298253+0000", 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2186e-05 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346236+0000", 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983499999999998 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346318+0000", 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2273000000000003e-05 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346436+0000", 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011741199999999999 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62626 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2826240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467685082999999, 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048414997000000001, 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62626 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298267+0000", 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4109999999999999e-06 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298278+0000", 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1399999999999999e-05 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298283+0000", 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1919999999999996e-06 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346477+0000", 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048193998000000002 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346529+0000", 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1561999999999999e-05 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346679+0000", 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149973 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62627 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2854912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467656480000002, 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048814124, 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62627 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298295+0000", 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298302+0000", 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3060000000000003e-06 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298306+0000", 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6820000000000002e-06 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346724+0000", 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048417610999999999 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346818+0000", 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3733000000000005e-05 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347107+0000", 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028912000000000002 2024-09-21T22:17:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62628 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467631578000002, 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048832672000000001, 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62628 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298318+0000", 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298320+0000", 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1239999999999999e-06 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298326+0000", 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8220000000000003e-06 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298331+0000", 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347139+0000", 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048808782000000002 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347150+0000", 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0672e-05 2024-09-21T22:17:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62629 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467612602999999, 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048848529000000002, 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62629 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298337+0000", 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298339+0000", 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298345+0000", 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298350+0000", 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347177+0000", 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048826889999999998 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347185+0000", 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62630 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467590495000003, 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048855136, 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62630 2024-09-21T22:17:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298361+0000", 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298367+0000", 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298372+0000", 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347206+0000", 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048834223000000003 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347214+0000", 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8639999999999996e-06 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62631 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467396035, 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048836962999999997, 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62631 2024-09-21T22:17:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298554+0000", 2024-09-21T22:17:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298557+0000", 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.145e-06 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298570+0000", 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2870999999999999e-05 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298575+0000", 2024-09-21T22:17:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7570000000000001e-06 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347379+0000", 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048803199999999998 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347390+0000", 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1415e-05 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62632 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467362586999997, 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048882087999999997, 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62632 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298587+0000", 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298590+0000", 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6129999999999998e-06 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298601+0000", 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1517e-05 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298606+0000", 2024-09-21T22:17:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8060000000000002e-06 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347417+0000", 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048811326000000002 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347469+0000", 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378999999999997e-05 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62633 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467334147999999, 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048891830999999997, 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62633 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298618+0000", 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298624+0000", 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999998e-06 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298634+0000", 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T22:17:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347498+0000", 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863908999999997 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347507+0000", 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8829999999999995e-06 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62634 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467308408000001, 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048897406999999997, 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62634 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298643+0000", 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-06 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298649+0000", 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298654+0000", 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.831e-06 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347530+0000", 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048875952 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347538+0000", 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8059999999999995e-06 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62635 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467289051999998, 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.04890684, 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62635 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298685+0000", 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4230999999999999e-05 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298691+0000", 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.562e-06 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298696+0000", 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347560+0000", 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863986999999998 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347567+0000", 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.579e-06 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62636 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467243130999996, 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048894625999999997, 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62636 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298709+0000", 2024-09-21T22:17:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298714+0000", 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298719+0000", 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347592+0000", 2024-09-21T22:17:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048872916000000002 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347601+0000", 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5879999999999998e-06 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62637 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.467219239999999, 2024-09-21T22:17:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048904669999999997, 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62637 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298732+0000", 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:17:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298738+0000", 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298745+0000", 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6710000000000002e-06 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347627+0000", 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048881775000000002 2024-09-21T22:17:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347634+0000", 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.926e-06 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:15.851 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:15.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:15.891+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:15.967 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:15.966+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:16.000 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:16.000 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:16.000 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:16.000 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:16.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:16.093 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:16.092+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:16.104 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:16.104 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:16.105 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-21T22:17:16.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-21T22:17:16.155 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:16.155 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:16.155 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:16.155 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:16.155 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:16.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:16.168 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:16.167+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:16.269 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:16.268+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:16.274 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:16.274 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:16.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:16.274 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.358050464000002, 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:17:16.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:17:16.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235308846999999, 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:17:16.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235299308000002, 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.288 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235290468000002, 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.289 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:17:16.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235281262000001, 2024-09-21T22:17:16.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:17:16.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:17:16.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235272287999997, 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.301 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235263383000003, 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.302 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235241643000002, 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:17:16.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:17:16.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235232218999997, 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.311 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:17:16.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:17:16.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:17:16.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235223320000003, 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:17:16.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:17:16.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.235214366999998, 2024-09-21T22:17:16.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.233719624000003, 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:17:16.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:17:16.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.233709507, 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:17:16.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:17:16.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.233700001999999, 2024-09-21T22:17:16.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:17:16.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:17:16.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.233686263000003, 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.340 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.233676953, 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.341 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.373665954000003, 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:17:16.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.370044532999998, 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:17:16.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:17:16.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:17:16.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:16.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.787573999000003, 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:16.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0689110590000004, 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:16.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:16.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:16.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:16.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:16.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:16.370 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:16.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:16.371 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:16.370+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:16.393 INFO:teuthology.orchestra.run.smithi134.stdout:moved 0 / 82 (0%) 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:avg 10.25 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:stddev 2.77263 -> 2.77263 (expected baseline 2.99479) 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:min osd.2 with 6 -> 6 pgs (0.585366 -> 0.585366 * mean) 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:max osd.0 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:oload 1000 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:max_change 0.05 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:max_change_osds 4 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:average_utilization 0.0011 2024-09-21T22:17:16.394 INFO:teuthology.orchestra.run.smithi134.stdout:overload_utilization 0.0108 2024-09-21T22:17:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:no change 2024-09-21T22:17:16.407 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-21T22:17:16.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-09-21T22:17:16.491 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:16.490+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:16.499 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:16.499 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:16.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:16.572 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:16.571+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:16.640 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:16.654 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:16.654 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:16.654 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:16.654 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:16.654 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:16.663 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:16.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:16.703+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout:moved 0 / 82 (0%) 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout:avg 10.25 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout:stddev 2.77263 -> 2.77263 (expected baseline 2.99479) 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout:min osd.2 with 6 -> 6 pgs (0.585366 -> 0.585366 * mean) 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout:max osd.0 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout:oload 1000 2024-09-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi134.stdout:max_change 1 2024-09-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi134.stdout:max_change_osds 4 2024-09-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi134.stdout:average_utilization 0.0011 2024-09-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi134.stdout:overload_utilization 0.0108 2024-09-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi134.stderr:no change 2024-09-21T22:17:16.749 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-21T22:17:16.749 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-09-21T22:17:16.774 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:16.772+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:16.777 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:16.794 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:16.794 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:16.812 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:16.812 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:16.822 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:16.822 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:16.828 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:16.828 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:16.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:16.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:16.845 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:16.862 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:16.863 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:16.875 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:16.874+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:16.880 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:16.880 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:16.904 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:16.905 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:16.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:17:16.969 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:16.969 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:16.975 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:16.974+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:16.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:17.076 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:17.075+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:17.126 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:17.126 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:17.130 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:17:17.129+0000 7f0b56a06640 -1 mgr.server reply reply (3) No such process no change 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:moved 10 / 82 (12.1951%) 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:avg 10.25 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:stddev 2.77263 -> 3.11247 (expected baseline 2.99479) 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:min osd.2 with 6 -> 7 pgs (0.585366 -> 0.682927 * mean) 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:max osd.0 with 14 -> 6 pgs (1.36585 -> 0.585366 * mean) 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:oload 110 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:max_change 3 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:max_change_osds 4 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:average_utilization 0.0011 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:overload_utilization 0.0012 2024-09-21T22:17:17.131 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 weight 1.0000 -> 0.6971 2024-09-21T22:17:17.132 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 weight 1.0000 -> 0.7243 2024-09-21T22:17:17.132 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 weight 1.0000 -> 0.8386 2024-09-21T22:17:17.132 INFO:teuthology.orchestra.run.smithi134.stderr:no change 2024-09-21T22:17:17.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:17.144 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-21T22:17:17.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-21T22:17:17.179 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:17.177+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:17.239 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:17.239 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:17.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:17.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:17.277+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:17.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:17.378+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:17.391 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:17.391 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:17.400 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:17.460 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:17:17.459+0000 7f0b56a06640 -1 mgr.server reply reply (3) No such process no change 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:moved 2 / 82 (2.43902%) 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:avg 10.25 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:stddev 2.77263 -> 2.72718 (expected baseline 2.99479) 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:min osd.2 with 6 -> 6 pgs (0.585366 -> 0.585366 * mean) 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:max osd.0 with 14 -> 13 pgs (1.36585 -> 1.26829 * mean) 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:oload 110 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:max_change 0.05 2024-09-21T22:17:17.461 INFO:teuthology.orchestra.run.smithi134.stdout:max_change_osds 4 2024-09-21T22:17:17.462 INFO:teuthology.orchestra.run.smithi134.stdout:average_utilization 0.0011 2024-09-21T22:17:17.462 INFO:teuthology.orchestra.run.smithi134.stdout:overload_utilization 0.0012 2024-09-21T22:17:17.462 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 weight 1.0000 -> 0.9500 2024-09-21T22:17:17.462 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 weight 1.0000 -> 0.9500 2024-09-21T22:17:17.462 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 weight 1.0000 -> 0.9500 2024-09-21T22:17:17.462 INFO:teuthology.orchestra.run.smithi134.stderr:no change 2024-09-21T22:17:17.473 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-21T22:17:17.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-21T22:17:17.479 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:17.477+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:17.503 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:17.504 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:17.513 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:17.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:17.579+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:17.657 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:17.657 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:17.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:17.709 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:17.708+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:17.769 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:17.769 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:17.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:17.790 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-21T22:17:17.789+0000 7f0b56a06640 -1 mgr.server reply reply (3) No such process no change 2024-09-21T22:17:17.790 INFO:teuthology.orchestra.run.smithi134.stdout:moved 10 / 82 (12.1951%) 2024-09-21T22:17:17.790 INFO:teuthology.orchestra.run.smithi134.stdout:avg 10.25 2024-09-21T22:17:17.790 INFO:teuthology.orchestra.run.smithi134.stdout:stddev 2.77263 -> 3.11247 (expected baseline 2.99479) 2024-09-21T22:17:17.790 INFO:teuthology.orchestra.run.smithi134.stdout:min osd.2 with 6 -> 7 pgs (0.585366 -> 0.682927 * mean) 2024-09-21T22:17:17.790 INFO:teuthology.orchestra.run.smithi134.stdout:max osd.0 with 14 -> 6 pgs (1.36585 -> 0.585366 * mean) 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:oload 110 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:max_change 1 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:max_change_osds 4 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:average_utilization 0.0011 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:overload_utilization 0.0012 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 weight 1.0000 -> 0.6971 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 weight 1.0000 -> 0.7243 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 weight 1.0000 -> 0.8386 2024-09-21T22:17:17.791 INFO:teuthology.orchestra.run.smithi134.stderr:no change 2024-09-21T22:17:17.819 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:17.817+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:17.883 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:17.882+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:17.906 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:17.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:17.984 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:17.983+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:18.037 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-21T22:17:18.038 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:18.038 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:18.048 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:18.093 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:18.090+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:18.160 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:18.160 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:18.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:18.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:18.185+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:18.287 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:18.287 INFO:teuthology.orchestra.run.smithi134.stdout:4167 punch from 0xaddc5c9 to 0xade6d26, (0xa75d bytes) 2024-09-21T22:17:18.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:18.286+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:18.302 INFO:teuthology.orchestra.run.smithi134.stdout:4168 trunc from 0xb955c80 to 0x1f335ce 2024-09-21T22:17:18.319 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:18.319 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:18.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:18.342 INFO:teuthology.orchestra.run.smithi134.stdout:4169 read 0x14851b1 thru 0x1490f29 (0xbd79 bytes) 2024-09-21T22:17:18.342 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:18.342 INFO:teuthology.orchestra.run.smithi134.stdout:4171 writesame 0x262cae thru 0x2701d6 data_size 0x1(0xd529 bytes) 2024-09-21T22:17:18.368 INFO:teuthology.orchestra.run.smithi134.stdout:4174 read 0x1b8517f thru 0x1b924e8 (0xd36a bytes) 2024-09-21T22:17:18.368 INFO:teuthology.orchestra.run.smithi134.stdout:4175 punch from 0x18b4b53 to 0x18c48d5, (0xfd82 bytes) 2024-09-21T22:17:18.384 INFO:teuthology.orchestra.run.smithi134.stdout:4176 write 0xa738f15 thru 0xa73ccb4 (0x3da0 bytes) 2024-09-21T22:17:18.387 INFO:teuthology.orchestra.run.smithi134.stdout:4179 read 0x1b5ebd7 thru 0x1b6334c (0x4776 bytes) 2024-09-21T22:17:18.388 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:18.386+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:18.395 INFO:teuthology.orchestra.run.smithi134.stdout:4180 trunc from 0xa73ccb5 to 0x3ecf467 2024-09-21T22:17:18.406 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:18.415 INFO:teuthology.orchestra.run.smithi134.stdout:4182 write 0x76d2ce8 thru 0x76da705 (0x7a1e bytes) 2024-09-21T22:17:18.418 INFO:teuthology.orchestra.run.smithi134.stdout:4183 write 0x42c3e18 thru 0x42cb4a0 (0x7689 bytes) 2024-09-21T22:17:18.421 INFO:teuthology.orchestra.run.smithi134.stdout:4184 read 0x6cada5a thru 0x6cb3411 (0x59b8 bytes) 2024-09-21T22:17:18.427 INFO:teuthology.orchestra.run.smithi134.stdout:4186 write 0x7e9b203 thru 0x7ea12e3 (0x60e1 bytes) 2024-09-21T22:17:18.430 INFO:teuthology.orchestra.run.smithi134.stdout:4187 read 0x23b663 thru 0x24921a (0xdbb8 bytes) 2024-09-21T22:17:18.431 INFO:teuthology.orchestra.run.smithi134.stdout:4188 punch from 0x2d74702 to 0x2d78932, (0x4230 bytes) 2024-09-21T22:17:18.431 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:18.431 INFO:teuthology.orchestra.run.smithi134.stdout:4191 punch from 0x5f20f6d to 0x5f23549, (0x25dc bytes) 2024-09-21T22:17:18.431 INFO:teuthology.orchestra.run.smithi134.stdout:4193 read 0x8d7f2d thru 0x8e0009 (0x80dd bytes) 2024-09-21T22:17:18.439 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:18.439 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:18.441 INFO:teuthology.orchestra.run.smithi134.stdout:4194 write 0xc09a89d thru 0xc0a877d (0xdee1 bytes) 2024-09-21T22:17:18.444 INFO:teuthology.orchestra.run.smithi134.stdout:4196 writesame 0x514d477 thru 0x515c189 data_size 0x1(0xed13 bytes) 2024-09-21T22:17:18.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:18.477 INFO:teuthology.orchestra.run.smithi134.stdout:4198 read 0xf36658 thru 0xf383c5 (0x1d6e bytes) 2024-09-21T22:17:18.477 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:18.477 INFO:teuthology.orchestra.run.smithi134.stdout:4200 punch from 0x6447412 to 0x644c291, (0x4e7f bytes) 2024-09-21T22:17:18.488 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:18.487+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:18.491 INFO:teuthology.orchestra.run.smithi134.stdout:4203 trunc from 0xc0a877e to 0x84e2f7 2024-09-21T22:17:18.507 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:18.507 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:18.518 INFO:teuthology.orchestra.run.smithi134.stdout:4206 write 0x528dfc1 thru 0x528f847 (0x1887 bytes) 2024-09-21T22:17:18.521 INFO:teuthology.orchestra.run.smithi134.stdout:4207 write 0x23036ac thru 0x230d26e (0x9bc3 bytes) 2024-09-21T22:17:18.524 INFO:teuthology.orchestra.run.smithi134.stdout:4208 punch from 0x273ee37 to 0x2749b78, (0xad41 bytes) 2024-09-21T22:17:18.524 INFO:teuthology.orchestra.run.smithi134.stdout:4209 read 0x5e5866 thru 0x5e8768 (0x2f03 bytes) 2024-09-21T22:17:18.524 INFO:teuthology.orchestra.run.smithi134.stdout:4212 read 0x3cd3253 thru 0x3cdf825 (0xc5d3 bytes) 2024-09-21T22:17:18.524 INFO:teuthology.orchestra.run.smithi134.stdout:4213 writesame 0x3a98bf2 thru 0x3aa39b6 data_size 0x9b(0xadc5 bytes) 2024-09-21T22:17:18.539 INFO:teuthology.orchestra.run.smithi134.stdout:4214 writesame 0xa9080fb thru 0xa90b98f data_size 0x1(0x3895 bytes) 2024-09-21T22:17:18.539 INFO:teuthology.orchestra.run.smithi134.stdout:4217 read 0xe05f35 thru 0xe09618 (0x36e4 bytes) 2024-09-21T22:17:18.539 INFO:teuthology.orchestra.run.smithi134.stdout:4218 writesame 0x832fb1 thru 0x840560 data_size 0x34(0xd5b0 bytes) 2024-09-21T22:17:18.552 INFO:teuthology.orchestra.run.smithi134.stdout:4219 trunc from 0xa90b990 to 0x1ae5f45 2024-09-21T22:17:18.570 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:18.570 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:18.584 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi134.stdout:4220 writesame 0xd61831f thru 0xd61b78e data_size 0x8(0x3470 bytes) 2024-09-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi134.stdout:4222 writesame 0xa43def0 thru 0xa44004c data_size 0x27(0x215d bytes) 2024-09-21T22:17:18.588 INFO:teuthology.orchestra.run.smithi134.stdout:4223 punch from 0x7ecdcaa to 0x7ed9298, (0xb5ee bytes) 2024-09-21T22:17:18.589 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:18.587+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:18.600 INFO:teuthology.orchestra.run.smithi134.stdout:4224 trunc from 0xd61b78f to 0x408ad52 2024-09-21T22:17:18.619 INFO:teuthology.orchestra.run.smithi134.stdout:4225 writesame 0x7f1ec83 thru 0x7f2e8c1 data_size 0x69(0xfc3f bytes) 2024-09-21T22:17:18.620 INFO:teuthology.orchestra.run.smithi134.stdout:4227 read 0x5f52532 thru 0x5f5841d (0x5eec bytes) 2024-09-21T22:17:18.620 INFO:teuthology.orchestra.run.smithi134.stdout:4228 read 0x7c8c53a thru 0x7c90a10 (0x44d7 bytes) 2024-09-21T22:17:18.629 INFO:teuthology.orchestra.run.smithi134.stdout:4229 write 0xc3760f2 thru 0xc385c92 (0xfba1 bytes) 2024-09-21T22:17:18.639 INFO:teuthology.orchestra.run.smithi134.stdout:4232 write 0xcc86f05 thru 0xcc8cf51 (0x604d bytes) 2024-09-21T22:17:18.642 INFO:teuthology.orchestra.run.smithi134.stdout:4233 writesame 0x5d925f4 thru 0x5d98c66 data_size 0x1(0x6673 bytes) 2024-09-21T22:17:18.656 INFO:teuthology.orchestra.run.smithi134.stdout:4234 write 0xb41aa0b thru 0xb424aa5 (0xa09b bytes) 2024-09-21T22:17:18.660 INFO:teuthology.orchestra.run.smithi134.stdout:4237 read 0xc2285a6 thru 0xc22b88e (0x32e9 bytes) 2024-09-21T22:17:18.660 INFO:teuthology.orchestra.run.smithi134.stdout:4238 punch from 0x3c6edef to 0x3c785bd, (0x97ce bytes) 2024-09-21T22:17:18.660 INFO:teuthology.orchestra.run.smithi134.stdout:4239 read 0x83e8cd0 thru 0x83ecaa6 (0x3dd7 bytes) 2024-09-21T22:17:18.660 INFO:teuthology.orchestra.run.smithi134.stdout:4240 writesame 0x9a7637c thru 0x9a7a167 data_size 0x6(0x3dec bytes) 2024-09-21T22:17:18.663 INFO:teuthology.orchestra.run.smithi134.stdout:4241 clone 24 order 22 su 524288 sc 2 2024-09-21T22:17:18.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:18.689+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:18.695 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:18.695 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:18.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:18.791 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:18.790+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:18.848 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:18.848 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:18.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:18.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:18.897+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:18.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:18.994 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:18.993+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:19.008 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:19.008 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:19.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:19.061 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:19.062 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:19.078 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:19.079 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:19.095 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:19.095 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:19.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:19.094+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:19.111 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:19.128 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:19.128 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:19.144 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:19.145 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:19.161 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:19.163 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:19.163 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:19.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:19.178 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:19.178 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:19.196 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:19.195+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:19.282 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:19.282 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:19.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:19.282 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:19.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62618 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2596864~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982610043999998, 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046851039999999997, 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62618 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.283 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:19.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297855+0000", 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297861+0000", 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297869+0000", 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4229999999999999e-06 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344498+0000", 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046629275999999997 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344580+0000", 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.229e-05 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344704+0000", 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012379399999999999 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62619 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2625536~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982587113000001, 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047029327000000003, 2024-09-21T22:17:19.287 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62619 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297878+0000", 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:17:19.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297884+0000", 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8420000000000001e-06 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297889+0000", 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0529999999999997e-06 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344750+0000", 2024-09-21T22:17:19.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046860589000000001 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344799+0000", 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9259999999999999e-05 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344905+0000", 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106023 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62620 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2654208~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982567467999999, 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047262419999999999, 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62620 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297896+0000", 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:19.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297900+0000", 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297906+0000", 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0499999999999997e-06 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297911+0000", 2024-09-21T22:17:19.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6070000000000001e-06 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344949+0000", 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047038468999999999 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345037+0000", 2024-09-21T22:17:19.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7664999999999995e-05 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345158+0000", 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121206 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62621 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2682880~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982546493999997, 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047537283, 2024-09-21T22:17:19.296 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62621 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297917+0000", 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297919+0000", 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297925+0000", 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1970000000000001e-06 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297930+0000", 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5619999999999997e-06 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345251+0000", 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047321410000000001 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345344+0000", 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3447000000000002e-05 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345454+0000", 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010932700000000001 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62622 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2711552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982524963000003, 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047769796000000003, 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62622 2024-09-21T22:17:19.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297941+0000", 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.137e-06 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297946+0000", 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297951+0000", 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345499+0000", 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047547865000000002 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345601+0000", 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101671 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345708+0000", 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107141 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62623 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2740224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982500754, 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047987992, 2024-09-21T22:17:19.305 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62623 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297963+0000", 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297971+0000", 2024-09-21T22:17:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9009999999999994e-06 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297977+0000", 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5590000000000002e-06 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297989+0000", 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.183e-05 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345742+0000", 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047753035999999999 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345846+0000", 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103859 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345950+0000", 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104388 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62624 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2768896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982466533999997, 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048201194000000003, 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.310 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62624 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297997+0000", 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297999+0000", 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2620000000000001e-06 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298005+0000", 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298011+0000", 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1789999999999999e-06 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345994+0000", 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983959 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346078+0000", 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3830000000000002e-05 2024-09-21T22:17:19.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346198+0000", 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119311 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62625 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2797568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982233661000002, 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048206511, 2024-09-21T22:17:19.314 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62625 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298230+0000", 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298233+0000", 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.371e-06 2024-09-21T22:17:19.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298240+0000", 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1790000000000002e-06 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298253+0000", 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2186e-05 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346236+0000", 2024-09-21T22:17:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983499999999998 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346318+0000", 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2273000000000003e-05 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346436+0000", 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011741199999999999 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62626 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2826240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982198975999999, 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048414997000000001, 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62626 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.319 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:19.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298267+0000", 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4109999999999999e-06 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298278+0000", 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1399999999999999e-05 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298283+0000", 2024-09-21T22:17:19.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1919999999999996e-06 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346477+0000", 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048193998000000002 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346529+0000", 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1561999999999999e-05 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346679+0000", 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149973 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62627 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2854912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982170373000002, 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048814124, 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62627 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:19.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298295+0000", 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298302+0000", 2024-09-21T22:17:19.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3060000000000003e-06 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298306+0000", 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6820000000000002e-06 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346724+0000", 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048417610999999999 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346818+0000", 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3733000000000005e-05 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347107+0000", 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028912000000000002 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62628 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982145471000003, 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048832672000000001, 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62628 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298318+0000", 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298320+0000", 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1239999999999999e-06 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298326+0000", 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8220000000000003e-06 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298331+0000", 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347139+0000", 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048808782000000002 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347150+0000", 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0672e-05 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62629 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.331 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982126495999999, 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048848529000000002, 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62629 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298337+0000", 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298339+0000", 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298345+0000", 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298350+0000", 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:19.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347177+0000", 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048826889999999998 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347185+0000", 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62630 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.982104388000003, 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048855136, 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62630 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:17:19.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298361+0000", 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298367+0000", 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298372+0000", 2024-09-21T22:17:19.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347206+0000", 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048834223000000003 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347214+0000", 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8639999999999996e-06 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62631 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.981909928, 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048836962999999997, 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62631 2024-09-21T22:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298554+0000", 2024-09-21T22:17:19.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298557+0000", 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.145e-06 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298570+0000", 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2870999999999999e-05 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298575+0000", 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7570000000000001e-06 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347379+0000", 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048803199999999998 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347390+0000", 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1415e-05 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62632 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.981876479999997, 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048882087999999997, 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62632 2024-09-21T22:17:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298587+0000", 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298590+0000", 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6129999999999998e-06 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298601+0000", 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1517e-05 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298606+0000", 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8060000000000002e-06 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347417+0000", 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048811326000000002 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347469+0000", 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378999999999997e-05 2024-09-21T22:17:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62633 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.981848040999999, 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048891830999999997, 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62633 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298618+0000", 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298624+0000", 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999998e-06 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298634+0000", 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347498+0000", 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863908999999997 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347507+0000", 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8829999999999995e-06 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62634 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.981822301000001, 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048897406999999997, 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62634 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298643+0000", 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-06 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298649+0000", 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298654+0000", 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.831e-06 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347530+0000", 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048875952 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347538+0000", 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8059999999999995e-06 2024-09-21T22:17:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62635 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.981802944999998, 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.04890684, 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62635 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298685+0000", 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4230999999999999e-05 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298691+0000", 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.562e-06 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298696+0000", 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347560+0000", 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863986999999998 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347567+0000", 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.579e-06 2024-09-21T22:17:19.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62636 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.981757023999997, 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048894625999999997, 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62636 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298709+0000", 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298714+0000", 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:17:19.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298719+0000", 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347592+0000", 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048872916000000002 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347601+0000", 2024-09-21T22:17:19.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5879999999999998e-06 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62637 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.981733132999999, 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048904669999999997, 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62637 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298732+0000", 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:17:19.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298738+0000", 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298745+0000", 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6710000000000002e-06 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347627+0000", 2024-09-21T22:17:19.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048881775000000002 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347634+0000", 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.926e-06 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.368 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:19.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:19.370 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:19.368+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:19.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:19.469+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:19.514 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:19.514 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:19.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:19.571 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:19.570+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:19.665 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:19.666 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:19.672 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:19.671+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:19.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:19.772 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:19.771+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:19.778 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861963911000004, 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:17:19.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:17:19.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739222294000001, 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739212754999997, 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:17:19.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739203914999997, 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:19.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:17:19.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739194709000003, 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:17:19.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739185735, 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:17:19.802 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:17:19.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739176829999998, 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:17:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739155089999997, 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:17:19.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739145665999999, 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.816 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:17:19.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739136766999998, 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:17:19.820 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:17:19.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:17:19.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.739127814, 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.825 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:19.829 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.737633070999998, 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:17:19.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:17:19.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.737622954000003, 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:17:19.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:17:19.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.737613449000001, 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:17:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:17:19.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.737599709999998, 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:17:19.843 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:17:19.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:17:19.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.737590400000002, 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.848 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:17:19.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:17:19.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.877579400999998, 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:17:19.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:17:19.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.87395798, 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:17:19.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:17:19.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:17:19.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:17:19.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.291487445999998, 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:17:19.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:19.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.872 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5728245059999999, 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:17:19.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:19.877 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:19.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:19.879 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:19.878+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:19.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:17:20.007 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:20.006+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:20.044 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:20.044 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:20.044 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:20.045 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:20.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:20.081 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:20.079+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:20.181 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:20.180+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:20.198 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:20.198 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:20.198 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:20.198 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:20.199 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:20.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:20.283 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:20.282+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.809221524999998, 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.794038065999999, 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.782591628000006, 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.232504399999996, 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:17:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:17:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:17:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.177416636999993, 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:17:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:17:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.906323947999994, 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:17:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.901417374000005, 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.898206775000006, 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:17:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.893185078000002, 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.891197746000003, 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.350 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:17:20.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.367344154999998, 2024-09-21T22:17:20.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:40247 3.0 e71/23 3:0688b99e:::rbd_data.118542b14bcd.0000000000000281:head v 71'358, mlcod=71'356)", 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.076134940999999, 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039211389999999997, 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:20.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234378+0000", 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9500000000000001e-07 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234387+0000", 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2599999999999994e-06 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234398+0000", 2024-09-21T22:17:20.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234405+0000", 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234460+0000", 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4975999999999997e-05 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234482+0000", 2024-09-21T22:17:20.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1407e-05 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238263+0000", 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037812039999999998 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238298+0000", 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5419000000000001e-05 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.362 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.324182544000003, 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:20.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.322681803000002, 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:17:20.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:17:20.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97072 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'409, mlcod=84'406)", 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.387734037000001, 2024-09-21T22:17:20.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039520709999999997, 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922780+0000", 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3740000000000001e-06 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922789+0000", 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922808+0000", 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8481000000000001e-05 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922822+0000", 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922885+0000", 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3336000000000005e-05 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922910+0000", 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5072999999999999e-05 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926670+0000", 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003760191 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926730+0000", 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0126e-05 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:17:20.375 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.342994814999997, 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:20.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:17:20.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.338110739000001, 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.337323042000001, 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:17:20.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.330315599999999, 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.35439093599999999, 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:20.392 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:17:20.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:17:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:17:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:20.396 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:20.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:20.398 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:20.396+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:20.498 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:20.497+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:20.507 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:20.507 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:20.507 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:20.507 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:20.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:20.600 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:20.598+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:20.660 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:20.661 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:20.661 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:20.661 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:20.661 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:20.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:20.713 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:20.711+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:20.775 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.208573900999994, 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:17:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.208476438999995, 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.208421383000001, 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:17:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.208379377, 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:17:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:17:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.208318778999995, 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:17:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:17:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.208296586000003, 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:17:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:17:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.251957047000005, 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:17:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.812 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.248817805000002, 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:17:20.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 85.155804180000004, 2024-09-21T22:17:20.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:17:20.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:17:20.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:17:20.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 84.199938888000005, 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.825 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:17:20.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:20.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:17:20.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.831 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.094100338000004, 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.832 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.838 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.093083762999996, 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:17:20.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:17:20.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:17:20.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:17:20.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.092715996999999, 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:17:20.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.574373698000002, 2024-09-21T22:17:20.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:17:20.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:17:20.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 65.572497816999999, 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:17:20.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.302755521999998, 2024-09-21T22:17:20.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:17:20.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:17:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:17:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.18698569, 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:17:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:17:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.80917247, 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:17:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:17:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.883 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.956846678000002, 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:17:20.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:17:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.890 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 18.681310063000002, 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:20.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:20.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:20.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:20.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:20.897 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:20.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:20.899 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:20.897+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:20.928 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:17:21.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:20.999+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:21.043 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:21.043 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:21.043 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:21.044 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:21.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:21.068 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-21T22:17:21.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:21.100+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:21.157 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:21.157 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:21.158 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:21.158 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:21.158 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:21.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:21.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:21.233 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:21.232+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322331946000006, 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.272 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:21.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:21.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322311775000003, 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.277 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.281 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322292829000006, 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322273465999999, 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.286 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:21.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:21.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322240817999997, 2024-09-21T22:17:21.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:21.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:21.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.294 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322189651000002, 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322162978999998, 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.299 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:21.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322138179999996, 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:21.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.308 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322107231999993, 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.309 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:21.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:21.313 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322083014, 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.317 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322058662000003, 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:21.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:21.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:21.322 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322034419000005, 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:21.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:21.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:21.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.322004684000007, 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.327 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.321969214000006, 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.331 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:21.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.335 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.284438008999999, 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:21.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:21.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.091570349999998, 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.340 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:21.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.086203818000001, 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.345 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:21.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:21.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.068639025000003, 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 47.036258031999999, 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.356 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.988454586000003, 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:21.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:21.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:21.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.367 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:21.368 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:21.368 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:21.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4244 write 0xa5102c6 thru 0xa514831 (0x456c bytes) 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4245 writesame 0x2c665fa thru 0x2c6b579 data_size 0x6a(0x4f80 bytes) 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4246 write 0xccc29fa thru 0xccc850b (0x5b12 bytes) 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4247 read 0x278da2 thru 0x280012 (0x7271 bytes) 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4248 writesame 0x7edd26e thru 0x7ee54f5 data_size 0x4(0x8288 bytes) 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4249 punch from 0x71cb49f to 0x71cb7a0, (0x301 bytes) 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4251 trunc from 0xccc850c to 0xe6b0c78 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4253 read 0xa7ce5f4 thru 0xa7d8b16 (0xa523 bytes) 2024-09-21T22:17:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:4254 write 0x1bddbb0 thru 0x1be7c00 (0xa051 bytes) 2024-09-21T22:17:21.372 INFO:teuthology.orchestra.run.smithi134.stdout:4255 read 0x66e2ec8 thru 0x66e31dd (0x316 bytes) 2024-09-21T22:17:21.372 INFO:teuthology.orchestra.run.smithi134.stdout:4256 read 0x129b833 thru 0x12aace5 (0xf4b3 bytes) 2024-09-21T22:17:21.372 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:21.372 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:21.372 INFO:teuthology.orchestra.run.smithi134.stdout:4257 trunc from 0xe6b0c78 to 0x2e2f5f2 2024-09-21T22:17:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:21.373 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:21.373 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:21.374 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:21.368+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:21.374 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:21.374 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:21.386 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:21.386 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:21.402 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:21.402 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:21.418 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:21.418 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:21.436 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:21.436 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:21.470 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:21.468+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:21.479 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:21.479 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:21.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:21.563 INFO:teuthology.orchestra.run.smithi134.stdout:4260 write 0xdbe755b thru 0xdbe82cd (0xd73 bytes) 2024-09-21T22:17:21.566 INFO:teuthology.orchestra.run.smithi134.stdout:4261 write 0x716292b thru 0x7165a1e (0x30f4 bytes) 2024-09-21T22:17:21.573 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:21.571+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:21.576 INFO:teuthology.orchestra.run.smithi134.stdout:4262 trunc from 0xdbe82ce to 0x8486e2f 2024-09-21T22:17:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:4263 punch from 0x69b039e to 0x69bcd07, (0xc969 bytes) 2024-09-21T22:17:21.585 INFO:teuthology.orchestra.run.smithi134.stdout:4264 write 0x8212c91 thru 0x8219c8b (0x6ffb bytes) 2024-09-21T22:17:21.594 INFO:teuthology.orchestra.run.smithi134.stdout:4265 trunc from 0x8486e2f to 0x33f8395 2024-09-21T22:17:21.603 INFO:teuthology.orchestra.run.smithi134.stdout:4266 read 0x5aec16 thru 0x5b0936 (0x1d21 bytes) 2024-09-21T22:17:21.604 INFO:teuthology.orchestra.run.smithi134.stdout:4267 read 0x21381f8 thru 0x213a0c6 (0x1ecf bytes) 2024-09-21T22:17:21.604 INFO:teuthology.orchestra.run.smithi134.stdout:4270 read 0xfb5500 thru 0xfb8e3e (0x393f bytes) 2024-09-21T22:17:21.612 INFO:teuthology.orchestra.run.smithi134.stdout:4272 write 0x56aba1d thru 0x56abe0b (0x3ef bytes) 2024-09-21T22:17:21.628 INFO:teuthology.orchestra.run.smithi134.stdout:4273 write 0x98c23e3 thru 0x98ca7fe (0x841c bytes) 2024-09-21T22:17:21.631 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:21.631 INFO:teuthology.orchestra.run.smithi134.stdout:4276 write 0xe8e80e thru 0xe9ddf7 (0xf5ea bytes) 2024-09-21T22:17:21.634 INFO:teuthology.orchestra.run.smithi134.stdout:4278 punch from 0x79a47e4 to 0x79b43ff, (0xfc1b bytes) 2024-09-21T22:17:21.634 INFO:teuthology.orchestra.run.smithi134.stdout:4281 read 0x57dcb34 thru 0x57e9faf (0xd47c bytes) 2024-09-21T22:17:21.634 INFO:teuthology.orchestra.run.smithi134.stdout:4282 write 0x51a056a thru 0x51a5bd0 (0x5667 bytes) 2024-09-21T22:17:21.636 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:21.636 INFO:teuthology.orchestra.run.smithi134.stdout:4284 writesame 0x7a089c4 thru 0x7a11841 data_size 0x2e(0x8e7e bytes) 2024-09-21T22:17:21.640 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:21.640 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:21.646 INFO:teuthology.orchestra.run.smithi134.stdout:4285 writesame 0xa6c976a thru 0xa6d1b6a data_size 0x1(0x8401 bytes) 2024-09-21T22:17:21.646 INFO:teuthology.orchestra.run.smithi134.stdout:4286 read 0x4266de3 thru 0x4276570 (0xf78e bytes) 2024-09-21T22:17:21.646 INFO:teuthology.orchestra.run.smithi134.stdout:4287 read 0x69ae62d thru 0x69b92a3 (0xac77 bytes) 2024-09-21T22:17:21.646 INFO:teuthology.orchestra.run.smithi134.stdout:4288 read 0xa0c18cf thru 0xa0c3230 (0x1962 bytes) 2024-09-21T22:17:21.646 INFO:teuthology.orchestra.run.smithi134.stdout:4291 punch from 0x83cad13 to 0x83d09d9, (0x5cc6 bytes) 2024-09-21T22:17:21.647 INFO:teuthology.orchestra.run.smithi134.stdout:4292 punch from 0x9916bf6 to 0x992129c, (0xa6a6 bytes) 2024-09-21T22:17:21.647 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:21.647 INFO:teuthology.orchestra.run.smithi134.stdout:4294 punch from 0x23997fd to 0x239e6df, (0x4ee2 bytes) 2024-09-21T22:17:21.647 INFO:teuthology.orchestra.run.smithi134.stdout:4295 read 0x283e86e thru 0x284d64b (0xedde bytes) 2024-09-21T22:17:21.647 INFO:teuthology.orchestra.run.smithi134.stdout:4297 write 0x957da8c thru 0x958612d (0x86a2 bytes) 2024-09-21T22:17:21.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:21.650 INFO:teuthology.orchestra.run.smithi134.stdout:4298 write 0x4f300d9 thru 0x4f3aa31 (0xa959 bytes) 2024-09-21T22:17:21.654 INFO:teuthology.orchestra.run.smithi134.stdout:4299 writesame 0x313324a thru 0x313a312 data_size 0x1(0x70c9 bytes) 2024-09-21T22:17:21.671 INFO:teuthology.orchestra.run.smithi134.stdout:4302 punch from 0x9cc4151 to 0x9cd0d15, (0xcbc4 bytes) 2024-09-21T22:17:21.671 INFO:teuthology.orchestra.run.smithi134.stdout:4303 read 0x7cc8b16 thru 0x7ccb21a (0x2705 bytes) 2024-09-21T22:17:21.671 INFO:teuthology.orchestra.run.smithi134.stdout:4304 write 0x107535 thru 0x1090a1 (0x1b6d bytes) 2024-09-21T22:17:21.673 INFO:teuthology.orchestra.run.smithi134.stdout:4305 read 0xa2ac7b5 thru 0xa2b739b (0xabe7 bytes) 2024-09-21T22:17:21.673 INFO:teuthology.orchestra.run.smithi134.stdout:4306 writesame 0x65c82d0 thru 0x65cbf8f data_size 0x10(0x3cc0 bytes) 2024-09-21T22:17:21.685 INFO:teuthology.orchestra.run.smithi134.stdout:4307 writesame 0xda65601 thru 0xda6b2ce data_size 0x7(0x5cce bytes) 2024-09-21T22:17:21.691 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:21.689+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:21.697 INFO:teuthology.orchestra.run.smithi134.stdout:4308 trunc from 0xda6b2cf to 0x35c94dd 2024-09-21T22:17:21.708 INFO:teuthology.orchestra.run.smithi134.stdout:4309 punch from 0x1fffb04 to 0x2007121, (0x761d bytes) 2024-09-21T22:17:21.708 INFO:teuthology.orchestra.run.smithi134.stdout:4311 read 0x210a49e thru 0x211a187 (0xfcea bytes) 2024-09-21T22:17:21.709 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:21.709 INFO:teuthology.orchestra.run.smithi134.stdout:4314 punch from 0x200e882 to 0x200ecf0, (0x46e bytes) 2024-09-21T22:17:21.709 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:21.717 INFO:teuthology.orchestra.run.smithi134.stdout:4316 trunc from 0x35c94dd to 0xa73569a 2024-09-21T22:17:21.722 INFO:teuthology.orchestra.run.smithi134.stdout:4317 clone 25 order 19 su 65536 sc 8 2024-09-21T22:17:21.773 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:21.771+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:21.795 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:21.795 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:21.804 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:21.888 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:21.886+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:21.954 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:21.954 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:21.963 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:22.005 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:22.003+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:22.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:22.075+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:22.109 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:22.109 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:22.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:22.176 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:22.174+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:22.221 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:22.221 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:22.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:22.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:22.276+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:22.334 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:22.334 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:22.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:22.384 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:22.383+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:22.480 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:22.479+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:22.485 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:22.485 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:22.494 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:22.581 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:22.579+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:22.636 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:22.636 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:22.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:22.682 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:22.680+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:22.747 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:22.747 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:22.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:22.783 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:22.782+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:22.803 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:22.803 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:22.804 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:17:22.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:17:22.861 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:22.861 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:22.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:22.884 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:22.883+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:22.944 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:17:22.989 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:22.988+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:23.007 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:23.007 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:23.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:23.087 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:23.086+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:23.153 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 125, 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:17:22.924673+0000", 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:59.900683+0000", 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:16:44.923178+0000", 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5799936, 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:17:23.154 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 5, 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 3, 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:17:23.155 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "luminous", 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:23.156 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:23.157 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:23.158 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:23.159 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:23.160 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 6.9000000953674316, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 6.9000000953674316, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.28999999165534973, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:17:23.161 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:23.162 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:23.163 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:17:23.164 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:23.165 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:23.166 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 2.630000114440918, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 2.630000114440918, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:23.167 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "pool_client.0", 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:34.502611+0000", 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:23.168 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 32, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 32, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 32, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 32, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 32, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:23.169 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "125", 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 52, 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 125, 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:23.170 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:23.171 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:23.172 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.75, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.75, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1.1399999856948853, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:23.173 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:23.174 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:17:23.175 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.178 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.179 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 116, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:17:23.180 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:17:23.182 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.184 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.189 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.190 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 13, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 26, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 45, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 27, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.194 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/704257458", 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/704257458", 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/704257458", 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/704257458", 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 115, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.198 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:17:23.200 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 0, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:23.201 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:17:23.202 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:17:23.203 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:17:23.204 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:23.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:17:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.207 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.208 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:17:23.209 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:17:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.211 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:23.212 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.216 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.217 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.218 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.219 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 27 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.220 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [ 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.d", 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: 6, 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: 0 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.11", 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 7 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.16", 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 2 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [ 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 48, 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 50, 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [], 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [], 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.227 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:23.229 INFO:tasks.thrashosds.thrasher:j is {'epoch': 125, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:17:22.924673+0000', 'last_up_change': '2024-09-21T22:15:59.900683+0000', 'last_in_change': '2024-09-21T22:16:44.923178+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:15:34.502611+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 52, 'snap_epoch': 125, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 26, 'up_from': 45, 'up_thru': 101, 'down_at': 27, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 704257458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 704257458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 704257458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 704257458}]}, 'public_addr': '172.21.15.134:6809/704257458', 'cluster_addr': '172.21.15.134:6811/704257458', 'heartbeat_back_addr': '172.21.15.134:6815/704257458', 'heartbeat_front_addr': '172.21.15.134:6813/704257458', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 27}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.d', 'osds': [6, 0]}, {'pgid': '3.11', 'osds': [1, 7]}, {'pgid': '3.16', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 48, 'length': 1}, {'begin': 50, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:17:23.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:17:23.230 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:23.231 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:23.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:23.231 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:23.227+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:23.330 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:23.328+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:23.376 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:23.377 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:23.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:23.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:23.430+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:23.447 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:23.491 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:23.491 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:23.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:23.531 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:23.530+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:23.559 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:23.560 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:17:23.572 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:23.572 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:23.573 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-21T22:17:23.193066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":911024962,"num_objects":707,"num_object_clones":0,"num_object_copies":1414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":707,"num_whiteouts":0,"num_read":122392,"num_read_kb":792026,"num_write":18954,"num_write_kb":592956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1213,"num_bytes_recovered":142274642,"num_keys_recovered":223,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13328,"ondisk_log_size":13328,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":848100,"kb_used_data":469600,"kb_used_omap":15,"kb_used_meta":378096,"kb_avail":754126620,"statfs":{"total":773094113280,"available":772225658880,"internally_reserved":0,"allocated":480870400,"data_stored":472537409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":387171100},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9897002,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2669,"num_read_kb":18804,"num_write":538,"num_write_kb":10920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000584"},"pg_stats":[{"pgid":"3.1f","version":"120'1088","reported_seq":10246,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.911523+0000","last_change":"2024-09-21T22:17:17.909268+0000","last_active":"2024-09-21T22:17:18.911523+0000","last_peered":"2024-09-21T22:17:18.911523+0000","last_clean":"2024-09-21T22:17:18.911523+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:17:18.911523+0000","last_undegraded":"2024-09-21T22:17:18.911523+0000","last_fullsized":"2024-09-21T22:17:18.911523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1088,"log_dups_size":0,"ondisk_log_size":1088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:21.285328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041649299999999998,"stat_sum":{"num_bytes":45375835,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12939,"num_read_kb":45610,"num_write":1941,"num_write_kb":24990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.1e","version":"120'428","reported_seq":3470,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908900+0000","last_change":"2024-09-21T22:17:17.909629+0000","last_active":"2024-09-21T22:17:18.908900+0000","last_peered":"2024-09-21T22:17:18.908900+0000","last_clean":"2024-09-21T22:17:18.908900+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:17:18.908900+0000","last_undegraded":"2024-09-21T22:17:18.908900+0000","last_fullsized":"2024-09-21T22:17:18.908900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:03:52.548064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001536408,"stat_sum":{"num_bytes":25777853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3973,"num_read_kb":26961,"num_write":434,"num_write_kb":16813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.1d","version":"120'274","reported_seq":6752,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.913112+0000","last_change":"2024-09-21T22:17:17.912822+0000","last_active":"2024-09-21T22:17:18.913112+0000","last_peered":"2024-09-21T22:17:18.913112+0000","last_clean":"2024-09-21T22:17:18.913112+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:17:18.913112+0000","last_undegraded":"2024-09-21T22:17:18.913112+0000","last_fullsized":"2024-09-21T22:17:18.913112+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:22:59.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060482699999999995,"stat_sum":{"num_bytes":53140202,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":6271,"num_read_kb":41436,"num_write":383,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.1c","version":"121'599","reported_seq":1807,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.913243+0000","last_change":"2024-09-21T22:17:17.912542+0000","last_active":"2024-09-21T22:17:18.913243+0000","last_peered":"2024-09-21T22:17:18.913243+0000","last_clean":"2024-09-21T22:17:18.913243+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:17:18.913243+0000","last_undegraded":"2024-09-21T22:17:18.913243+0000","last_fullsized":"2024-09-21T22:17:18.913243+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:06:19.841477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035405700000000002,"stat_sum":{"num_bytes":23472309,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2360,"num_read_kb":26518,"num_write":1027,"num_write_kb":24021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.1b","version":"121'283","reported_seq":1731,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.928214+0000","last_change":"2024-09-21T22:17:17.908577+0000","last_active":"2024-09-21T22:17:18.928214+0000","last_peered":"2024-09-21T22:17:18.928214+0000","last_clean":"2024-09-21T22:17:18.928214+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:17:18.928214+0000","last_undegraded":"2024-09-21T22:17:18.928214+0000","last_fullsized":"2024-09-21T22:17:18.928214+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:57:17.270675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034906899999999997,"stat_sum":{"num_bytes":20491389,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1674,"num_read_kb":19968,"num_write":371,"num_write_kb":17600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.1a","version":"111'254","reported_seq":1948,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.933940+0000","last_change":"2024-09-21T22:17:17.912599+0000","last_active":"2024-09-21T22:17:18.933940+0000","last_peered":"2024-09-21T22:17:18.933940+0000","last_clean":"2024-09-21T22:17:18.933940+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:17:18.933940+0000","last_undegraded":"2024-09-21T22:17:18.933940+0000","last_fullsized":"2024-09-21T22:17:18.933940+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:24.997518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040746000000000001,"stat_sum":{"num_bytes":7718890,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":1673,"num_read_kb":11562,"num_write":336,"num_write_kb":14012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.19","version":"122'573","reported_seq":2957,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.997177+0000","last_change":"2024-09-21T22:17:18.020974+0000","last_active":"2024-09-21T22:17:19.997177+0000","last_peered":"2024-09-21T22:17:19.997177+0000","last_clean":"2024-09-21T22:17:19.997177+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:17:19.997177+0000","last_undegraded":"2024-09-21T22:17:19.997177+0000","last_fullsized":"2024-09-21T22:17:19.997177+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:20.905200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053560800000000003,"stat_sum":{"num_bytes":15440871,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4545,"num_read_kb":17425,"num_write":675,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.18","version":"120'637","reported_seq":1746,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908950+0000","last_change":"2024-09-21T22:17:17.909515+0000","last_active":"2024-09-21T22:17:18.908950+0000","last_peered":"2024-09-21T22:17:18.908950+0000","last_clean":"2024-09-21T22:17:18.908950+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:17:18.908950+0000","last_undegraded":"2024-09-21T22:17:18.908950+0000","last_fullsized":"2024-09-21T22:17:18.908950+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:32:39.595147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001461749,"stat_sum":{"num_bytes":21737168,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2811,"num_read_kb":21169,"num_write":849,"num_write_kb":21775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.17","version":"120'749","reported_seq":1934,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.911549+0000","last_change":"2024-09-21T22:17:17.909460+0000","last_active":"2024-09-21T22:17:18.911549+0000","last_peered":"2024-09-21T22:17:18.911549+0000","last_clean":"2024-09-21T22:17:18.911549+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:17:18.911549+0000","last_undegraded":"2024-09-21T22:17:18.911549+0000","last_fullsized":"2024-09-21T22:17:18.911549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:17:06.066957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058028099999999998,"stat_sum":{"num_bytes":12281926,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":3847,"num_read_kb":17466,"num_write":1379,"num_write_kb":18349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.16","version":"120'178","reported_seq":13247,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.938329+0000","last_change":"2024-09-21T22:17:18.021177+0000","last_active":"2024-09-21T22:17:19.938329+0000","last_peered":"2024-09-21T22:17:19.938329+0000","last_clean":"2024-09-21T22:17:19.938329+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:17:19.938329+0000","last_undegraded":"2024-09-21T22:17:19.938329+0000","last_fullsized":"2024-09-21T22:17:19.938329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:15.281154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067360800000000002,"stat_sum":{"num_bytes":41903551,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13520,"num_read_kb":45453,"num_write":263,"num_write_kb":13465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.15","version":"120'651","reported_seq":2780,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.914926+0000","last_change":"2024-09-21T22:17:17.908060+0000","last_active":"2024-09-21T22:17:18.914926+0000","last_peered":"2024-09-21T22:17:18.914926+0000","last_clean":"2024-09-21T22:17:18.914926+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:17:18.914926+0000","last_undegraded":"2024-09-21T22:17:18.914926+0000","last_fullsized":"2024-09-21T22:17:18.914926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:47.328942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048813200000000001,"stat_sum":{"num_bytes":46423637,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3651,"num_read_kb":28784,"num_write":1016,"num_write_kb":27009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.14","version":"112'277","reported_seq":2549,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.913295+0000","last_change":"2024-09-21T22:17:17.912860+0000","last_active":"2024-09-21T22:17:18.913295+0000","last_peered":"2024-09-21T22:17:18.913295+0000","last_clean":"2024-09-21T22:17:18.913295+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:17:18.913295+0000","last_undegraded":"2024-09-21T22:17:18.913295+0000","last_fullsized":"2024-09-21T22:17:18.913295+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:39:37.946747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062423000000000003,"stat_sum":{"num_bytes":44911202,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1834,"num_read_kb":23782,"num_write":325,"num_write_kb":17552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":216,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908429+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:17:18.908429+0000","last_peered":"2024-09-21T22:17:18.908429+0000","last_clean":"2024-09-21T22:17:18.908429+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:17:18.908429+0000","last_undegraded":"2024-09-21T22:17:18.908429+0000","last_fullsized":"2024-09-21T22:17:18.908429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"120'298","reported_seq":2270,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.911286+0000","last_change":"2024-09-21T22:17:17.909204+0000","last_active":"2024-09-21T22:17:18.911286+0000","last_peered":"2024-09-21T22:17:18.911286+0000","last_clean":"2024-09-21T22:17:18.911286+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:17:18.911286+0000","last_undegraded":"2024-09-21T22:17:18.911286+0000","last_fullsized":"2024-09-21T22:17:18.911286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:45:39.048439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053224399999999997,"stat_sum":{"num_bytes":32213787,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2405,"num_read_kb":30001,"num_write":342,"num_write_kb":21987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":221,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.924436+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:17:19.924436+0000","last_peered":"2024-09-21T22:17:19.924436+0000","last_clean":"2024-09-21T22:17:19.924436+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:17:19.924436+0000","last_undegraded":"2024-09-21T22:17:19.924436+0000","last_fullsized":"2024-09-21T22:17:19.924436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"120'263","reported_seq":1682,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908898+0000","last_change":"2024-09-21T22:17:17.909897+0000","last_active":"2024-09-21T22:17:18.908898+0000","last_peered":"2024-09-21T22:17:18.908898+0000","last_clean":"2024-09-21T22:17:18.908898+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:17:18.908898+0000","last_undegraded":"2024-09-21T22:17:18.908898+0000","last_fullsized":"2024-09-21T22:17:18.908898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:12:08.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001592874,"stat_sum":{"num_bytes":27119345,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1443,"num_read_kb":19185,"num_write":317,"num_write_kb":15506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.914947+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:17:18.914947+0000","last_peered":"2024-09-21T22:17:18.914947+0000","last_clean":"2024-09-21T22:17:18.914947+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:17:18.914947+0000","last_undegraded":"2024-09-21T22:17:18.914947+0000","last_fullsized":"2024-09-21T22:17:18.914947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"122'381","reported_seq":9187,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.924461+0000","last_change":"2024-09-21T22:17:18.021280+0000","last_active":"2024-09-21T22:17:19.924461+0000","last_peered":"2024-09-21T22:17:19.924461+0000","last_clean":"2024-09-21T22:17:19.924461+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:17:19.924461+0000","last_undegraded":"2024-09-21T22:17:19.924461+0000","last_fullsized":"2024-09-21T22:17:19.924461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:54:21.618666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000716444,"stat_sum":{"num_bytes":39363442,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":9025,"num_read_kb":40764,"num_write":452,"num_write_kb":23666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":221,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.924338+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:17:19.924338+0000","last_peered":"2024-09-21T22:17:19.924338+0000","last_clean":"2024-09-21T22:17:19.924338+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:17:19.924338+0000","last_undegraded":"2024-09-21T22:17:19.924338+0000","last_fullsized":"2024-09-21T22:17:19.924338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"120'212","reported_seq":1741,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.909236+0000","last_change":"2024-09-21T22:17:17.909352+0000","last_active":"2024-09-21T22:17:18.909236+0000","last_peered":"2024-09-21T22:17:18.909236+0000","last_clean":"2024-09-21T22:17:18.909236+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:17:18.909236+0000","last_undegraded":"2024-09-21T22:17:18.909236+0000","last_fullsized":"2024-09-21T22:17:18.909236+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:52:32.468917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014649719999999999,"stat_sum":{"num_bytes":20133686,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1131,"num_read_kb":20991,"num_write":325,"num_write_kb":14649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.3","version":"120'273","reported_seq":1904,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.913208+0000","last_change":"2024-09-21T22:17:17.913079+0000","last_active":"2024-09-21T22:17:18.913208+0000","last_peered":"2024-09-21T22:17:18.913208+0000","last_clean":"2024-09-21T22:17:18.913208+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:17:18.913208+0000","last_undegraded":"2024-09-21T22:17:18.913208+0000","last_fullsized":"2024-09-21T22:17:18.913208+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:35:19.966185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065228900000000002,"stat_sum":{"num_bytes":20631757,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1461,"num_read_kb":22323,"num_write":342,"num_write_kb":18703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":68,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.924303+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:17:19.924303+0000","last_peered":"2024-09-21T22:17:19.924303+0000","last_clean":"2024-09-21T22:17:19.924303+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:17:19.924303+0000","last_undegraded":"2024-09-21T22:17:19.924303+0000","last_fullsized":"2024-09-21T22:17:19.924303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"120'513","reported_seq":8465,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.924260+0000","last_change":"2024-09-21T22:17:18.021427+0000","last_active":"2024-09-21T22:17:19.924260+0000","last_peered":"2024-09-21T22:17:19.924260+0000","last_clean":"2024-09-21T22:17:19.924260+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:17:19.924260+0000","last_undegraded":"2024-09-21T22:17:19.924260+0000","last_fullsized":"2024-09-21T22:17:19.924260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:36:21.371918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076628700000000004,"stat_sum":{"num_bytes":65854189,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":8643,"num_read_kb":42390,"num_write":686,"num_write_kb":23367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":224,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.920861+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:17:19.920861+0000","last_peered":"2024-09-21T22:17:19.920861+0000","last_clean":"2024-09-21T22:17:19.920861+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:17:19.920861+0000","last_undegraded":"2024-09-21T22:17:19.920861+0000","last_fullsized":"2024-09-21T22:17:19.920861+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"120'342","reported_seq":1792,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.911141+0000","last_change":"2024-09-21T22:17:17.908635+0000","last_active":"2024-09-21T22:17:18.911141+0000","last_peered":"2024-09-21T22:17:18.911141+0000","last_clean":"2024-09-21T22:17:18.911141+0000","last_became_active":"2024-09-21T22:16:48.956575+0000","last_became_peered":"2024-09-21T22:16:48.956575+0000","last_unstale":"2024-09-21T22:17:18.911141+0000","last_undegraded":"2024-09-21T22:17:18.911141+0000","last_fullsized":"2024-09-21T22:17:18.911141+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:40.308916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000992307,"stat_sum":{"num_bytes":35026366,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1376,"num_read_kb":17972,"num_write":505,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6594455,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.914796+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:17:18.914796+0000","last_peered":"2024-09-21T22:17:18.914796+0000","last_clean":"2024-09-21T22:17:18.914796+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:17:18.914796+0000","last_undegraded":"2024-09-21T22:17:18.914796+0000","last_fullsized":"2024-09-21T22:17:18.914796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"120'213","reported_seq":942,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908822+0000","last_change":"2024-09-21T22:17:17.909060+0000","last_active":"2024-09-21T22:17:18.908822+0000","last_peered":"2024-09-21T22:17:18.908822+0000","last_clean":"2024-09-21T22:17:18.908822+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:17:18.908822+0000","last_undegraded":"2024-09-21T22:17:18.908822+0000","last_fullsized":"2024-09-21T22:17:18.908822+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:03.515643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001446145,"stat_sum":{"num_bytes":19572055,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":561,"num_read_kb":22547,"num_write":274,"num_write_kb":22081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":57,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.920788+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:17:19.920788+0000","last_peered":"2024-09-21T22:17:19.920788+0000","last_clean":"2024-09-21T22:17:19.920788+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:17:19.920788+0000","last_undegraded":"2024-09-21T22:17:19.920788+0000","last_fullsized":"2024-09-21T22:17:19.920788+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":369,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.914810+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:17:18.914810+0000","last_peered":"2024-09-21T22:17:18.914810+0000","last_clean":"2024-09-21T22:17:18.914810+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:17:18.914810+0000","last_undegraded":"2024-09-21T22:17:18.914810+0000","last_fullsized":"2024-09-21T22:17:18.914810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"120'552","reported_seq":1553,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908872+0000","last_change":"2024-09-21T22:17:17.909839+0000","last_active":"2024-09-21T22:17:18.908872+0000","last_peered":"2024-09-21T22:17:18.908872+0000","last_clean":"2024-09-21T22:17:18.908872+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:17:18.908872+0000","last_undegraded":"2024-09-21T22:17:18.908872+0000","last_fullsized":"2024-09-21T22:17:18.908872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:14.513284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016366009999999999,"stat_sum":{"num_bytes":21676581,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2245,"num_read_kb":12111,"num_write":879,"num_write_kb":17020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.9","version":"120'316","reported_seq":3097,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.913033+0000","last_change":"2024-09-21T22:17:17.913142+0000","last_active":"2024-09-21T22:17:18.913033+0000","last_peered":"2024-09-21T22:17:18.913033+0000","last_clean":"2024-09-21T22:17:18.913033+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:17:18.913033+0000","last_undegraded":"2024-09-21T22:17:18.913033+0000","last_fullsized":"2024-09-21T22:17:18.913033+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:56:42.460340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070589600000000002,"stat_sum":{"num_bytes":62556077,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3220,"num_read_kb":43487,"num_write":435,"num_write_kb":18665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.a","version":"121'324","reported_seq":2215,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.954253+0000","last_change":"2024-09-21T22:17:18.092397+0000","last_active":"2024-09-21T22:17:18.954253+0000","last_peered":"2024-09-21T22:17:18.954253+0000","last_clean":"2024-09-21T22:17:18.954253+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:17:18.954253+0000","last_undegraded":"2024-09-21T22:17:18.954253+0000","last_fullsized":"2024-09-21T22:17:18.954253+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:13.327488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032722160000000001,"stat_sum":{"num_bytes":35591436,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2334,"num_read_kb":20612,"num_write":340,"num_write_kb":13881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.b","version":"112'678","reported_seq":1962,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.909060+0000","last_change":"2024-09-21T22:17:17.907927+0000","last_active":"2024-09-21T22:17:18.909060+0000","last_peered":"2024-09-21T22:17:18.909060+0000","last_clean":"2024-09-21T22:17:18.909060+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:17:18.909060+0000","last_undegraded":"2024-09-21T22:17:18.909060+0000","last_fullsized":"2024-09-21T22:17:18.909060+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:57:57.672838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000463246,"stat_sum":{"num_bytes":12983887,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4119,"num_read_kb":15133,"num_write":936,"num_write_kb":14821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.c","version":"120'156","reported_seq":1001,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.909160+0000","last_change":"2024-09-21T22:17:17.909084+0000","last_active":"2024-09-21T22:17:18.909160+0000","last_peered":"2024-09-21T22:17:18.909160+0000","last_clean":"2024-09-21T22:17:18.909160+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:17:18.909160+0000","last_undegraded":"2024-09-21T22:17:18.909160+0000","last_fullsized":"2024-09-21T22:17:18.909160+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:45:40.470396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001327295,"stat_sum":{"num_bytes":35602025,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":575,"num_read_kb":19955,"num_write":182,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.d","version":"120'376","reported_seq":1222,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908464+0000","last_change":"2024-09-21T22:17:18.093736+0000","last_active":"2024-09-21T22:17:18.908464+0000","last_peered":"2024-09-21T22:17:18.908464+0000","last_clean":"2024-09-21T22:17:18.908464+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:17:18.908464+0000","last_undegraded":"2024-09-21T22:17:18.908464+0000","last_fullsized":"2024-09-21T22:17:18.908464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:46:54.985349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044831960000000001,"stat_sum":{"num_bytes":12091468,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1338,"num_read_kb":18132,"num_write":579,"num_write_kb":16339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.e","version":"120'174","reported_seq":965,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.915016+0000","last_change":"2024-09-21T22:17:17.908012+0000","last_active":"2024-09-21T22:17:18.915016+0000","last_peered":"2024-09-21T22:17:18.915016+0000","last_clean":"2024-09-21T22:17:18.915016+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:17:18.915016+0000","last_undegraded":"2024-09-21T22:17:18.915016+0000","last_fullsized":"2024-09-21T22:17:18.915016+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:08:00.275347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052517700000000004,"stat_sum":{"num_bytes":6302461,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":286,"num_read_kb":10969,"num_write":244,"num_write_kb":14062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.f","version":"121'453","reported_seq":1827,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.918120+0000","last_change":"2024-09-21T22:17:17.908434+0000","last_active":"2024-09-21T22:17:18.918120+0000","last_peered":"2024-09-21T22:17:18.918120+0000","last_clean":"2024-09-21T22:17:18.918120+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:17:18.918120+0000","last_undegraded":"2024-09-21T22:17:18.918120+0000","last_fullsized":"2024-09-21T22:17:18.918120+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:58.695629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077321499999999995,"stat_sum":{"num_bytes":13227763,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2090,"num_read_kb":12317,"num_write":577,"num_write_kb":15501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.10","version":"120'234","reported_seq":1542,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.908462+0000","last_change":"2024-09-21T22:17:18.092314+0000","last_active":"2024-09-21T22:17:18.908462+0000","last_peered":"2024-09-21T22:17:18.908462+0000","last_clean":"2024-09-21T22:17:18.908462+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:17:18.908462+0000","last_undegraded":"2024-09-21T22:17:18.908462+0000","last_fullsized":"2024-09-21T22:17:18.908462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:32.479535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003485967,"stat_sum":{"num_bytes":22571921,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1048,"num_read_kb":18543,"num_write":273,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.11","version":"120'566","reported_seq":1627,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T22:17:19.961152+0000","last_change":"2024-09-21T22:17:18.020970+0000","last_active":"2024-09-21T22:17:19.961152+0000","last_peered":"2024-09-21T22:17:19.961152+0000","last_clean":"2024-09-21T22:17:19.961152+0000","last_became_active":"2024-09-21T22:17:14.901471+0000","last_became_peered":"2024-09-21T22:17:14.901471+0000","last_unstale":"2024-09-21T22:17:19.961152+0000","last_undegraded":"2024-09-21T22:17:19.961152+0000","last_fullsized":"2024-09-21T22:17:19.961152+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:41:59.198314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053494199999999995,"stat_sum":{"num_bytes":13404584,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":2594,"num_read_kb":15644,"num_write":878,"num_write_kb":16926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":16112633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.12","version":"120'378","reported_seq":6131,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.911209+0000","last_change":"2024-09-21T22:17:17.908071+0000","last_active":"2024-09-21T22:17:18.911209+0000","last_peered":"2024-09-21T22:17:18.911209+0000","last_clean":"2024-09-21T22:17:18.911209+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:17:18.911209+0000","last_undegraded":"2024-09-21T22:17:18.911209+0000","last_fullsized":"2024-09-21T22:17:18.911209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:21:44.562162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063170100000000003,"stat_sum":{"num_bytes":16379596,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":6316,"num_read_kb":17447,"num_write":502,"num_write_kb":14993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]},{"pgid":"3.13","version":"111'515","reported_seq":10485,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-21T22:17:18.914938+0000","last_change":"2024-09-21T22:17:17.907836+0000","last_active":"2024-09-21T22:17:18.914938+0000","last_peered":"2024-09-21T22:17:18.914938+0000","last_clean":"2024-09-21T22:17:18.914938+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:17:18.914938+0000","last_undegraded":"2024-09-21T22:17:18.914938+0000","last_fullsized":"2024-09-21T22:17:18.914938+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:39:55.158943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042603200000000002,"stat_sum":{"num_bytes":39457316,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":10968,"num_read_kb":45269,"num_write":726,"num_write_kb":17391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"1"},{"start":"2e","length":"1"},{"start":"30","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":910434575,"num_objects":703,"num_object_clones":0,"num_object_copies":1406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":703,"num_whiteouts":0,"num_read":122276,"num_read_kb":791926,"num_write":18793,"num_write_kb":590538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1213,"num_bytes_recovered":142274642,"num_keys_recovered":223,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":471875584,"data_stored":469521180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13208,"ondisk_log_size":13208,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94460,"kb_used_data":49384,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94277380,"statfs":{"total":96636764160,"available":96540037120,"internally_reserved":0,"allocated":50569216,"data_stored":49547446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57588,"kb_used_data":22236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314252,"statfs":{"total":96636764160,"available":96577794048,"internally_reserved":0,"allocated":22769664,"data_stored":21886583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122988,"kb_used_data":61272,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94248852,"statfs":{"total":96636764160,"available":96510824448,"internally_reserved":0,"allocated":62742528,"data_stored":61692957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142640,"kb_used_data":89248,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94229200,"statfs":{"total":96636764160,"available":96490700800,"internally_reserved":0,"allocated":91389952,"data_stored":90215278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528337,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110652,"kb_used_data":70048,"kb_used_omap":4,"kb_used_meta":40571,"kb_avail":94261188,"statfs":{"total":96636764160,"available":96523456512,"internally_reserved":0,"allocated":71729152,"data_stored":70579146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":41545394},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72816,"kb_used_data":37460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94299024,"statfs":{"total":96636764160,"available":96562200576,"internally_reserved":0,"allocated":38359040,"data_stored":37411384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100100,"kb_used_data":60380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94271740,"statfs":{"total":96636764160,"available":96534261760,"internally_reserved":0,"allocated":61829120,"data_stored":60790009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146856,"kb_used_data":79572,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94224984,"statfs":{"total":96636764160,"available":96486383616,"internally_reserved":0,"allocated":81481728,"data_stored":80414606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":79458304,"data_stored":79132940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":64036864,"data_stored":63748431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36900864,"data_stored":36711368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70336512,"data_stored":69932428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":89960448,"data_stored":89527889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61304832,"data_stored":61005502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21348352,"data_stored":21199270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48529408,"data_stored":48263352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:17:23.575 INFO:tasks.thrashosds.thrasher:Setting 3.1 to [0, 1] 2024-09-21T22:17:23.575 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1', '0', '1'] 2024-09-21T22:17:23.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1 0 1 2024-09-21T22:17:23.591 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:23.591 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:23.609 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:23.609 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:23.612 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:23.612 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:23.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:23.630 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:23.630 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:23.632 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:23.631+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:23.647 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:23.647 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:23.664 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:23.664 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:23.681 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:23.682 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:23.700 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:23.700 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:23.733 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:23.731+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:23.738 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:23.738 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:23.738 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:23.738 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:23.738 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:23.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:23.833 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:23.832+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:23.893 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:23.893 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:23.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:23.893 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 100.38987838600001, 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:17:23.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 97.374694926999993, 2024-09-21T22:17:23.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:23.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 97.363248489, 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 86.813161261000005, 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:17:23.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.758073498000002, 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:17:23.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.486980809000002, 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:17:23.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:17:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.482074234999999, 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:17:23.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:17:23.925 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.478863636, 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:17:23.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.473841938999996, 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:23.935 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.471854606999997, 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:17:23.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.948001015999999, 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:23.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:17:23.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:17:23.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:17:23.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:40247 3.0 e71/23 3:0688b99e:::rbd_data.118542b14bcd.0000000000000281:head v 71'358, mlcod=71'356)", 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.656791802000001, 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039211389999999997, 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234377+0000", 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234378+0000", 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9500000000000001e-07 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234387+0000", 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2599999999999994e-06 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234398+0000", 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234405+0000", 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234460+0000", 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4975999999999997e-05 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.234482+0000", 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1407e-05 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238263+0000", 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037812039999999998 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:28.238298+0000", 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5419000000000001e-05 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.904839404999997, 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.903338664000003, 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:17:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:17:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97072 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'409, mlcod=84'406)", 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.968390898000003, 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039520709999999997, 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922780+0000", 2024-09-21T22:17:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3740000000000001e-06 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922789+0000", 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922808+0000", 2024-09-21T22:17:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8481000000000001e-05 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922822+0000", 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922885+0000", 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3336000000000005e-05 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922910+0000", 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5072999999999999e-05 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926670+0000", 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003760191 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926730+0000", 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0126e-05 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.923651675999999, 2024-09-21T22:17:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:17:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:17:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.918767600000002, 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:17:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.917979903000003, 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.910972461, 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:17:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.9350477970000002, 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:17:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:23.984 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:23.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:23.986 INFO:teuthology.orchestra.run.smithi134.stderr:set 3.1 pg_upmap mapping to [0,1] 2024-09-21T22:17:23.986 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:17:23.988 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:23.984+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:24.061 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-21T22:17:24.086 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:24.084+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:24.096 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:24.096 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:24.096 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:24.096 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:24.105 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:24.187 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:24.186+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:24.249 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:24.249 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:24.249 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:24.249 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:24.249 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:24.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:24.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:24.287+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:24.362 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:24.362 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:24.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1601 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1802240~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.796073093, 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01121581, 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1601 2024-09-21T22:17:24.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564244+0000", 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-07 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564262+0000", 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7263000000000001e-05 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564289+0000", 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.694e-05 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564317+0000", 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.792e-05 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575226+0000", 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010909211 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575327+0000", 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000100883 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575460+0000", 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013314199999999999 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1602 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1867776~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.795975631, 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011371434, 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.367 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1602 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564341+0000", 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564342+0000", 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564344+0000", 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5280000000000002e-06 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564371+0000", 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6774000000000001e-05 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564377+0000", 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575505+0000", 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011128325 2024-09-21T22:17:24.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575599+0000", 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3885e-05 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575713+0000", 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011382 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.371 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1603 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1933312~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.795920575, 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011461047, 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1603 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564396+0000", 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564397+0000", 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7e-07 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564400+0000", 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4989999999999999e-06 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564407+0000", 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6290000000000004e-06 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564431+0000", 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575730+0000", 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011299247 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575792+0000", 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2411999999999998e-05 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575857+0000", 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5071000000000001e-05 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1604 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 1998848~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.795878569, 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657693, 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1604 2024-09-21T22:17:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564438+0000", 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564439+0000", 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564441+0000", 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5339999999999998e-06 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564476+0000", 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4669999999999998e-05 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564482+0000", 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6640000000000003e-06 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575897+0000", 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011415740000000001 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.575984+0000", 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6794999999999998e-05 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576096+0000", 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111857 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1605 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:3 [read 2064384~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.79581797100001, 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011820020000000001, 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.380 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1605 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564499+0000", 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564500+0000", 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564502+0000", 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7e-06 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564509+0000", 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9750000000000001e-06 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564515+0000", 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3850000000000001e-06 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576142+0000", 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011627622000000001 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576220+0000", 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8009000000000005e-05 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576319+0000", 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8770000000000005e-05 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.795795778, 2024-09-21T22:17:24.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:17:24.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:17:24.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.388 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.839456239, 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:17:24.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:2359 3.1d e33/23 3:bf3b4e54:::rbd_data.118555b0e245.0000000000000001:head v 33'4, mlcod=30'2)", 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 97.836316996999997, 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011273856000000001, 2024-09-21T22:17:24.394 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.524000+0000", 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526435+0000", 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024346860000000001 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526468+0000", 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2614999999999999e-05 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526485+0000", 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7842999999999998e-05 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526608+0000", 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012259400000000001 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.526640+0000", 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1875000000000002e-05 2024-09-21T22:17:24.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535229+0000", 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0085894979999999992 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.535274+0000", 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4431000000000002e-05 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8048 3.9 3:920637af:::rbd_data.1185acca6c1f.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.743303372, 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011307143, 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8048 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617014+0000", 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617015+0000", 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0109999999999999e-06 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617020+0000", 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617032+0000", 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1936000000000001e-05 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617043+0000", 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0834e-05 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617093+0000", 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0146999999999999e-05 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.617144+0000", 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1357999999999999e-05 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.618892+0000", 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001748236 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628221+0000", 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0093285020000000007 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628251+0000", 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9842999999999999e-05 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628287+0000", 2024-09-21T22:17:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6640000000000002e-05 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:55.628321+0000", 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3543000000000001e-05 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.787438080000001, 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:17:24.404 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:17:24.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:17:24.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:17:24.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.68159953, 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.410 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:17:24.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:17:24.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16960 3.3 3:c5a54815:::rbd_data.1185fc79843.000000000000006c:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.680582955000006, 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01132942, 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16960 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679734+0000", 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679735+0000", 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:17:24.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679740+0000", 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679750+0000", 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0883000000000001e-05 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679756+0000", 2024-09-21T22:17:24.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0799999999999996e-06 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679802+0000", 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6149999999999997e-05 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.679904+0000", 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000101854 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:24.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.681657+0000", 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001753051 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690874+0000", 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.009217589 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690929+0000", 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4866e-05 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.690998+0000", 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8580999999999999e-05 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691063+0000", 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5878999999999997e-05 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:24.421 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.680215188999995, 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:24.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:17:24.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.161872889999998, 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:17:24.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:17:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:17:24.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.159997008999994, 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.436 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.890254714000001, 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.437 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:24.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:24.442 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.774484882000003, 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:17:24.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:17:24.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:17:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:17:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.396671662000003, 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 22.544345870000001, 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 22.268809255000001, 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.464 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:24.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:24.466 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:24.464+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:24.566 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:24.564+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:24.570 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:24.570 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:24.570 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:24.570 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:24.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:24.667 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:24.665+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:24.724 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:24.724 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:24.724 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:24.724 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:24.724 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:24.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:24.775 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:24.773+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:24.868 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:24.867+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:24.879 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:24.879 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930226825000005, 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.880 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:24.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930206654000003, 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930187708000005, 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930168344999998, 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930135696999997, 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:24.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:24.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930084530000002, 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.901 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.905 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930057857999998, 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.909 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930033058999996, 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:24.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:24.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:24.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.930002110999993, 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.914 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.929977893, 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:24.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:24.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.929953541000003, 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:24.922 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:24.926 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.929929298000005, 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:24.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:24.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.929899563000006, 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:24.934 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.929864093000006, 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.935 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:24.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.892332887999999, 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:24.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:24.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:24.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.699465228999998, 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.694098697000001, 2024-09-21T22:17:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.676533904000003, 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.644152910999999, 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.596349465000003, 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:24.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:24.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:24.969+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:25.070 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:25.069+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:25.074 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:25.074 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:25.074 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:25.074 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:25.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:25.171 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:25.169+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:25.187 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:25.187 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:25.188 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:25.188 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:25.188 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:25.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:25.272 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:25.271+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 93.210457258999995, 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:17:25.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:25.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:17:25.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 93.181397438000005, 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.349 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:17:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.981183692000002, 2024-09-21T22:17:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:17:25.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.829944875999999, 2024-09-21T22:17:25.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:17:25.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:17:25.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:17:25.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 84.427002572999996, 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.366 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:25.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:17:25.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.373 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 84.426939718, 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:17:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:17:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953435740000003, 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.380 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:25.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:17:25.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:17:25.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953413486000002, 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.384 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.388 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953389071999993, 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:17:25.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:17:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953359606999996, 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.393 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:17:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953332462999995, 2024-09-21T22:17:25.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:17:25.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:17:25.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953313360999999, 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:17:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:17:25.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953289209000005, 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.406 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:17:25.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953265431000005, 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:17:25.410 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:17:25.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953246456000002, 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:17:25.414 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:17:25.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953227706000007, 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.418 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:17:25.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:17:25.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953195622999999, 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.422 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:17:25.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:17:25.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953182635999994, 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.426 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.430 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 79.953172386999995, 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97073 3.d 3:b30a3fcc:::rbd_data.11859a4b084.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.416613026999997, 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011897978999999999, 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97073 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924748+0000", 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.147e-06 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928499+0000", 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514219999999999 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928513+0000", 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4032000000000001e-05 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928520+0000", 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3409999999999997e-06 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928582+0000", 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1748000000000006e-05 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928728+0000", 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000145523 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928881+0000", 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015284599999999999 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.932050+0000", 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031697330000000001 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936518+0000", 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044676120000000001 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936587+0000", 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8783999999999997e-05 2024-09-21T22:17:25.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936644+0000", 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7791000000000003e-05 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.440 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:25.441 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:25.442 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:25.440+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:25.542 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:25.540+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:25.546 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:25.546 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:25.546 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:25.546 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:25.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:25.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:25.642+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:25.699 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:25.699 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:25.699 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:25.699 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:25.699 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:25.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:25.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:25.757 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:25.756+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:25.812 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410609761000003, 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:17:25.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.816 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410564141999998, 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.817 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:17:25.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:17:25.820 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410491409000002, 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.821 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410444532, 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:25.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:17:25.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.829 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410379792000001, 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410343562999998, 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.834 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:25.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.837 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410249636000003, 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:17:25.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410225867999998, 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:25.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:25.846 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410160996999998, 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.850 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410123374000001, 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410082580999998, 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:17:25.858 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.410007120000003, 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.859 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409936747000003, 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:17:25.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409903071999999, 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:25.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409834320000002, 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:25.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:17:25.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:17:25.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409789924000002, 2024-09-21T22:17:25.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.879 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409698976000001, 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:25.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:17:25.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:17:25.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409670452, 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:17:25.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:17:25.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409638158, 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.888 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:17:25.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:17:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.409600025000003, 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:25.892 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:25.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:25.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:25.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:25.896 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:25.897 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:25.897 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:25.898 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:25.898 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:25.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:25.899 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:25.895+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:25.899 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:25.899 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:25.900 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:25.900 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:25.909 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:25.910 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:25.926 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:25.943 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:25.943 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:25.962 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:25.962 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:25.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:17:26.007 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.007 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:26.008 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:26.007+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:26.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:26.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:26.100+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:26.189 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.189 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:26.199 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:26.198+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:26.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:26.300 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:26.299+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:26.311 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:26.311 INFO:teuthology.orchestra.run.smithi134.stdout:4319 read 0x6f11a8b thru 0x6f1e923 (0xce99 bytes) 2024-09-21T22:17:26.312 INFO:teuthology.orchestra.run.smithi134.stdout:4322 write 0x4d06699 thru 0x4d0e41f (0x7d87 bytes) 2024-09-21T22:17:26.319 INFO:teuthology.orchestra.run.smithi134.stdout:4323 punch from 0x2e79716 to 0x2e8371d, (0xa007 bytes) 2024-09-21T22:17:26.319 INFO:teuthology.orchestra.run.smithi134.stdout:4324 punch from 0x7d901 to 0x8507b, (0x777a bytes) 2024-09-21T22:17:26.319 INFO:teuthology.orchestra.run.smithi134.stdout:4327 read 0x3efccd5 thru 0x3f052ed (0x8619 bytes) 2024-09-21T22:17:26.319 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:26.319 INFO:teuthology.orchestra.run.smithi134.stdout:4329 write 0x8f12431 thru 0x8f18805 (0x63d5 bytes) 2024-09-21T22:17:26.322 INFO:teuthology.orchestra.run.smithi134.stdout:4333 write 0x12eee99 thru 0x12fab07 (0xbc6f bytes) 2024-09-21T22:17:26.327 INFO:teuthology.orchestra.run.smithi134.stdout:4334 clone 26 order 24 su 262144 sc 6 2024-09-21T22:17:26.352 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.352 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:26.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:26.405 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:26.404+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:26.464 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.464 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:26.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:26.502 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:26.501+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:26.603 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:26.602+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:26.616 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.616 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:26.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:26.703 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:26.702+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:26.768 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.768 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:26.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:26.804 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:26.803+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:26.879 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.879 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:26.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:26.890 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:17:26.905 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:26.903+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:26.996 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:26.996 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:27.006 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:27.005+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:27.108 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:27.108 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.108 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:27.106+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:27.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:27.208 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:27.207+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:27.309 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:27.307+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:27.332 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:27.332 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:27.410 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:27.408+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:27.443 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:27.443 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:27.511 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:27.509+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:27.563 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:27.564 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.572 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:27.612 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:27.611+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:27.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:27.712+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:27.716 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:27.716 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:27.814 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:27.813+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:27.827 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:27.827 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:27.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:27.920 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:27.918+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:27.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:28.000 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:28.000 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:28.009 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:28.050 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:28.048+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:28.096 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:28.113 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:28.113 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:28.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:28.116+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:28.129 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:28.145 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:28.145 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:28.152 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:28.152 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:28.161 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:28.161 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:28.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:28.177 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:28.193 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:28.194 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:28.209 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:28.210 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:28.218 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:28.216+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317834714, 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:28.271 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317814542999997, 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.272 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317795597, 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317776233999993, 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:28.284 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317743586000006, 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:28.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317692418999997, 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.292 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317665747000007, 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:28.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317640948000005, 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:28.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:28.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:28.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317610000000002, 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317585781999995, 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317561429999998, 2024-09-21T22:17:28.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.313 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317537186999999, 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317507452000001, 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.318 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.317471982000001, 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.322 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:28.326 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 54.279940777, 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:28.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:28.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 54.087073117999999, 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:28.331 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:28.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 54.081706586000003, 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:28.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:28.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:28.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 54.064141792999997, 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:28.340 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 54.031760800000001, 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.345 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.983957353999998, 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:28.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:28.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:28.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:28.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:28.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.356 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.356 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.356 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:28.357 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:28.358 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:28.356+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:28.458 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:28.457+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:28.502 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:28.503 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:28.503 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:28.503 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:28.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:28.559 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:28.558+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:28.614 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:28.614 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:28.614 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:28.615 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:28.615 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:28.623 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:28.667 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:28.665+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:28.728 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4627 3.10 3:0df1d655:::rbd_data.1185e2328614.0000000000000017:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.595938102000005, 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015685013000000001, 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.729 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4627 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130902+0000", 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130903+0000", 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.032e-06 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130910+0000", 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130923+0000", 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2517000000000001e-05 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130932+0000", 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.8989999999999996e-06 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.130986+0000", 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263999999999997e-05 2024-09-21T22:17:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.131043+0000", 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7578000000000003e-05 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.133352+0000", 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023084630000000002 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146479+0000", 2024-09-21T22:17:28.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01312752 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146493+0000", 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3838e-05 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146530+0000", 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7064000000000003e-05 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.146587+0000", 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7108999999999998e-05 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:4643 3.10 3:0964328a:::rbd_data.1185e2328614.0000000000000022:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.566878281000001, 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015544540000000001, 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 4643 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159962+0000", 2024-09-21T22:17:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159963+0000", 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.372e-06 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159969+0000", 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159982+0000", 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2597e-05 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.159988+0000", 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160056+0000", 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8616999999999997e-05 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.160147+0000", 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0779000000000006e-05 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.162539+0000", 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0023918889999999999 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175364+0000", 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012824597 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175407+0000", 2024-09-21T22:17:28.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3529999999999998e-05 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175453+0000", 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5507999999999999e-05 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:52.175507+0000", 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4030000000000003e-05 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.740 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8685 3.10 3:08e1ef71:::rbd_data.1185acca6c1f.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.366664534999998, 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014789973, 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8685 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.741 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360176+0000", 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360178+0000", 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360187+0000", 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0129999999999999e-06 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360205+0000", 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8457999999999998e-05 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360214+0000", 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8189999999999998e-06 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360283+0000", 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8788000000000006e-05 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.360380+0000", 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6823000000000005e-05 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.363061+0000", 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002681377 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374885+0000", 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011823904999999999 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374898+0000", 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3488e-05 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374933+0000", 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4177999999999997e-05 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.374966+0000", 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3160000000000001e-05 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.746 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.215425718999995, 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.812483416000006, 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:28.752 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:17:28.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:17:28.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:17:28.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 87.812420560999996, 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.759 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:17:28.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:17:28.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15924 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 589824~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.765 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338916583, 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011506258, 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15924 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387924+0000", 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3999999999999998e-07 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387929+0000", 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0180000000000001e-06 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387935+0000", 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387940+0000", 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399325+0000", 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011385116000000001 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399370+0000", 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5028000000000003e-05 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399430+0000", 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0322000000000003e-05 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.769 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15925 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 671744~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338894328999999, 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011623591000000001, 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.770 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15925 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387946+0000", 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387947+0000", 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387948+0000", 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387958+0000", 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7950000000000002e-06 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387964+0000", 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399460+0000", 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011495579000000001 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399507+0000", 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7367000000000002e-05 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399570+0000", 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2550000000000003e-05 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15926 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 753664~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338869915000004, 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011730397, 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.774 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15926 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387970+0000", 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387971+0000", 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387977+0000", 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5889999999999999e-06 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387988+0000", 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0331e-05 2024-09-21T22:17:28.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.387993+0000", 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1869999999999996e-06 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399594+0000", 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011601436999999999 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399640+0000", 2024-09-21T22:17:28.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5580000000000001e-05 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399701+0000", 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0890999999999997e-05 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15927 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 802816~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338840450000006, 2024-09-21T22:17:28.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011825398000000001, 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15927 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388000+0000", 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388007+0000", 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1659999999999997e-06 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388015+0000", 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8019999999999992e-06 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388020+0000", 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0390000000000004e-06 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399721+0000", 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011700911 2024-09-21T22:17:28.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399766+0000", 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4965000000000001e-05 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399825+0000", 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9097e-05 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15928 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 884736~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338813306000006, 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011920904, 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15928 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388027+0000", 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:17:28.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388029+0000", 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8920000000000001e-06 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388035+0000", 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388040+0000", 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6280000000000004e-06 2024-09-21T22:17:28.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399846+0000", 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011805683000000001 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399888+0000", 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2546999999999998e-05 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399948+0000", 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9805000000000001e-05 2024-09-21T22:17:28.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15929 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 966656~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338794203999996, 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012023094999999999, 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.787 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15929 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388046+0000", 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388047+0000", 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388048+0000", 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.832e-06 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388054+0000", 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7359999999999998e-06 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388064+0000", 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9180000000000006e-06 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.399969+0000", 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011905396 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400012+0000", 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2429000000000003e-05 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400069+0000", 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7423999999999998e-05 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15930 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1097728~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338770052000001, 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012123831999999999, 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.791 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15930 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388070+0000", 2024-09-21T22:17:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388071+0000", 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388073+0000", 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.877e-06 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388080+0000", 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3540000000000002e-06 2024-09-21T22:17:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388087+0000", 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5549999999999997e-06 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400089+0000", 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012001918 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400134+0000", 2024-09-21T22:17:28.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4912e-05 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400194+0000", 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9806000000000003e-05 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15931 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1179648~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:28.795 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338746274000002, 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012253455, 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15931 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388094+0000", 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388095+0000", 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388097+0000", 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.001e-06 2024-09-21T22:17:28.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388103+0000", 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2269999999999998e-06 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388107+0000", 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.724e-06 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400216+0000", 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012108633000000001 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400272+0000", 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.588e-05 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400348+0000", 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5561000000000004e-05 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.799 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15932 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1261568~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338727298999999, 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012440102, 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15932 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388113+0000", 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388115+0000", 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388121+0000", 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1040000000000003e-06 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388126+0000", 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400380+0000", 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012254312 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400445+0000", 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5166000000000006e-05 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400553+0000", 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107793 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.803 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15933 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1310720~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338708549000003, 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012537161, 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15933 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.804 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388132+0000", 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388134+0000", 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8729999999999999e-06 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388141+0000", 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7920000000000004e-06 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388145+0000", 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400571+0000", 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012425983 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400613+0000", 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1785000000000001e-05 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400669+0000", 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6079999999999998e-05 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15934 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1392640~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338676465999995, 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012723866, 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15934 2024-09-21T22:17:28.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388164+0000", 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:17:28.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388166+0000", 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7740000000000001e-06 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388170+0000", 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1930000000000003e-06 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388173+0000", 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6970000000000002e-06 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400699+0000", 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012526539999999999 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400777+0000", 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7919999999999999e-05 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400888+0000", 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011043 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15935 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1474560~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338663479000004, 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012853365, 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.812 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15935 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:28.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388177+0000", 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388178+0000", 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.184e-06 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388182+0000", 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1870000000000001e-06 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388184+0000", 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4269999999999998e-06 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400910+0000", 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012726314000000001 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.400954+0000", 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4150999999999998e-05 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401030+0000", 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5751e-05 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:15936 3.a 3:528b3d32:::rbd_data.11854f79dd7.000000000000001b:d [read 1556480~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 83.338653230000006, 2024-09-21T22:17:28.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013076727, 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 15936 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388187+0000", 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388188+0000", 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.062e-06 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388192+0000", 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.366e-06 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.388194+0000", 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3499999999999999e-06 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401070+0000", 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012875737999999999 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401156+0000", 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5866999999999996e-05 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:05.401264+0000", 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000108132 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97073 3.d 3:b30a3fcc:::rbd_data.11859a4b084.0000000000000000:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:28.820 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.80209387, 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011897978999999999, 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97073 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:28.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924746+0000", 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.924748+0000", 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.147e-06 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:28.822 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928499+0000", 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037514219999999999 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928513+0000", 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4032000000000001e-05 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928520+0000", 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3409999999999997e-06 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:28.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928582+0000", 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1748000000000006e-05 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928728+0000", 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000145523 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.928881+0000", 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015284599999999999 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.932050+0000", 2024-09-21T22:17:28.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031697330000000001 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936518+0000", 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0044676120000000001 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936587+0000", 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8783999999999997e-05 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:43.936644+0000", 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7791000000000003e-05 2024-09-21T22:17:28.825 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.826 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.826 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.826 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:28.826 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:28.826 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:28.827 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:28.828 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:28.826+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:28.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:17:28.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:28.951+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:28.976 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:28.976 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:28.976 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:28.976 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:28.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:28.988 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:28.988 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:28.988 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:17:28.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:17:29.032 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:29.031+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:29.083 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-21T22:17:29.092 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:29.092 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:29.092 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:29.092 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:29.092 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:29.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:29.144 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:29.142+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:29.205 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803927170999998, 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.206 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:17:29.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:17:29.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803881552, 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.210 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:17:29.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803808818999997, 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.215 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803761942000001, 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.219 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803697202000002, 2024-09-21T22:17:29.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.227 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803660973, 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803567045999998, 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:17:29.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803543277999999, 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803478407, 2024-09-21T22:17:29.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803440784000003, 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:17:29.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:17:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803399990999999, 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.249 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:29.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803324529999998, 2024-09-21T22:17:29.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:29.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:17:29.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803254156999998, 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.258 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:17:29.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803220482, 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.262 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:29.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:29.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:17:29.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803151730000003, 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:17:29.266 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.270 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803107334000003, 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:17:29.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:17:29.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.803016386000003, 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:17:29.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:29.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:17:29.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.802987862000002, 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.279 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.802955568000002, 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.283 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:17:29.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.802917434999998, 2024-09-21T22:17:29.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:17:29.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:17:29.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:29.291 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:29.292 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:29.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:29.293 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:29.291+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:29.295 INFO:teuthology.orchestra.run.smithi134.stdout:4337 writesame 0xdbe0a6a thru 0xdbe7e45 data_size 0xa(0x73dc bytes) 2024-09-21T22:17:29.296 INFO:teuthology.orchestra.run.smithi134.stdout:4338 read 0xbf8dbbb thru 0xbf96637 (0x8a7d bytes) 2024-09-21T22:17:29.296 INFO:teuthology.orchestra.run.smithi134.stdout:4339 read 0x67a8ebe thru 0x67b306a (0xa1ad bytes) 2024-09-21T22:17:29.296 INFO:teuthology.orchestra.run.smithi134.stdout:4340 writesame 0x7ed5de2 thru 0x7ed8e6c data_size 0x11(0x308b bytes) 2024-09-21T22:17:29.298 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.298 INFO:teuthology.orchestra.run.smithi134.stdout:4344 read 0xdbc75f2 thru 0xdbc82f6 (0xd05 bytes) 2024-09-21T22:17:29.298 INFO:teuthology.orchestra.run.smithi134.stdout:4345 write 0x76de0bf thru 0x76e7254 (0x9196 bytes) 2024-09-21T22:17:29.310 INFO:teuthology.orchestra.run.smithi134.stdout:4346 write 0xebc17db thru 0xebcfb63 (0xe389 bytes) 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 131, 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:17:28.951748+0000", 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:59.900683+0000", 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:16:44.923178+0000", 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:17:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5806080, 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "nodeep-scrub", 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "noscrub", 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 5, 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 3, 2024-09-21T22:17:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "luminous", 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:17:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 6.9000000953674316, 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 6.9000000953674316, 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.28999999165534973, 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:17:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:17:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 2.630000114440918, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 2.630000114440918, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "pool_client.0", 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:34.502611+0000", 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:17:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 32, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 32, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 32, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 32, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 32, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:17:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "131", 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 54, 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 131, 2024-09-21T22:17:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:17:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:17:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.75, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.75, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1.1399999856948853, 2024-09-21T22:17:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.875, 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 1, 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 129, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:17:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:17:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 116, 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:17:29.348 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 13, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 26, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 45, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 27, 2024-09-21T22:17:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.351 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.353 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.354 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/704257458", 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/704257458", 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/704257458", 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/704257458", 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.355 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 115, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.356 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:17:29.360 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 0, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.361 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.362 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.363 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.365 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:17:29.366 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.367 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.368 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.369 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.370 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:17:29.371 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:17:29.372 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:17:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:17:29.375 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:17:29.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:17:29.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.378 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:17:29.379 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 27 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:29.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:17:29.382 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [ 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.1", 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:29.383 INFO:teuthology.orchestra.run.smithi134.stdout: 0, 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: 1 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.d", 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: 6, 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: 0 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.11", 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: 7 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.16", 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: 2 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:17:29.385 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.386 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [ 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 50, 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 52, 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 54, 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:29.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [ 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 54, 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.388 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [], 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.389 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:29.390 INFO:teuthology.orchestra.run.smithi134.stdout:4347 read 0xee376f thru 0xeef50e (0xbda0 bytes) 2024-09-21T22:17:29.390 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.390 INFO:teuthology.orchestra.run.smithi134.stdout:4349 read 0xd8f750c thru 0xd9000b1 (0x8ba6 bytes) 2024-09-21T22:17:29.390 INFO:teuthology.orchestra.run.smithi134.stdout:4350 read 0xd98fd9e thru 0xd99f2dd (0xf540 bytes) 2024-09-21T22:17:29.390 INFO:teuthology.orchestra.run.smithi134.stdout:4352 trunc from 0xebcfb64 to 0x43d8b01 2024-09-21T22:17:29.392 INFO:tasks.thrashosds.thrasher:j is {'epoch': 131, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:17:28.951748+0000', 'last_up_change': '2024-09-21T22:15:59.900683+0000', 'last_in_change': '2024-09-21T22:16:44.923178+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:15:34.502611+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 54, 'snap_epoch': 131, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 26, 'up_from': 45, 'up_thru': 101, 'down_at': 27, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 704257458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 704257458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 704257458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 704257458}]}, 'public_addr': '172.21.15.134:6809/704257458', 'cluster_addr': '172.21.15.134:6811/704257458', 'heartbeat_back_addr': '172.21.15.134:6815/704257458', 'heartbeat_front_addr': '172.21.15.134:6813/704257458', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 27}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.1', 'osds': [0, 1]}, {'pgid': '3.d', 'osds': [6, 0]}, {'pgid': '3.11', 'osds': [1, 7]}, {'pgid': '3.16', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 50, 'length': 1}, {'begin': 52, 'length': 1}, {'begin': 54, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 54, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:17:29.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:17:29.394 INFO:teuthology.orchestra.run.smithi134.stdout:4353 read 0x1ca6cc7 thru 0x1ca77d6 (0xb10 bytes) 2024-09-21T22:17:29.394 INFO:teuthology.orchestra.run.smithi134.stdout:4356 read 0x389ebf4 thru 0x38a2add (0x3eea bytes) 2024-09-21T22:17:29.394 INFO:teuthology.orchestra.run.smithi134.stdout:4358 write 0x6094f65 thru 0x609bc48 (0x6ce4 bytes) 2024-09-21T22:17:29.394 INFO:teuthology.orchestra.run.smithi134.stdout:4359 read 0x276285e thru 0x2772215 (0xf9b8 bytes) 2024-09-21T22:17:29.394 INFO:teuthology.orchestra.run.smithi134.stdout:4361 writesame 0x1000bf2 thru 0x1000f23 data_size 0x1(0x332 bytes) 2024-09-21T22:17:29.394 INFO:teuthology.orchestra.run.smithi134.stdout:4366 write 0xb5273f9 thru 0xb533050 (0xbc58 bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4368 read 0x8ca1ce7 thru 0x8cb056f (0xe889 bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4370 write 0x7d269c6 thru 0x7d317d8 (0xae13 bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4371 read 0x5558930 thru 0x555e1b3 (0x5884 bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4373 writesame 0x791574a thru 0x79196f4 data_size 0x3(0x3fab bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4374 write 0xb95fbc thru 0xb981a5 (0x21ea bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4376 write 0xc754189 thru 0xc754a75 (0x8ed bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4378 punch from 0xa6801ef to 0xa6869bf, (0x67d0 bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4379 read 0x584ea3a thru 0x58571d2 (0x8799 bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4380 write 0x9ada617 thru 0x9ae7480 (0xce6a bytes) 2024-09-21T22:17:29.395 INFO:teuthology.orchestra.run.smithi134.stdout:4383 write 0x1c112c0 thru 0x1c159f4 (0x4735 bytes) 2024-09-21T22:17:29.396 INFO:teuthology.orchestra.run.smithi134.stdout:4384 punch from 0xbbd8616 to 0xbbdfa45, (0x742f bytes) 2024-09-21T22:17:29.396 INFO:teuthology.orchestra.run.smithi134.stdout:4385 read 0x2fc8559 thru 0x2fd5e67 (0xd90f bytes) 2024-09-21T22:17:29.396 INFO:teuthology.orchestra.run.smithi134.stdout:4386 trunc from 0xc754a76 to 0x55cd314 2024-09-21T22:17:29.397 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:29.395+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:29.415 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:29.415 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:29.415 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:29.415 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:29.420 INFO:teuthology.orchestra.run.smithi134.stdout:4387 write 0xb9f6216 thru 0xb9f96ff (0x34ea bytes) 2024-09-21T22:17:29.423 INFO:teuthology.orchestra.run.smithi134.stdout:4388 writesame 0x780a2b9 thru 0x78108f9 data_size 0x1(0x6641 bytes) 2024-09-21T22:17:29.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:29.438 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.438 INFO:teuthology.orchestra.run.smithi134.stdout:4391 read 0x5fe4e8f thru 0x5fe5379 (0x4eb bytes) 2024-09-21T22:17:29.439 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.439 INFO:teuthology.orchestra.run.smithi134.stdout:4394 read 0x7628483 thru 0x763318a (0xad08 bytes) 2024-09-21T22:17:29.439 INFO:teuthology.orchestra.run.smithi134.stdout:4395 write 0x9b43bb6 thru 0x9b4b8f8 (0x7d43 bytes) 2024-09-21T22:17:29.442 INFO:teuthology.orchestra.run.smithi134.stdout:4398 punch from 0x7938c3f to 0x794601e, (0xd3df bytes) 2024-09-21T22:17:29.454 INFO:teuthology.orchestra.run.smithi134.stdout:4399 trunc from 0xb9f9700 to 0x19bb1dd 2024-09-21T22:17:29.467 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.467 INFO:teuthology.orchestra.run.smithi134.stdout:4401 punch from 0x113c4d2 to 0x11459fe, (0x952c bytes) 2024-09-21T22:17:29.478 INFO:teuthology.orchestra.run.smithi134.stdout:4402 write 0x65a16a9 thru 0x65a9bb5 (0x850d bytes) 2024-09-21T22:17:29.481 INFO:teuthology.orchestra.run.smithi134.stdout:4404 write 0x4da39e2 thru 0x4db0f9f (0xd5be bytes) 2024-09-21T22:17:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:4406 write 0xd36a9c8 thru 0xd37a6bf (0xfcf8 bytes) 2024-09-21T22:17:29.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:29.496+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:4408 punch from 0x8dac6bb to 0x8db6ec0, (0xa805 bytes) 2024-09-21T22:17:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:4409 read 0xd0fd405 thru 0xd108e0c (0xba08 bytes) 2024-09-21T22:17:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:4410 punch from 0x13db787 to 0x13dc0d0, (0x949 bytes) 2024-09-21T22:17:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:4411 punch from 0x33828d0 to 0x3390f39, (0xe669 bytes) 2024-09-21T22:17:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:4412 punch from 0x8d99d82 to 0x8da3d14, (0x9f92 bytes) 2024-09-21T22:17:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:4414 punch from 0xaf5c53f to 0xaf63c08, (0x76c9 bytes) 2024-09-21T22:17:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:4416 write 0x8210dc7 thru 0x821a701 (0x993b bytes) 2024-09-21T22:17:29.501 INFO:teuthology.orchestra.run.smithi134.stdout:4417 read 0x5a69a31 thru 0x5a73b23 (0xa0f3 bytes) 2024-09-21T22:17:29.501 INFO:teuthology.orchestra.run.smithi134.stdout:4418 punch from 0x621b02c to 0x622284c, (0x7820 bytes) 2024-09-21T22:17:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:4419 punch from 0x70f5a9c to 0x71043e8, (0xe94c bytes) 2024-09-21T22:17:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:4422 read 0x8ea7918 thru 0x8eb0111 (0x87fa bytes) 2024-09-21T22:17:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:4423 read 0x180e0ca thru 0x18166f8 (0x862f bytes) 2024-09-21T22:17:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.503 INFO:teuthology.orchestra.run.smithi134.stdout:4427 writesame 0x4f454b0 thru 0x4f458f5 data_size 0x1(0x446 bytes) 2024-09-21T22:17:29.504 INFO:teuthology.orchestra.run.smithi134.stdout:4430 write 0x5189372 thru 0x51908a2 (0x7531 bytes) 2024-09-21T22:17:29.513 INFO:teuthology.orchestra.run.smithi134.stdout:4431 trunc from 0xd37a6c0 to 0x6cc9106 2024-09-21T22:17:29.524 INFO:teuthology.orchestra.run.smithi134.stdout:4432 read 0x3a3915d thru 0x3a3df13 (0x4db7 bytes) 2024-09-21T22:17:29.524 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.524 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.535 INFO:teuthology.orchestra.run.smithi134.stdout:4435 writesame 0xb450234 thru 0xb45bd87 data_size 0x26(0xbb54 bytes) 2024-09-21T22:17:29.537 INFO:teuthology.orchestra.run.smithi134.stdout:4436 trunc from 0xb45bd88 to 0xcff9086 2024-09-21T22:17:29.542 INFO:teuthology.orchestra.run.smithi134.stdout:4437 punch from 0x6fce3c1 to 0x6fd3c27, (0x5866 bytes) 2024-09-21T22:17:29.543 INFO:teuthology.orchestra.run.smithi134.stdout:4440 write 0x21d2171 thru 0x21e0499 (0xe329 bytes) 2024-09-21T22:17:29.544 INFO:teuthology.orchestra.run.smithi134.stdout:4441 write 0x214ac6f thru 0x2154b74 (0x9f06 bytes) 2024-09-21T22:17:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:4442 write 0x75fea98 thru 0x760c4f9 (0xda62 bytes) 2024-09-21T22:17:29.560 INFO:teuthology.orchestra.run.smithi134.stdout:4444 trunc from 0xcff9086 to 0x3651752 2024-09-21T22:17:29.563 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:29.563 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:29.563 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:29.563 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:29.563 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:29.571 INFO:teuthology.orchestra.run.smithi134.stdout:4445 read 0x7ba01 thru 0x7e86f (0x2e6f bytes) 2024-09-21T22:17:29.572 INFO:teuthology.orchestra.run.smithi134.stdout:4446 write 0x1c03d3c thru 0x1c0498d (0xc52 bytes) 2024-09-21T22:17:29.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:29.574 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.574 INFO:teuthology.orchestra.run.smithi134.stdout:4449 read 0x2363096 thru 0x236b4fb (0x8466 bytes) 2024-09-21T22:17:29.574 INFO:teuthology.orchestra.run.smithi134.stdout:4450 read 0xc7bc6d thru 0xc7e1ab (0x253f bytes) 2024-09-21T22:17:29.574 INFO:teuthology.orchestra.run.smithi134.stdout:4452 read 0x271824a thru 0x271b214 (0x2fcb bytes) 2024-09-21T22:17:29.580 INFO:teuthology.orchestra.run.smithi134.stdout:4453 trunc from 0x3651752 to 0x80868ee 2024-09-21T22:17:29.585 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.585 INFO:teuthology.orchestra.run.smithi134.stdout:4455 read 0x7b1b66b thru 0x7b2766a (0xc000 bytes) 2024-09-21T22:17:29.585 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.586 INFO:teuthology.orchestra.run.smithi134.stdout:4460 write 0x6fc9582 thru 0x6fca129 (0xba8 bytes) 2024-09-21T22:17:29.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:29.597+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:29.601 INFO:teuthology.orchestra.run.smithi134.stdout:4461 write 0xeb37ac1 thru 0xeb3e32b (0x686b bytes) 2024-09-21T22:17:29.620 INFO:teuthology.orchestra.run.smithi134.stdout:4462 trunc from 0xeb3e32c to 0x1bc22d7 2024-09-21T22:17:29.637 INFO:teuthology.orchestra.run.smithi134.stdout:4464 write 0x2236ce0 thru 0x2243642 (0xc963 bytes) 2024-09-21T22:17:29.647 INFO:teuthology.orchestra.run.smithi134.stdout:4465 write 0x4376ef2 thru 0x4378fa1 (0x20b0 bytes) 2024-09-21T22:17:29.661 INFO:teuthology.orchestra.run.smithi134.stdout:4466 trunc from 0x4378fa2 to 0xe156148 2024-09-21T22:17:29.667 INFO:teuthology.orchestra.run.smithi134.stdout:4467 write 0x5f8b859 thru 0x5f8d68b (0x1e33 bytes) 2024-09-21T22:17:29.668 INFO:teuthology.orchestra.run.smithi134.stdout:4469 read 0x3c9a35d thru 0x3ca90ab (0xed4f bytes) 2024-09-21T22:17:29.668 INFO:teuthology.orchestra.run.smithi134.stdout:4471 read 0x2f79f96 thru 0x2f7c98a (0x29f5 bytes) 2024-09-21T22:17:29.668 INFO:teuthology.orchestra.run.smithi134.stdout:4472 read 0x1344ded thru 0x134d19e (0x83b2 bytes) 2024-09-21T22:17:29.669 INFO:teuthology.orchestra.run.smithi134.stdout:4474 read 0x68e4302 thru 0x68eebd7 (0xa8d6 bytes) 2024-09-21T22:17:29.669 INFO:teuthology.orchestra.run.smithi134.stdout:4475 writesame 0x161da7f thru 0x16228b8 data_size 0x26(0x4e3a bytes) 2024-09-21T22:17:29.685 INFO:teuthology.orchestra.run.smithi134.stdout:4476 trunc from 0xe156148 to 0x211a811 2024-09-21T22:17:29.692 INFO:teuthology.orchestra.run.smithi134.stdout:4477 punch from 0x1c5baae to 0x1c5e2f1, (0x2843 bytes) 2024-09-21T22:17:29.692 INFO:teuthology.orchestra.run.smithi134.stdout:4480 punch from 0x1941cc9 to 0x194319f, (0x14d6 bytes) 2024-09-21T22:17:29.693 INFO:teuthology.orchestra.run.smithi134.stdout:4481 write 0xdedcc3 thru 0xdf01c7 (0x2505 bytes) 2024-09-21T22:17:29.699 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:29.697+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:29.699 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:29.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.785431263999996, 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.700 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.782809190999998, 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14151 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2244608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:29.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.497272496999997, 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016170106, 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14151 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198343+0000", 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198345+0000", 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198352+0000", 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198357+0000", 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214323+0000", 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015966351 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214405+0000", 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1437e-05 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214513+0000", 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010819600000000001 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14152 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.497249382999996, 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016468325999999998, 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14152 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:29.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198366+0000", 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198369+0000", 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3609999999999999e-06 2024-09-21T22:17:29.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198375+0000", 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.198379+0000", 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4719999999999997e-06 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214566+0000", 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016186918000000002 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214648+0000", 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2031000000000001e-05 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.214834+0000", 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018601699999999999 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14288 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.476129942, 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016189756, 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14288 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:29.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219485+0000", 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000001e-07 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219487+0000", 2024-09-21T22:17:29.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0440000000000001e-06 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219491+0000", 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5340000000000001e-06 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219495+0000", 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235444+0000", 2024-09-21T22:17:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015949545999999998 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235539+0000", 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4945999999999995e-05 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235675+0000", 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135721 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14289 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4046848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.476114832999997, 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413332999999999, 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14289 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219500+0000", 2024-09-21T22:17:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219501+0000", 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219502+0000", 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7850000000000001e-06 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219508+0000", 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6659999999999996e-06 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219512+0000", 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2950000000000004e-06 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235792+0000", 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016279420999999999 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235847+0000", 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5228e-05 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235914+0000", 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6607999999999997e-05 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14290 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:d [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.476096538999997, 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016558132999999999, 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14290 2024-09-21T22:17:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219519+0000", 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219521+0000", 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219527+0000", 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4970000000000001e-06 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.219531+0000", 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235945+0000", 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016413967000000002 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.235988+0000", 2024-09-21T22:17:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3112000000000003e-05 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236077+0000", 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9036999999999995e-05 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:14291 3.7 3:e54365b5:::rbd_data.11854f79dd7.000000000000000c:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.475439804000004, 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016046033000000001, 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14291 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220175+0000", 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220176+0000", 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.71e-07 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220181+0000", 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220194+0000", 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.220205+0000", 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0421999999999999e-05 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236108+0000", 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015903127 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236166+0000", 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8148e-05 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.236221+0000", 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5399000000000003e-05 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:28999 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.494956506999998, 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026428226999999999, 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 28999 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200659+0000", 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200660+0000", 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2759999999999999e-06 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200666+0000", 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4590000000000003e-06 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200679+0000", 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.241e-05 2024-09-21T22:17:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200686+0000", 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200734+0000", 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7728000000000001e-05 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.200800+0000", 2024-09-21T22:17:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6408999999999994e-05 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.205750+0000", 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049492199999999998 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226938+0000", 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021187968000000001 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.226959+0000", 2024-09-21T22:17:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1233000000000002e-05 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227026+0000", 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6761999999999995e-05 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.227087+0000", 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1291000000000007e-05 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29384 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.027496588999995, 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021779667999999999, 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29384 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668119+0000", 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668120+0000", 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-06 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668125+0000", 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4519999999999996e-06 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668140+0000", 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4948e-05 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668149+0000", 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3189999999999995e-06 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668190+0000", 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1186999999999997e-05 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.668238+0000", 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8204000000000001e-05 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.672298+0000", 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040598730000000003 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689792+0000", 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017494539 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689827+0000", 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4341000000000002e-05 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689863+0000", 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6106999999999998e-05 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:14.689898+0000", 2024-09-21T22:17:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5536e-05 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29953 3.18 3:1ca9b371:::rbd_data.1185b6e976dc.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.327766557000004, 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023690860000000001, 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29953 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367849+0000", 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367850+0000", 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.341e-06 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367856+0000", 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367869+0000", 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2614e-05 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367877+0000", 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-09-21T22:17:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367929+0000", 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1591000000000001e-05 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367988+0000", 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9713999999999998e-05 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.371959+0000", 2024-09-21T22:17:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039704040000000003 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391387+0000", 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019428567000000001 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391456+0000", 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8331999999999996e-05 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391505+0000", 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441000000000003e-05 2024-09-21T22:17:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391540+0000", 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4363999999999998e-05 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:29954 3.18 3:1da5a6eb:::rbd_data.1185b6e976dc.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.327720032000002, 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023692980999999998, 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 29954 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367895+0000", 2024-09-21T22:17:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367896+0000", 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367899+0000", 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7720000000000001e-06 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367909+0000", 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3389999999999999e-06 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.367915+0000", 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388908+0000", 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020992793999999999 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.388974+0000", 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6370000000000003e-05 2024-09-21T22:17:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.389382+0000", 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000408007 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391440+0000", 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020578810000000001 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391547+0000", 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107445 2024-09-21T22:17:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391570+0000", 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2747000000000001e-05 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:15.391588+0000", 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8042000000000001e-05 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:97229 3.b 3:d168bffe:::rbd_data.11859a4b084.0000000000000007:head [write 0~2097152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-21T22:17:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.735601985000002, 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018200561000000001, 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 97229 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960013+0000", 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960015+0000", 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2400000000000002e-06 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960890+0000", 2024-09-21T22:17:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087496899999999996 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960913+0000", 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2918e-05 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.960932+0000", 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8484000000000001e-05 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961011+0000", 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9240999999999996e-05 2024-09-21T22:17:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961165+0000", 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154036 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961308+0000", 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014330699999999999 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977902+0000", 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016593469 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978092+0000", 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019035600000000001 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978169+0000", 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6588000000000006e-05 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978214+0000", 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4953000000000001e-05 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97171 3.c e86/45 3:30c3e70a:::rbd_data.11859a4b084.0000000000000005:head v 86'91, mlcod=84'89)", 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.734266482999999, 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017387495999999999, 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961349+0000", 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.961350+0000", 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.47e-07 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966000+0000", 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046502469999999997 2024-09-21T22:17:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966013+0000", 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.343e-05 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966021+0000", 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5650000000000004e-06 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966094+0000", 2024-09-21T22:17:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2758999999999999e-05 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.966119+0000", 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5287999999999999e-05 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978684+0000", 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012564745 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978736+0000", 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2614999999999997e-05 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101043 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.572280823, 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018053537000000001, 2024-09-21T22:17:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101043 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123334+0000", 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123335+0000", 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123340+0000", 2024-09-21T22:17:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6700000000000002e-06 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123353+0000", 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2779000000000001e-05 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.123360+0000", 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3499999999999999e-06 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126073+0000", 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027131360000000001 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126157+0000", 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3319000000000006e-05 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.126924+0000", 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000767303 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136269+0000", 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093453049999999999 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141278+0000", 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050086949999999996 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141336+0000", 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7901e-05 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141388+0000", 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2135999999999997e-05 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101044 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.571048351999998, 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017384295000000001, 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101044 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124567+0000", 2024-09-21T22:17:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124568+0000", 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0599999999999999e-07 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124573+0000", 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0329999999999999e-06 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124584+0000", 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1569999999999999e-05 2024-09-21T22:17:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.124595+0000", 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0471e-05 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127509+0000", 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002914374 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127599+0000", 2024-09-21T22:17:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9827000000000006e-05 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127978+0000", 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037899500000000003 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.136277+0000", 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082993419999999995 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141448+0000", 2024-09-21T22:17:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051706950000000003 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141521+0000", 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3114999999999994e-05 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.141951+0000", 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043006700000000001 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101058 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.569682481000001, 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018654467000000001, 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101058 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125933+0000", 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125934+0000", 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0400000000000005e-07 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125940+0000", 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125951+0000", 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1600000000000001e-05 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.125958+0000", 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0910000000000004e-06 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129088+0000", 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003129452 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129173+0000", 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4979000000000001e-05 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.129877+0000", 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070436399999999997 2024-09-21T22:17:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137342+0000", 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074651630000000004 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144517+0000", 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071743989999999997 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144563+0000", 2024-09-21T22:17:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6304000000000003e-05 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144587+0000", 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4158000000000001e-05 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:101063 3.8 3:170166ec:::rbd_object_map.1185f120754b.0000000000000024:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.568483780000001, 2024-09-21T22:17:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017538194999999999, 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 101063 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127131+0000", 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127132+0000", 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0200000000000001e-07 2024-09-21T22:17:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127136+0000", 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3000000000000003e-06 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127145+0000", 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1950000000000003e-06 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.127150+0000", 2024-09-21T22:17:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4589999999999997e-06 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130331+0000", 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031804670000000002 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130404+0000", 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3003999999999994e-05 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.130969+0000", 2024-09-21T22:17:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056533799999999997 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.137356+0000", 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063868520000000002 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144623+0000", 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072671100000000002 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144649+0000", 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5876000000000001e-05 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:53.144670+0000", 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0891999999999999e-05 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:115491 3.c 3:3744ba9d:::rbd_data.1185a576a45b.0000000000000184:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.53116112, 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017507090999999999, 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 115491 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164454+0000", 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164455+0000", 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2500000000000005e-07 2024-09-21T22:17:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164459+0000", 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164470+0000", 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696999999999999e-05 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164475+0000", 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6339999999999998e-06 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164523+0000", 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7370999999999998e-05 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.164575+0000", 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2265000000000002e-05 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.168121+0000", 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035460930000000002 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181840+0000", 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013718895 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181883+0000", 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2870000000000001e-05 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181923+0000", 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197000000000002e-05 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:06.181961+0000", 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8071000000000002e-05 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:123964 3.b 3:d70cca8c:::rbd_data.1185d4b09229.0000000000000000:head [write 0~3670016 [fadvise_sequential+fadvise_nocache],zero 3670016~32768,write 3702784~65536 [fadvise_sequential+fadvise_nocache],zero 3768320~65536,write 3833856~65536 [fadvise_sequential+fadvise_nocache],zero 3899392~32768,write 3932160~65536 [fadvise_sequential+fadvise_nocache],zero 3997696~65536,write 4063232~65536 [fadvise_sequential+fadvise_nocache],zero 4128768~32768,write 4161536~32768 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.946089+0000", 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7495261180000004, 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020461818, 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 123964 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.946089+0000", 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.946089+0000", 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.946091+0000", 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.731e-06 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.948353+0000", 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022624149999999998 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.948371+0000", 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7762e-05 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.948379+0000", 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1899999999999995e-06 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.948444+0000", 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5188e-05 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.948683+0000", 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023855400000000001 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.949280+0000", 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059722699999999998 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958377+0000", 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090972610000000006 2024-09-21T22:17:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.966466+0000", 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080885999999999996 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.966514+0000", 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7933999999999999e-05 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.966551+0000", 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6956000000000003e-05 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:29.802 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:29.802 INFO:teuthology.orchestra.run.smithi134.stdout:4482 write 0x4fe30de thru 0x4fef6ce (0xc5f1 bytes) 2024-09-21T22:17:29.803 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:29.804 INFO:teuthology.orchestra.run.smithi134.stdout:4486 trunc from 0x4fef6cf to 0xa4bfba7 2024-09-21T22:17:29.804 INFO:teuthology.orchestra.run.smithi134.stdout:4487 read 0x7c119f8 thru 0x7c1a08a (0x8693 bytes) 2024-09-21T22:17:29.804 INFO:teuthology.orchestra.run.smithi134.stdout:4488 trunc from 0xa4bfba7 to 0xf8c6c9 2024-09-21T22:17:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:29.805 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:17:29.806 INFO:teuthology.orchestra.run.smithi134.stdout:4489 read 0xc5e5ea thru 0xc696d2 (0xb0e9 bytes) 2024-09-21T22:17:29.806 INFO:teuthology.orchestra.run.smithi134.stdout:4490 trunc from 0xf8c6c9 to 0x2512437 2024-09-21T22:17:29.807 INFO:teuthology.orchestra.run.smithi134.stdout:4491 punch from 0x2500d29 to 0x250bed5, (0xb1ac bytes) 2024-09-21T22:17:29.807 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-21T22:17:29.194041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":948734119,"num_objects":749,"num_object_clones":0,"num_object_copies":1498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":749,"num_whiteouts":0,"num_read":124341,"num_read_kb":824914,"num_write":19370,"num_write_kb":608612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1213,"num_bytes_recovered":142274642,"num_keys_recovered":223,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13620,"ondisk_log_size":13620,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":883308,"kb_used_data":500776,"kb_used_omap":15,"kb_used_meta":382256,"kb_avail":754091412,"statfs":{"total":773094113280,"available":772189605888,"internally_reserved":0,"allocated":512794624,"data_stored":504013379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":391430940},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15729784,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":564,"num_read_kb":10994,"num_write":53,"num_write_kb":4553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000634"},"pg_stats":[{"pgid":"3.1f","version":"125'1093","reported_seq":10289,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.941556+0000","last_change":"2024-09-21T22:17:23.941556+0000","last_active":"2024-09-21T22:17:23.941556+0000","last_peered":"2024-09-21T22:17:23.941556+0000","last_clean":"2024-09-21T22:17:23.941556+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:17:23.941556+0000","last_undegraded":"2024-09-21T22:17:23.941556+0000","last_fullsized":"2024-09-21T22:17:23.941556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:49:32.547198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052706699999999999,"stat_sum":{"num_bytes":45441371,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":12954,"num_read_kb":45692,"num_write":1946,"num_write_kb":25064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.1e","version":"123'431","reported_seq":3514,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.893432+0000","last_change":"2024-09-21T22:17:23.938289+0000","last_active":"2024-09-21T22:17:27.893432+0000","last_peered":"2024-09-21T22:17:27.893432+0000","last_clean":"2024-09-21T22:17:27.893432+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:17:27.893432+0000","last_undegraded":"2024-09-21T22:17:27.893432+0000","last_fullsized":"2024-09-21T22:17:27.893432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:02:54.370252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012135239999999999,"stat_sum":{"num_bytes":25777929,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3988,"num_read_kb":26966,"num_write":436,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.1d","version":"125'275","reported_seq":6784,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.939101+0000","last_change":"2024-09-21T22:17:23.939101+0000","last_active":"2024-09-21T22:17:23.939101+0000","last_peered":"2024-09-21T22:17:23.939101+0000","last_clean":"2024-09-21T22:17:23.939101+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:17:23.939101+0000","last_undegraded":"2024-09-21T22:17:23.939101+0000","last_fullsized":"2024-09-21T22:17:23.939101+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:07:40.802172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698279,"stat_sum":{"num_bytes":53664490,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":6279,"num_read_kb":42714,"num_write":384,"num_write_kb":27565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.1c","version":"124'602","reported_seq":1844,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.939105+0000","last_change":"2024-09-21T22:17:23.939105+0000","last_active":"2024-09-21T22:17:23.939105+0000","last_peered":"2024-09-21T22:17:23.939105+0000","last_clean":"2024-09-21T22:17:23.939105+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:17:23.939105+0000","last_undegraded":"2024-09-21T22:17:23.939105+0000","last_fullsized":"2024-09-21T22:17:23.939105+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:57.558975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067508800000000001,"stat_sum":{"num_bytes":23472309,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2373,"num_read_kb":26572,"num_write":1030,"num_write_kb":24062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.1b","version":"126'287","reported_seq":1770,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.059256+0000","last_change":"2024-09-21T22:17:23.941819+0000","last_active":"2024-09-21T22:17:24.059256+0000","last_peered":"2024-09-21T22:17:24.059256+0000","last_clean":"2024-09-21T22:17:24.059256+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:17:24.059256+0000","last_undegraded":"2024-09-21T22:17:24.059256+0000","last_fullsized":"2024-09-21T22:17:24.059256+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:54:56.559739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090781,"stat_sum":{"num_bytes":20491389,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1710,"num_read_kb":19999,"num_write":371,"num_write_kb":17600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.1a","version":"125'256","reported_seq":2045,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.051038+0000","last_change":"2024-09-21T22:17:23.938885+0000","last_active":"2024-09-21T22:17:24.051038+0000","last_peered":"2024-09-21T22:17:24.051038+0000","last_clean":"2024-09-21T22:17:24.051038+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:17:24.051038+0000","last_undegraded":"2024-09-21T22:17:24.051038+0000","last_fullsized":"2024-09-21T22:17:24.051038+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:03:44.306208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051465899999999999,"stat_sum":{"num_bytes":10241003,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1745,"num_read_kb":11629,"num_write":339,"num_write_kb":14451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.19","version":"126'607","reported_seq":3129,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.944826+0000","last_change":"2024-09-21T22:17:23.943469+0000","last_active":"2024-09-21T22:17:24.944826+0000","last_peered":"2024-09-21T22:17:24.944826+0000","last_clean":"2024-09-21T22:17:24.944826+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:17:24.944826+0000","last_undegraded":"2024-09-21T22:17:24.944826+0000","last_fullsized":"2024-09-21T22:17:24.944826+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:01:21.829881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034409300000000001,"stat_sum":{"num_bytes":15766095,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4866,"num_read_kb":18230,"num_write":705,"num_write_kb":18098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.18","version":"123'641","reported_seq":1783,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.893495+0000","last_change":"2024-09-21T22:17:23.937656+0000","last_active":"2024-09-21T22:17:27.893495+0000","last_peered":"2024-09-21T22:17:27.893495+0000","last_clean":"2024-09-21T22:17:27.893495+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:17:27.893495+0000","last_undegraded":"2024-09-21T22:17:27.893495+0000","last_fullsized":"2024-09-21T22:17:27.893495+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:46:57.341774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001138465,"stat_sum":{"num_bytes":21737168,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2811,"num_read_kb":21169,"num_write":853,"num_write_kb":21827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.17","version":"123'751","reported_seq":1959,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.941640+0000","last_change":"2024-09-21T22:17:23.941855+0000","last_active":"2024-09-21T22:17:23.941640+0000","last_peered":"2024-09-21T22:17:23.941640+0000","last_clean":"2024-09-21T22:17:23.941640+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:17:23.941640+0000","last_undegraded":"2024-09-21T22:17:23.941640+0000","last_fullsized":"2024-09-21T22:17:23.941640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:18.369731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053823200000000003,"stat_sum":{"num_bytes":12281926,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":3847,"num_read_kb":17466,"num_write":1381,"num_write_kb":18353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.16","version":"123'180","reported_seq":13272,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.944950+0000","last_change":"2024-09-21T22:17:23.943689+0000","last_active":"2024-09-21T22:17:24.944950+0000","last_peered":"2024-09-21T22:17:24.944950+0000","last_clean":"2024-09-21T22:17:24.944950+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:17:24.944950+0000","last_undegraded":"2024-09-21T22:17:24.944950+0000","last_fullsized":"2024-09-21T22:17:24.944950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:35:48.035379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052020899999999999,"stat_sum":{"num_bytes":41903551,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13521,"num_read_kb":45965,"num_write":265,"num_write_kb":13478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.15","version":"120'651","reported_seq":2813,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.045856+0000","last_change":"2024-09-21T22:17:24.045856+0000","last_active":"2024-09-21T22:17:24.045856+0000","last_peered":"2024-09-21T22:17:24.045856+0000","last_clean":"2024-09-21T22:17:24.045856+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:17:24.045856+0000","last_undegraded":"2024-09-21T22:17:24.045856+0000","last_fullsized":"2024-09-21T22:17:24.045856+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:02:28.786217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062494199999999997,"stat_sum":{"num_bytes":46423637,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3661,"num_read_kb":28864,"num_write":1016,"num_write_kb":27009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.14","version":"125'305","reported_seq":2602,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.939190+0000","last_change":"2024-09-21T22:17:23.939349+0000","last_active":"2024-09-21T22:17:23.939190+0000","last_peered":"2024-09-21T22:17:23.939190+0000","last_clean":"2024-09-21T22:17:23.939190+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:17:23.939190+0000","last_undegraded":"2024-09-21T22:17:23.939190+0000","last_fullsized":"2024-09-21T22:17:23.939190+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:26:21.284133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076514300000000003,"stat_sum":{"num_bytes":45828706,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1958,"num_read_kb":23880,"num_write":379,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.943702+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:17:23.943702+0000","last_peered":"2024-09-21T22:17:23.943702+0000","last_clean":"2024-09-21T22:17:23.943702+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:17:23.943702+0000","last_undegraded":"2024-09-21T22:17:23.943702+0000","last_fullsized":"2024-09-21T22:17:23.943702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"120'298","reported_seq":2293,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.940930+0000","last_change":"2024-09-21T22:17:23.941157+0000","last_active":"2024-09-21T22:17:23.940930+0000","last_peered":"2024-09-21T22:17:23.940930+0000","last_clean":"2024-09-21T22:17:23.940930+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:17:23.940930+0000","last_undegraded":"2024-09-21T22:17:23.940930+0000","last_fullsized":"2024-09-21T22:17:23.940930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:26:00.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041461299999999998,"stat_sum":{"num_bytes":32213787,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2405,"num_read_kb":30001,"num_write":342,"num_write_kb":21987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":231,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.945023+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:17:24.945023+0000","last_peered":"2024-09-21T22:17:24.945023+0000","last_clean":"2024-09-21T22:17:24.945023+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:17:24.945023+0000","last_undegraded":"2024-09-21T22:17:24.945023+0000","last_fullsized":"2024-09-21T22:17:24.945023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"130'343","reported_seq":1860,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.949112+0000","last_change":"2024-09-21T22:17:23.937622+0000","last_active":"2024-09-21T22:17:27.949112+0000","last_peered":"2024-09-21T22:17:27.949112+0000","last_clean":"2024-09-21T22:17:27.949112+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:17:27.949112+0000","last_undegraded":"2024-09-21T22:17:27.949112+0000","last_fullsized":"2024-09-21T22:17:27.949112+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:42:47.205200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097776799999999995,"stat_sum":{"num_bytes":37957364,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1870,"num_read_kb":20633,"num_write":476,"num_write_kb":18125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.045121+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:17:24.045121+0000","last_peered":"2024-09-21T22:17:24.045121+0000","last_clean":"2024-09-21T22:17:24.045121+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:17:24.045121+0000","last_undegraded":"2024-09-21T22:17:24.045121+0000","last_fullsized":"2024-09-21T22:17:24.045121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"125'385","reported_seq":9295,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.944872+0000","last_change":"2024-09-21T22:17:23.943886+0000","last_active":"2024-09-21T22:17:24.944872+0000","last_peered":"2024-09-21T22:17:24.944872+0000","last_clean":"2024-09-21T22:17:24.944872+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:17:24.944872+0000","last_undegraded":"2024-09-21T22:17:24.944872+0000","last_fullsized":"2024-09-21T22:17:24.944872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:50:24.912337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000360715,"stat_sum":{"num_bytes":40470121,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":9107,"num_read_kb":44342,"num_write":457,"num_write_kb":24707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":231,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.944896+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:17:24.944896+0000","last_peered":"2024-09-21T22:17:24.944896+0000","last_clean":"2024-09-21T22:17:24.944896+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:17:24.944896+0000","last_undegraded":"2024-09-21T22:17:24.944896+0000","last_fullsized":"2024-09-21T22:17:24.944896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"130'216","reported_seq":1875,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.943208+0000","last_change":"2024-09-21T22:17:23.938639+0000","last_active":"2024-09-21T22:17:27.943208+0000","last_peered":"2024-09-21T22:17:27.943208+0000","last_clean":"2024-09-21T22:17:27.943208+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:17:27.943208+0000","last_undegraded":"2024-09-21T22:17:27.943208+0000","last_fullsized":"2024-09-21T22:17:27.943208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:17:23.413532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015438819999999999,"stat_sum":{"num_bytes":25957678,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1228,"num_read_kb":23113,"num_write":333,"num_write_kb":17123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.3","version":"123'274","reported_seq":1937,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.939325+0000","last_change":"2024-09-21T22:17:23.939325+0000","last_active":"2024-09-21T22:17:23.939325+0000","last_peered":"2024-09-21T22:17:23.939325+0000","last_clean":"2024-09-21T22:17:23.939325+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:17:23.939325+0000","last_undegraded":"2024-09-21T22:17:23.939325+0000","last_fullsized":"2024-09-21T22:17:23.939325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:43.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000748835,"stat_sum":{"num_bytes":20631757,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1470,"num_read_kb":23581,"num_write":342,"num_write_kb":18703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":78,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.944861+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:17:24.944861+0000","last_peered":"2024-09-21T22:17:24.944861+0000","last_clean":"2024-09-21T22:17:24.944861+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:17:24.944861+0000","last_undegraded":"2024-09-21T22:17:24.944861+0000","last_fullsized":"2024-09-21T22:17:24.944861+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"123'517","reported_seq":8556,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.944737+0000","last_change":"2024-09-21T22:17:23.944403+0000","last_active":"2024-09-21T22:17:24.944737+0000","last_peered":"2024-09-21T22:17:24.944737+0000","last_clean":"2024-09-21T22:17:24.944737+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:17:24.944737+0000","last_undegraded":"2024-09-21T22:17:24.944737+0000","last_fullsized":"2024-09-21T22:17:24.944737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:53.920346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035781400000000003,"stat_sum":{"num_bytes":68999917,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":8708,"num_read_kb":42536,"num_write":690,"num_write_kb":23414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":234,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:25.021840+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:17:25.021840+0000","last_peered":"2024-09-21T22:17:25.021840+0000","last_clean":"2024-09-21T22:17:25.021840+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:17:25.021840+0000","last_undegraded":"2024-09-21T22:17:25.021840+0000","last_fullsized":"2024-09-21T22:17:25.021840+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"123'345","reported_seq":1820,"reported_epoch":125,"state":"peering","last_fresh":"2024-09-21T22:17:22.934844+0000","last_change":"2024-09-21T22:17:23.941030+0000","last_active":"2024-09-21T22:17:23.941030+0000","last_peered":"2024-09-21T22:17:22.934844+0000","last_clean":"2024-09-21T22:17:22.934844+0000","last_became_active":"2024-09-21T22:16:48.956575+0000","last_became_peered":"2024-09-21T22:16:48.956575+0000","last_unstale":"2024-09-21T22:17:22.934844+0000","last_undegraded":"2024-09-21T22:17:22.934844+0000","last_fullsized":"2024-09-21T22:17:22.934844+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056822600000000002,"stat_sum":{"num_bytes":35026366,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1384,"num_read_kb":22856,"num_write":507,"num_write_kb":22368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6594455,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":227,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.044992+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:17:24.044992+0000","last_peered":"2024-09-21T22:17:24.044992+0000","last_clean":"2024-09-21T22:17:24.044992+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:17:24.044992+0000","last_undegraded":"2024-09-21T22:17:24.044992+0000","last_fullsized":"2024-09-21T22:17:24.044992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"128'219","reported_seq":1015,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.951241+0000","last_change":"2024-09-21T22:17:23.938861+0000","last_active":"2024-09-21T22:17:27.951241+0000","last_peered":"2024-09-21T22:17:27.951241+0000","last_clean":"2024-09-21T22:17:27.951241+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:17:27.951241+0000","last_undegraded":"2024-09-21T22:17:27.951241+0000","last_fullsized":"2024-09-21T22:17:27.951241+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:42:40.105168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015945320000000001,"stat_sum":{"num_bytes":20589917,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":595,"num_read_kb":24411,"num_write":279,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":67,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:25.021847+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:17:25.021847+0000","last_peered":"2024-09-21T22:17:25.021847+0000","last_clean":"2024-09-21T22:17:25.021847+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:17:25.021847+0000","last_undegraded":"2024-09-21T22:17:25.021847+0000","last_fullsized":"2024-09-21T22:17:25.021847+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":380,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.045328+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:17:24.045328+0000","last_peered":"2024-09-21T22:17:24.045328+0000","last_clean":"2024-09-21T22:17:24.045328+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:17:24.045328+0000","last_undegraded":"2024-09-21T22:17:24.045328+0000","last_fullsized":"2024-09-21T22:17:24.045328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"123'555","reported_seq":1605,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.893357+0000","last_change":"2024-09-21T22:17:23.937938+0000","last_active":"2024-09-21T22:17:27.893357+0000","last_peered":"2024-09-21T22:17:27.893357+0000","last_clean":"2024-09-21T22:17:27.893357+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:17:27.893357+0000","last_undegraded":"2024-09-21T22:17:27.893357+0000","last_fullsized":"2024-09-21T22:17:27.893357+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:51.271619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001220643,"stat_sum":{"num_bytes":21676581,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2261,"num_read_kb":14251,"num_write":881,"num_write_kb":17045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.9","version":"120'316","reported_seq":3128,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.938804+0000","last_change":"2024-09-21T22:17:23.938804+0000","last_active":"2024-09-21T22:17:23.938804+0000","last_peered":"2024-09-21T22:17:23.938804+0000","last_clean":"2024-09-21T22:17:23.938804+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:17:23.938804+0000","last_undegraded":"2024-09-21T22:17:23.938804+0000","last_fullsized":"2024-09-21T22:17:23.938804+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:22:03.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000437248,"stat_sum":{"num_bytes":62556077,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3228,"num_read_kb":44551,"num_write":435,"num_write_kb":18665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.a","version":"125'375","reported_seq":2321,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.110276+0000","last_change":"2024-09-21T22:17:23.944121+0000","last_active":"2024-09-21T22:17:24.110276+0000","last_peered":"2024-09-21T22:17:24.110276+0000","last_clean":"2024-09-21T22:17:24.110276+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:17:24.110276+0000","last_undegraded":"2024-09-21T22:17:24.110276+0000","last_fullsized":"2024-09-21T22:17:24.110276+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:27:01.575671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034032099999999998,"stat_sum":{"num_bytes":36115767,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2563,"num_read_kb":20921,"num_write":414,"num_write_kb":14427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.b","version":"123'685","reported_seq":2083,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.893461+0000","last_change":"2024-09-21T22:17:23.937863+0000","last_active":"2024-09-21T22:17:27.893461+0000","last_peered":"2024-09-21T22:17:27.893461+0000","last_clean":"2024-09-21T22:17:27.893461+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:17:27.893461+0000","last_undegraded":"2024-09-21T22:17:27.893461+0000","last_fullsized":"2024-09-21T22:17:27.893461+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:46:42.457007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012155779999999999,"stat_sum":{"num_bytes":17178191,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4200,"num_read_kb":19034,"num_write":947,"num_write_kb":18761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.c","version":"120'156","reported_seq":1035,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-21T22:17:27.893355+0000","last_change":"2024-09-21T22:17:23.938395+0000","last_active":"2024-09-21T22:17:27.893355+0000","last_peered":"2024-09-21T22:17:27.893355+0000","last_clean":"2024-09-21T22:17:27.893355+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:17:27.893355+0000","last_undegraded":"2024-09-21T22:17:27.893355+0000","last_fullsized":"2024-09-21T22:17:27.893355+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:05:44.564745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015149149999999999,"stat_sum":{"num_bytes":35602025,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":576,"num_read_kb":24207,"num_write":182,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.d","version":"126'394","reported_seq":1315,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.051654+0000","last_change":"2024-09-21T22:17:23.945066+0000","last_active":"2024-09-21T22:17:24.051654+0000","last_peered":"2024-09-21T22:17:24.051654+0000","last_clean":"2024-09-21T22:17:24.051654+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:17:24.051654+0000","last_undegraded":"2024-09-21T22:17:24.051654+0000","last_fullsized":"2024-09-21T22:17:24.051654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:44.212072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001273368,"stat_sum":{"num_bytes":12615756,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1486,"num_read_kb":18258,"num_write":598,"num_write_kb":16863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.e","version":"125'180","reported_seq":1000,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.045723+0000","last_change":"2024-09-21T22:17:24.045723+0000","last_active":"2024-09-21T22:17:24.045723+0000","last_peered":"2024-09-21T22:17:24.045723+0000","last_clean":"2024-09-21T22:17:24.045723+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:17:24.045723+0000","last_undegraded":"2024-09-21T22:17:24.045723+0000","last_fullsized":"2024-09-21T22:17:24.045723+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:13:12.861244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049931900000000002,"stat_sum":{"num_bytes":6999584,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":297,"num_read_kb":10972,"num_write":250,"num_write_kb":14679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.f","version":"125'462","reported_seq":1946,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.046079+0000","last_change":"2024-09-21T22:17:24.046079+0000","last_active":"2024-09-21T22:17:24.046079+0000","last_peered":"2024-09-21T22:17:24.046079+0000","last_clean":"2024-09-21T22:17:24.046079+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:17:24.046079+0000","last_undegraded":"2024-09-21T22:17:24.046079+0000","last_fullsized":"2024-09-21T22:17:24.046079+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:23:51.855128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048878599999999995,"stat_sum":{"num_bytes":17662559,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2202,"num_read_kb":13921,"num_write":584,"num_write_kb":15967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.10","version":"120'234","reported_seq":1567,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.943880+0000","last_change":"2024-09-21T22:17:23.944096+0000","last_active":"2024-09-21T22:17:23.943880+0000","last_peered":"2024-09-21T22:17:23.943880+0000","last_clean":"2024-09-21T22:17:23.943880+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:17:23.943880+0000","last_undegraded":"2024-09-21T22:17:23.943880+0000","last_fullsized":"2024-09-21T22:17:23.943880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:34:44.131102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034436299999999998,"stat_sum":{"num_bytes":22571921,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1051,"num_read_kb":18544,"num_write":273,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.11","version":"125'568","reported_seq":1654,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.944816+0000","last_change":"2024-09-21T22:17:23.943449+0000","last_active":"2024-09-21T22:17:24.944816+0000","last_peered":"2024-09-21T22:17:24.944816+0000","last_clean":"2024-09-21T22:17:24.944816+0000","last_became_active":"2024-09-21T22:17:14.901471+0000","last_became_peered":"2024-09-21T22:17:14.901471+0000","last_unstale":"2024-09-21T22:17:24.944816+0000","last_undegraded":"2024-09-21T22:17:24.944816+0000","last_fullsized":"2024-09-21T22:17:24.944816+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:33:16.111910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034136799999999999,"stat_sum":{"num_bytes":13928872,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2597,"num_read_kb":16820,"num_write":879,"num_write_kb":17438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":16112633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.12","version":"125'381","reported_seq":6157,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:23.940990+0000","last_change":"2024-09-21T22:17:23.941169+0000","last_active":"2024-09-21T22:17:23.940990+0000","last_peered":"2024-09-21T22:17:23.940990+0000","last_clean":"2024-09-21T22:17:23.940990+0000","last_became_active":"2024-09-21T22:15:36.448888+0000","last_became_peered":"2024-09-21T22:15:36.448888+0000","last_unstale":"2024-09-21T22:17:23.940990+0000","last_undegraded":"2024-09-21T22:17:23.940990+0000","last_fullsized":"2024-09-21T22:17:23.940990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.833586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033361900000000001,"stat_sum":{"num_bytes":16869834,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6316,"num_read_kb":17447,"num_write":506,"num_write_kb":15417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]},{"pgid":"3.13","version":"125'518","reported_seq":10511,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T22:17:24.045332+0000","last_change":"2024-09-21T22:17:24.045579+0000","last_active":"2024-09-21T22:17:24.045332+0000","last_peered":"2024-09-21T22:17:24.045332+0000","last_clean":"2024-09-21T22:17:24.045332+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:17:24.045332+0000","last_undegraded":"2024-09-21T22:17:24.045332+0000","last_fullsized":"2024-09-21T22:17:24.045332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:10.239935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043246799999999998,"stat_sum":{"num_bytes":39490084,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":10968,"num_read_kb":45269,"num_write":729,"num_write_kb":17447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":948143732,"num_objects":745,"num_object_clones":0,"num_object_copies":1490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":124225,"num_read_kb":824814,"num_write":19209,"num_write_kb":606194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1213,"num_bytes_recovered":142274642,"num_keys_recovered":223,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499527680,"data_stored":497024086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13500,"ondisk_log_size":13500,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98064,"kb_used_data":52984,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94273776,"statfs":{"total":96636764160,"available":96536346624,"internally_reserved":0,"allocated":54255616,"data_stored":53172442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58664,"kb_used_data":23284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94313176,"statfs":{"total":96636764160,"available":96576692224,"internally_reserved":0,"allocated":23842816,"data_stored":22912113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125160,"kb_used_data":63436,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94246680,"statfs":{"total":96636764160,"available":96508600320,"internally_reserved":0,"allocated":64958464,"data_stored":63872432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145640,"kb_used_data":92212,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94226200,"statfs":{"total":96636764160,"available":96487628800,"internally_reserved":0,"allocated":94425088,"data_stored":93182840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528339,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124476,"kb_used_data":79716,"kb_used_omap":4,"kb_used_meta":44731,"kb_avail":94247364,"statfs":{"total":96636764160,"available":96509300736,"internally_reserved":0,"allocated":81629184,"data_stored":80376324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":45805234},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73948,"kb_used_data":38596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94297892,"statfs":{"total":96636764160,"available":96561041408,"internally_reserved":0,"allocated":39522304,"data_stored":38537256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105624,"kb_used_data":66112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94266216,"statfs":{"total":96636764160,"available":96528605184,"internally_reserved":0,"allocated":67698688,"data_stored":66603732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151732,"kb_used_data":84436,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94220108,"statfs":{"total":96636764160,"available":96481390592,"internally_reserved":0,"allocated":86462464,"data_stored":85356240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84373504,"data_stored":84046858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":66187264,"data_stored":65878295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38002688,"data_stored":37805799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":80072704,"data_stored":79626154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":92930048,"data_stored":92463826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63459328,"data_stored":63153399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22347776,"data_stored":22193099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":52154368,"data_stored":51856656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:17:29.810 INFO:tasks.thrashosds.thrasher:Setting 3.5 to [5, 3] 2024-09-21T22:17:29.810 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.5', '5', '3'] 2024-09-21T22:17:29.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.5 5 3 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4492 write 0x546c2c5 thru 0x5477bf7 (0xb933 bytes) 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4493 read 0x4c0193e thru 0x4c0a8f0 (0x8fb3 bytes) 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4497 write 0xb20b7f6 thru 0xb218cc7 (0xd4d2 bytes) 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4499 write 0x34248a thru 0x34e21b (0xbd92 bytes) 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4500 write 0xa044788 thru 0xa04dd1a (0x9593 bytes) 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4502 write 0x7bcd27e thru 0x7bdcb4b (0xf8ce bytes) 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4503 writesame 0x9575c0a thru 0x957adf6 data_size 0x1(0x51ed bytes) 2024-09-21T22:17:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:4504 trunc from 0xb218cc8 to 0x170ca00 2024-09-21T22:17:29.812 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:29.801+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:29.822 INFO:teuthology.orchestra.run.smithi134.stdout:4505 write 0x5de6856 thru 0x5defd82 (0x952d bytes) 2024-09-21T22:17:29.829 INFO:teuthology.orchestra.run.smithi134.stdout:4506 trunc from 0x5defd83 to 0xb3a9106 2024-09-21T22:17:29.841 INFO:teuthology.orchestra.run.smithi134.stdout:4507 writesame 0xc2d3f42 thru 0xc2e35e3 data_size 0x33(0xf6a2 bytes) 2024-09-21T22:17:29.841 INFO:teuthology.orchestra.run.smithi134.stdout:4508 read 0x4a0dbdd thru 0x4a1477f (0x6ba3 bytes) 2024-09-21T22:17:29.841 INFO:teuthology.orchestra.run.smithi134.stdout:4511 write 0xc41114 thru 0xc42272 (0x115f bytes) 2024-09-21T22:17:29.843 INFO:teuthology.orchestra.run.smithi134.stdout:4513 read 0x6f5bee4 thru 0x6f66726 (0xa843 bytes) 2024-09-21T22:17:29.843 INFO:teuthology.orchestra.run.smithi134.stdout:4514 read 0xa397203 thru 0xa398dec (0x1bea bytes) 2024-09-21T22:17:29.843 INFO:teuthology.orchestra.run.smithi134.stdout:4516 write 0xb4df428 thru 0xb4e4be5 (0x57be bytes) 2024-09-21T22:17:29.846 INFO:teuthology.orchestra.run.smithi134.stdout:4518 write 0x852ea thru 0x91322 (0xc039 bytes) 2024-09-21T22:17:29.848 INFO:teuthology.orchestra.run.smithi134.stdout:4519 write 0x22d418d thru 0x22df3e8 (0xb25c bytes) 2024-09-21T22:17:29.850 INFO:teuthology.orchestra.run.smithi134.stdout:4520 punch from 0xdeeca6 to 0xdf6892, (0x7bec bytes) 2024-09-21T22:17:29.856 INFO:teuthology.orchestra.run.smithi134.stdout:4521 writesame 0xce7de7a thru 0xce8688c data_size 0x1(0x8a13 bytes) 2024-09-21T22:17:29.856 INFO:teuthology.orchestra.run.smithi134.stdout:4523 read 0x81086c2 thru 0x810ba18 (0x3357 bytes) 2024-09-21T22:17:29.856 INFO:teuthology.orchestra.run.smithi134.stdout:4524 read 0x91e320f thru 0x91eb6a7 (0x8499 bytes) 2024-09-21T22:17:29.856 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.871 INFO:teuthology.orchestra.run.smithi134.stdout:4526 trunc from 0xce8688d to 0x3d2ce3 2024-09-21T22:17:29.884 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.896 INFO:teuthology.orchestra.run.smithi134.stdout:4533 trunc from 0x3d2ce3 to 0xab5ebeb 2024-09-21T22:17:29.903 INFO:teuthology.orchestra.run.smithi134.stdout:4539 punch from 0x3159cc5 to 0x315b604, (0x193f bytes) 2024-09-21T22:17:29.903 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:29.902+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:29.908 INFO:teuthology.orchestra.run.smithi134.stdout:4540 trunc from 0xab5ebeb to 0x61fab17 2024-09-21T22:17:29.914 INFO:teuthology.orchestra.run.smithi134.stdout:4541 read 0x244aee7 thru 0x2453bd3 (0x8ced bytes) 2024-09-21T22:17:29.926 INFO:teuthology.orchestra.run.smithi134.stdout:4542 writesame 0xaa7c7f2 thru 0xaa8706c data_size 0xb(0xa87b bytes) 2024-09-21T22:17:29.926 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.926 INFO:teuthology.orchestra.run.smithi134.stdout:4545 punch from 0x99f9daa to 0x9a0383c, (0x9a92 bytes) 2024-09-21T22:17:29.926 INFO:teuthology.orchestra.run.smithi134.stdout:4546 read 0xebd0e4 thru 0xec36e9 (0x6606 bytes) 2024-09-21T22:17:29.926 INFO:teuthology.orchestra.run.smithi134.stdout:4547 write 0x5ab5a99 thru 0x5ac1eb1 (0xc419 bytes) 2024-09-21T22:17:29.928 INFO:teuthology.orchestra.run.smithi134.stdout:4548 writesame 0x5bd3101 thru 0x5bd725a data_size 0xe(0x415a bytes) 2024-09-21T22:17:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:29.930 INFO:teuthology.orchestra.run.smithi134.stdout:4551 writesame 0x9ecfa34 thru 0x9eda4e2 data_size 0xf(0xaaaf bytes) 2024-09-21T22:17:29.934 INFO:teuthology.orchestra.run.smithi134.stdout:4553 read 0x4583cd7 thru 0x458b1d9 (0x7503 bytes) 2024-09-21T22:17:29.935 INFO:teuthology.orchestra.run.smithi134.stdout:4555 read 0x7c0aa40 thru 0x7c11392 (0x6953 bytes) 2024-09-21T22:17:29.935 INFO:teuthology.orchestra.run.smithi134.stdout:4556 punch from 0x4bf82d to 0x4caf14, (0xb6e7 bytes) 2024-09-21T22:17:29.935 INFO:teuthology.orchestra.run.smithi134.stdout:4557 punch from 0x66ba34a to 0x66bc106, (0x1dbc bytes) 2024-09-21T22:17:29.935 INFO:teuthology.orchestra.run.smithi134.stdout:4558 write 0x4ba677f thru 0x4ba7a22 (0x12a4 bytes) 2024-09-21T22:17:29.936 INFO:teuthology.orchestra.run.smithi134.stdout:4560 punch from 0x113f586 to 0x1148ec0, (0x993a bytes) 2024-09-21T22:17:29.936 INFO:teuthology.orchestra.run.smithi134.stdout:4561 trunc from 0xaa8706d to 0xa6be3e2 2024-09-21T22:17:29.942 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:29.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:29.943 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:29.943 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:29.943 INFO:teuthology.orchestra.run.smithi134.stdout:4562 write 0x565279b thru 0x56572cf (0x4b35 bytes) 2024-09-21T22:17:29.944 INFO:teuthology.orchestra.run.smithi134.stdout:4563 read 0x8f8b63a thru 0x8f90d43 (0x570a bytes) 2024-09-21T22:17:29.944 INFO:teuthology.orchestra.run.smithi134.stdout:4564 read 0x9a80273 thru 0x9a8dfd5 (0xdd63 bytes) 2024-09-21T22:17:29.950 INFO:teuthology.orchestra.run.smithi134.stdout:4565 writesame 0xb2a027a thru 0xb2a4ad8 data_size 0x1(0x485f bytes) 2024-09-21T22:17:29.950 INFO:teuthology.orchestra.run.smithi134.stdout:4566 write 0xcbaf65 thru 0xcc975f (0xe7fb bytes) 2024-09-21T22:17:29.952 INFO:teuthology.orchestra.run.smithi134.stdout:4567 punch from 0x95550d4 to 0x95645e3, (0xf50f bytes) 2024-09-21T22:17:29.952 INFO:teuthology.orchestra.run.smithi134.stdout:4568 writesame 0x84eddd1 thru 0x84fc47d data_size 0x1(0xe6ad bytes) 2024-09-21T22:17:29.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:29.958 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:17:29.999 INFO:teuthology.orchestra.run.smithi134.stdout:4569 trunc from 0xb2a4ad9 to 0x2d3bc9b 2024-09-21T22:17:30.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:30.003+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:30.013 INFO:teuthology.orchestra.run.smithi134.stdout:4570 writesame 0x23c87ff thru 0x23cd354 data_size 0x1(0x4b56 bytes) 2024-09-21T22:17:30.022 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:30.041 INFO:teuthology.orchestra.run.smithi134.stdout:4573 writesame 0xd9bfeca thru 0xd9c19c4 data_size 0x1(0x1afb bytes) 2024-09-21T22:17:30.041 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:30.041 INFO:teuthology.orchestra.run.smithi134.stdout:4576 clone 27 order 18 su 1024 sc 8 2024-09-21T22:17:30.075 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:30.075 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:30.075 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:30.075 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:30.075 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:30.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:30.105 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:30.104+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:30.206 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:30.205+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:30.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:30.230 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:30.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62618 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2596864~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930900096000002, 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046851039999999997, 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62618 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.231 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297853+0000", 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:17:30.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297855+0000", 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297861+0000", 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297869+0000", 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4229999999999999e-06 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344498+0000", 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046629275999999997 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344580+0000", 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.229e-05 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344704+0000", 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012379399999999999 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62619 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2625536~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930877164999998, 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047029327000000003, 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62619 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297876+0000", 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297878+0000", 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1720000000000001e-06 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297884+0000", 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8420000000000001e-06 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297889+0000", 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0529999999999997e-06 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344750+0000", 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046860589000000001 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344799+0000", 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9259999999999999e-05 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344905+0000", 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106023 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62620 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2654208~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930857520000004, 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047262419999999999, 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62620 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297895+0000", 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297896+0000", 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:30.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297900+0000", 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297906+0000", 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0499999999999997e-06 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297911+0000", 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6070000000000001e-06 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.344949+0000", 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047038468999999999 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345037+0000", 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7664999999999995e-05 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345158+0000", 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121206 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62621 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2682880~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930836546000002, 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047537283, 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62621 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297916+0000", 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297917+0000", 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297919+0000", 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297925+0000", 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1970000000000001e-06 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297930+0000", 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5619999999999997e-06 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345251+0000", 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047321410000000001 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345344+0000", 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3447000000000002e-05 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345454+0000", 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010932700000000001 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62622 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2711552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930815015, 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047769796000000003, 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62622 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297938+0000", 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:17:30.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297941+0000", 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.137e-06 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297946+0000", 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297951+0000", 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345499+0000", 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047547865000000002 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345601+0000", 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101671 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345708+0000", 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107141 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.250 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62623 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2740224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930790805999997, 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047987992, 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62623 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297962+0000", 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297963+0000", 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297971+0000", 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9009999999999994e-06 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297977+0000", 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5590000000000002e-06 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297989+0000", 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.183e-05 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345742+0000", 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047753035999999999 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345846+0000", 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103859 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345950+0000", 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104388 2024-09-21T22:17:30.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62624 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2768896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930756586000001, 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048201194000000003, 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62624 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297996+0000", 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297997+0000", 2024-09-21T22:17:30.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.297999+0000", 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2620000000000001e-06 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298005+0000", 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298011+0000", 2024-09-21T22:17:30.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1789999999999999e-06 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.345994+0000", 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983959 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346078+0000", 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3830000000000002e-05 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346198+0000", 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119311 2024-09-21T22:17:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62625 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2797568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930523712999999, 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048206511, 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62625 2024-09-21T22:17:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298229+0000", 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298230+0000", 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8999999999999996e-07 2024-09-21T22:17:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298233+0000", 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.371e-06 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298240+0000", 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1790000000000002e-06 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298253+0000", 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2186e-05 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346236+0000", 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047983499999999998 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346318+0000", 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2273000000000003e-05 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346436+0000", 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011741199999999999 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62626 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2826240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930489027999997, 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048414997000000001, 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62626 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298264+0000", 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6100000000000001e-07 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298267+0000", 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4109999999999999e-06 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298278+0000", 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1399999999999999e-05 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298283+0000", 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1919999999999996e-06 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346477+0000", 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048193998000000002 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346529+0000", 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1561999999999999e-05 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346679+0000", 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149973 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62627 3.12 3:4d98109f:::rbd_data.11853a90904b.0000000000000003:1d [read 2854912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930460425, 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048814124, 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62627 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298293+0000", 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298295+0000", 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2520000000000002e-06 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298302+0000", 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3060000000000003e-06 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298306+0000", 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6820000000000002e-06 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346724+0000", 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048417610999999999 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.346818+0000", 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3733000000000005e-05 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347107+0000", 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028912000000000002 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62628 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930435523, 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048832672000000001, 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62628 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298317+0000", 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298318+0000", 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298320+0000", 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1239999999999999e-06 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298326+0000", 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8220000000000003e-06 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298331+0000", 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347139+0000", 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048808782000000002 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347150+0000", 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0672e-05 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62629 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930416547999997, 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048848529000000002, 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62629 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298336+0000", 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298337+0000", 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298339+0000", 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298345+0000", 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298350+0000", 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347177+0000", 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048826889999999998 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347185+0000", 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62630 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930394440000001, 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048855136, 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62630 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298359+0000", 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.22e-07 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298361+0000", 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0779999999999998e-06 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298367+0000", 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298372+0000", 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347206+0000", 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048834223000000003 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347214+0000", 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8639999999999996e-06 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62631 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930199979999998, 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048836962999999997, 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62631 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298553+0000", 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298554+0000", 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298557+0000", 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.145e-06 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298570+0000", 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2870999999999999e-05 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298575+0000", 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7570000000000001e-06 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347379+0000", 2024-09-21T22:17:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048803199999999998 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347390+0000", 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1415e-05 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62632 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930166532000001, 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048882087999999997, 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62632 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298586+0000", 2024-09-21T22:17:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298587+0000", 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298590+0000", 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6129999999999998e-06 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298601+0000", 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1517e-05 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298606+0000", 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8060000000000002e-06 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347417+0000", 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048811326000000002 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347469+0000", 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378999999999997e-05 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62633 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930138092999997, 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048891830999999997, 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62633 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298615+0000", 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298618+0000", 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298624+0000", 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3559999999999998e-06 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298634+0000", 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347498+0000", 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863908999999997 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347507+0000", 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8829999999999995e-06 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62634 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930112352999998, 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048897406999999997, 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62634 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298641+0000", 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298643+0000", 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-06 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298649+0000", 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298654+0000", 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.831e-06 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347530+0000", 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048875952 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347538+0000", 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8059999999999995e-06 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62635 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930092997000003, 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.04890684, 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62635 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298660+0000", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298685+0000", 2024-09-21T22:17:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4230999999999999e-05 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298691+0000", 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.562e-06 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298696+0000", 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347560+0000", 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048863986999999998 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347567+0000", 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.579e-06 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62636 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930047076000001, 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048894625999999997, 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62636 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298706+0000", 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298709+0000", 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298714+0000", 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298719+0000", 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347592+0000", 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048872916000000002 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347601+0000", 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5879999999999998e-06 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:62637 3.12 3.f90819b2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930023185000003, 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048904669999999997, 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 62637 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298730+0000", 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298732+0000", 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3010000000000001e-06 2024-09-21T22:17:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298738+0000", 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.298745+0000", 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6710000000000002e-06 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347627+0000", 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048881775000000002 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:35.347634+0000", 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.926e-06 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:30.306 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:30.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:30.308 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:30.306+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:30.341 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:30.341 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:30.359 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:30.431 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:30.431 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:30.431 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:30.431 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:30.432 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:30.432 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:30.432 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:30.432 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:30.433 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:30.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:30.433+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:30.443 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:30.443 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:30.448 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:30.448 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:30.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:30.459 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:30.535 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:30.534+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:30.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:30.635 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:30.634+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:30.672 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:30.672 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:30.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:30.736 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:30.735+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:30.824 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:30.824 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:30.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:30.837 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:30.836+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:30.934 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:30.934 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:30.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:30.936+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:30.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:30.962 INFO:teuthology.orchestra.run.smithi134.stderr:set 3.5 pg_upmap mapping to [5,3] 2024-09-21T22:17:31.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:31.037+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:31.068 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:31.068 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:31.077 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:31.140 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:31.139+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:31.187 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:31.187 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:31.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:31.280 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:31.279+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:31.339 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:31.340 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:31.340 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:31.340+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:31.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:31.441 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:31.441+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:31.494 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:31.494 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:31.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:31.544 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:31.543+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:31.642 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:31.642+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:31.646 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:31.646 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:31.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:31.743 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:31.742+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:31.800 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:31.800 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:31.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:31.844 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:31.843+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:31.944 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:31.943+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:31.956 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:31.956 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:31.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:31.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:17:32.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:32.044+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:32.112 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:32.112 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:32.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:32.145 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:32.144+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:32.227 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:32.227 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:32.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:32.246 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:32.245+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:32.341 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:32.341 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:32.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:32.347+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:32.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:32.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:32.448+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:32.457 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:32.457 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:32.467 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:32.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:32.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:32.549+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:32.571 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:32.571 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:32.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:32.651 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:32.650+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:32.667 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:32.668 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:32.688 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:32.688 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:32.697 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:32.711 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:32.711 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:32.751 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:32.751+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:32.752 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:32.752 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:32.780 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:32.780 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:32.806 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:32.806 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:32.834 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:32.834 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:32.850 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:32.850 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:32.850 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:32.850 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:32.852 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:32.852+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:32.862 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:32.866 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:32.866 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:32.895 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:32.895 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:32.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:32.952+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:32.972 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:17:33.029 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:33.029 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:33.029 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:33.030 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:33.030 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:33.043 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:33.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:33.083+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:33.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:33.152+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:33.241 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:33.241 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:33.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:33.241 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:33.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.241 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.32884688, 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.242 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.326224807000003, 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139829 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002667+0000", 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236363883, 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030870926999999999, 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139829 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002667+0000", 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002667+0000", 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002667+0000", 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1600000000000002e-07 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002669+0000", 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8500000000000001e-06 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002675+0000", 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002679+0000", 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4800000000000003e-06 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033531+0000", 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030851462 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033538+0000", 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2030000000000003e-06 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139830 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002684+0000", 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236346732, 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030884334999999999, 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139830 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002684+0000", 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002684+0000", 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002684+0000", 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4400000000000001e-07 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002686+0000", 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.885e-06 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002693+0000", 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.489e-06 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002698+0000", 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2630000000000003e-06 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033561+0000", 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030863225000000001 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033568+0000", 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139831 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002704+0000", 2024-09-21T22:17:33.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236326909, 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030895596000000001, 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139831 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002704+0000", 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002704+0000", 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002704+0000", 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9699999999999996e-07 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002706+0000", 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:17:33.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002712+0000", 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9370000000000001e-06 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002718+0000", 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6230000000000002e-06 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033592+0000", 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030874393 2024-09-21T22:17:33.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033600+0000", 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139832 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002724+0000", 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236306829, 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030909325000000001, 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139832 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002724+0000", 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002724+0000", 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002724+0000", 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002726+0000", 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0499999999999999e-06 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002732+0000", 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0220000000000001e-06 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002737+0000", 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8280000000000002e-06 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033624+0000", 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030886813999999999 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033633+0000", 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2930000000000006e-06 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139833 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002743+0000", 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23628791199999999, 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030923597000000001, 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139833 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002743+0000", 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002743+0000", 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002743+0000", 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002745+0000", 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002751+0000", 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.755e-06 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002756+0000", 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5210000000000004e-06 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033658+0000", 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.03090219 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033667+0000", 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6330000000000002e-06 2024-09-21T22:17:33.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139834 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002761+0000", 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23626965, 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030938437999999999, 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139834 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002761+0000", 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002761+0000", 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002761+0000", 2024-09-21T22:17:33.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.96e-07 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002763+0000", 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9750000000000001e-06 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002775+0000", 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002780+0000", 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9899999999999997e-06 2024-09-21T22:17:33.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033693+0000", 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030912318000000001 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033700+0000", 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8889999999999996e-06 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139835 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002787+0000", 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23624377599999999, 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030943999, 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139835 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002787+0000", 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002787+0000", 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002788+0000", 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002793+0000", 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002799+0000", 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9290000000000003e-06 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002804+0000", 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6229999999999996e-06 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033724+0000", 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030920310999999999 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033731+0000", 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1339999999999998e-06 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139836 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002809+0000", 2024-09-21T22:17:33.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23622196600000001, 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030952403999999999, 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139836 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002809+0000", 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002809+0000", 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002809+0000", 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002811+0000", 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002817+0000", 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002821+0000", 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4750000000000004e-06 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033752+0000", 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030931191 2024-09-21T22:17:33.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033761+0000", 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139837 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002827+0000", 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23620429600000001, 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030970650999999998, 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.282 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139837 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002827+0000", 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002827+0000", 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002827+0000", 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002829+0000", 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.821e-06 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002834+0000", 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5979999999999996e-06 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002840+0000", 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2970000000000003e-06 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033790+0000", 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030949949000000001 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033797+0000", 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5329999999999997e-06 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139838 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002845+0000", 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236185967, 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030984459999999998, 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.286 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139838 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002845+0000", 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002845+0000", 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002845+0000", 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002847+0000", 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.818e-06 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002853+0000", 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5249999999999996e-06 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002857+0000", 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6160000000000004e-06 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033822+0000", 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030965072 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033829+0000", 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1019999999999999e-06 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139839 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002863+0000", 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23616807400000001, 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030996528999999998, 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139839 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002863+0000", 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002863+0000", 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002863+0000", 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0800000000000001e-07 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002865+0000", 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002871+0000", 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002876+0000", 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0370000000000002e-06 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033853+0000", 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030976788000000002 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033859+0000", 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7739999999999999e-06 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139840 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002881+0000", 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23614953499999999, 2024-09-21T22:17:33.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031008549999999999, 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139840 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002881+0000", 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002881+0000", 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002882+0000", 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002884+0000", 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9139999999999998e-06 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002889+0000", 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5600000000000001e-06 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002894+0000", 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5530000000000003e-06 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033882+0000", 2024-09-21T22:17:33.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030988686000000001 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033890+0000", 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4830000000000002e-06 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139841 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002899+0000", 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23613215500000001, 2024-09-21T22:17:33.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031023397000000001, 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139841 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002899+0000", 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002899+0000", 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002899+0000", 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0100000000000001e-07 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002901+0000", 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.792e-06 2024-09-21T22:17:33.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002906+0000", 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5160000000000002e-06 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002911+0000", 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4020000000000004e-06 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033915+0000", 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031004113999999999 2024-09-21T22:17:33.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033922+0000", 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.272e-06 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139842 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002916+0000", 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236115084, 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031048694000000002, 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139842 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002916+0000", 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002916+0000", 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002916+0000", 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002918+0000", 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.849e-06 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002923+0000", 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5040000000000002e-06 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002928+0000", 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033956+0000", 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031027743 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033964+0000", 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7159999999999992e-06 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139843 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002933+0000", 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236097737, 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031062459000000001, 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139843 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002933+0000", 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002933+0000", 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002934+0000", 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0999999999999999e-07 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002935+0000", 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8950000000000001e-06 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002941+0000", 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4040000000000003e-06 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002945+0000", 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4649999999999996e-06 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033988+0000", 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031042882000000001 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.033996+0000", 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.308 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139844 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002952+0000", 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23607905000000001, 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031074153, 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.309 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139844 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002952+0000", 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002952+0000", 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002952+0000", 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002954+0000", 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.872e-06 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002960+0000", 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.575e-06 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002964+0000", 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7319999999999998e-06 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.034019+0000", 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031054689 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.034026+0000", 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7599999999999997e-06 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139845 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002970+0000", 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.23606126899999999, 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031087025000000001, 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139845 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002970+0000", 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002970+0000", 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002970+0000", 2024-09-21T22:17:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.15e-07 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002972+0000", 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002977+0000", 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4870000000000002e-06 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002982+0000", 2024-09-21T22:17:33.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4530000000000004e-06 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.034049+0000", 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031067155999999999 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.034057+0000", 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6170000000000001e-06 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:139846 3.7 3.5f9b4de7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.002987+0000", 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.236043594, 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031100940000000001, 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139846 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002987+0000", 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002987+0000", 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002988+0000", 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002990+0000", 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.159e-06 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.002996+0000", 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2999999999999998e-06 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.003001+0000", 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9819999999999999e-06 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.034081+0000", 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031079797999999999 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.034088+0000", 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2540000000000003e-06 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.320 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:33.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:33.322 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:33.321+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:33.422 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:33.422+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:33.523 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:33.522+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:33.545 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:33.545 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:33.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.545 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143733 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.545 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510182+0000", 2024-09-21T22:17:33.545 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018920383999999998, 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01893684, 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143733 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510182+0000", 2024-09-21T22:17:33.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510182+0000", 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510182+0000", 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510184+0000", 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.934e-06 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510192+0000", 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2649999999999999e-06 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510197+0000", 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.694e-06 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143861 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512749+0000", 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016353202000000001, 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016433607999999999, 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143861 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512749+0000", 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512749+0000", 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512750+0000", 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:33.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512752+0000", 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9520000000000001e-06 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512758+0000", 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512763+0000", 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.865e-06 2024-09-21T22:17:33.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143957 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513677+0000", 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015425917000000001, 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015558690999999999, 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.552 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143957 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513677+0000", 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513677+0000", 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513677+0000", 2024-09-21T22:17:33.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513679+0000", 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513686+0000", 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3069999999999997e-06 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513691+0000", 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8910000000000003e-06 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143989 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514410+0000", 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014692770000000001, 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014861285, 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.555 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143989 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514410+0000", 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514410+0000", 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514410+0000", 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.53e-07 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514412+0000", 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.905e-06 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514419+0000", 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3220000000000004e-06 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514425+0000", 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4099999999999999e-06 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144052 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.519639+0000", 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0094639279999999999, 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096799799999999995, 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144052 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519639+0000", 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519639+0000", 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519639+0000", 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519643+0000", 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4159999999999997e-06 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519647+0000", 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0219999999999998e-06 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519650+0000", 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7030000000000002e-06 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144116 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.561 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523067+0000", 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060353999999999998, 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063054510000000001, 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144116 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523067+0000", 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523067+0000", 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523068+0000", 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523071+0000", 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.853e-06 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523077+0000", 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523082+0000", 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.724e-06 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144214 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525923+0000", 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003179337, 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035031979999999999, 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144214 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525923+0000", 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525923+0000", 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525924+0000", 2024-09-21T22:17:33.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525926+0000", 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.367e-06 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525932+0000", 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0689999999999998e-06 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525944+0000", 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1819e-05 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143734 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510204+0000", 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018898964000000001, 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019284698999999999, 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.568 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143734 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510204+0000", 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510204+0000", 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510204+0000", 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1899999999999998e-07 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510206+0000", 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.058e-06 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510212+0000", 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7799999999999997e-06 2024-09-21T22:17:33.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510217+0000", 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143862 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512778+0000", 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016324556, 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016766195000000001, 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143862 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512778+0000", 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512778+0000", 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512778+0000", 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512781+0000", 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.204e-06 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512787+0000", 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5069999999999997e-06 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512792+0000", 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8189999999999999e-06 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143958 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513714+0000", 2024-09-21T22:17:33.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015388954, 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015886758000000001, 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143958 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513714+0000", 2024-09-21T22:17:33.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513714+0000", 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513714+0000", 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513720+0000", 2024-09-21T22:17:33.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5339999999999999e-06 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513726+0000", 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3600000000000001e-06 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513731+0000", 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9230000000000001e-06 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144053 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.519653+0000", 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0094491769999999996, 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010001222000000001, 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144053 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519653+0000", 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519653+0000", 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519654+0000", 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1400000000000001e-07 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519657+0000", 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6909999999999999e-06 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519661+0000", 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5559999999999999e-06 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519667+0000", 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9599999999999997e-06 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144117 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523089+0000", 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0060130599999999998, 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066197900000000004, 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144117 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.581 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523089+0000", 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523089+0000", 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523090+0000", 2024-09-21T22:17:33.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523098+0000", 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4999999999999999e-06 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523105+0000", 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4350000000000002e-06 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523110+0000", 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2270000000000001e-06 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144215 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525952+0000", 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0031508640000000002, 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003810744, 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144215 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525952+0000", 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525952+0000", 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525952+0000", 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525954+0000", 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525961+0000", 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525965+0000", 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143735 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510222+0000", 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018880299999999999, 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019600678, 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143735 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510222+0000", 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510222+0000", 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510223+0000", 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510224+0000", 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7689999999999999e-06 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510230+0000", 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5740000000000003e-06 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510234+0000", 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4660000000000001e-06 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143863 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512798+0000", 2024-09-21T22:17:33.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016304446, 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017076101999999999, 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143863 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512798+0000", 2024-09-21T22:17:33.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512798+0000", 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512798+0000", 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512800+0000", 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512806+0000", 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7699999999999998e-06 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512811+0000", 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143959 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513738+0000", 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015364838, 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016178616999999999, 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143959 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513738+0000", 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513738+0000", 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513738+0000", 2024-09-21T22:17:33.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513740+0000", 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9609999999999999e-06 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513747+0000", 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6069999999999996e-06 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513751+0000", 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7260000000000002e-06 2024-09-21T22:17:33.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143990 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514431+0000", 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014671818, 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015522067000000001, 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143990 2024-09-21T22:17:33.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514431+0000", 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514431+0000", 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514431+0000", 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2500000000000001e-07 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514433+0000", 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8810000000000001e-06 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514478+0000", 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4610999999999997e-05 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514488+0000", 2024-09-21T22:17:33.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0905e-05 2024-09-21T22:17:33.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144054 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.519671+0000", 2024-09-21T22:17:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0094311940000000004, 2024-09-21T22:17:33.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010326793000000001, 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144054 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519671+0000", 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519671+0000", 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519734+0000", 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2626000000000007e-05 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519737+0000", 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0510000000000001e-06 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519745+0000", 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5460000000000003e-06 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519750+0000", 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144118 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523128+0000", 2024-09-21T22:17:33.604 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059745509999999998, 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069135359999999996, 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144118 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523128+0000", 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523128+0000", 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523129+0000", 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9999999999999997e-07 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523131+0000", 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4389999999999999e-06 2024-09-21T22:17:33.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523137+0000", 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9610000000000002e-06 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523142+0000", 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5900000000000001e-06 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144216 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525972+0000", 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0031309749999999998, 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041249870000000001, 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144216 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525972+0000", 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525972+0000", 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527774+0000", 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018026940000000001 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527785+0000", 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1202999999999999e-05 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527794+0000", 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0359999999999995e-06 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527801+0000", 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4370000000000004e-06 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143736 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510240+0000", 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018862436999999999, 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019907798000000001, 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143736 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510240+0000", 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510240+0000", 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510240+0000", 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510248+0000", 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.43e-06 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510254+0000", 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2079999999999997e-06 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510259+0000", 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9880000000000004e-06 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143864 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512836+0000", 2024-09-21T22:17:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016266275, 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017364240999999999, 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143864 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512836+0000", 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512836+0000", 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512837+0000", 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512839+0000", 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512845+0000", 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4049999999999997e-06 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512850+0000", 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8999999999999997e-06 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143960 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513758+0000", 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015344383, 2024-09-21T22:17:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016496831, 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143960 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513758+0000", 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513758+0000", 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513759+0000", 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3499999999999996e-07 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513761+0000", 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.018e-06 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513774+0000", 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3027000000000001e-05 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513779+0000", 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4530000000000001e-06 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143991 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514496+0000", 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01460696, 2024-09-21T22:17:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015810609999999999, 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143991 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514496+0000", 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514496+0000", 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514496+0000", 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514498+0000", 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4439999999999998e-06 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514505+0000", 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.951e-06 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514511+0000", 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.181e-06 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144055 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.519779+0000", 2024-09-21T22:17:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0093231709999999999, 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010581521, 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144055 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519779+0000", 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519779+0000", 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519780+0000", 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519782+0000", 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5629999999999999e-06 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519790+0000", 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4499999999999998e-06 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519796+0000", 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7080000000000002e-06 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144119 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523149+0000", 2024-09-21T22:17:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059533750000000003, 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007265713, 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144119 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523149+0000", 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523149+0000", 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523150+0000", 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523152+0000", 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:17:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523158+0000", 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.925e-06 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523162+0000", 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8040000000000001e-06 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144217 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527813+0000", 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0012893640000000001, 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026549680000000002, 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144217 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527813+0000", 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527813+0000", 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527814+0000", 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000002e-07 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527816+0000", 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4420000000000001e-06 2024-09-21T22:17:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527822+0000", 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0499999999999997e-06 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527827+0000", 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8210000000000001e-06 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143737 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510267+0000", 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018835752000000001, 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020257785, 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143737 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510267+0000", 2024-09-21T22:17:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510267+0000", 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510267+0000", 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4099999999999999e-07 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510273+0000", 2024-09-21T22:17:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6019999999999999e-06 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510279+0000", 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1829999999999999e-06 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510284+0000", 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6859999999999997e-06 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143865 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512857+0000", 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016245595000000002, 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017718191000000001, 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143865 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512857+0000", 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512857+0000", 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512857+0000", 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:17:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512859+0000", 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512865+0000", 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.925e-06 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512871+0000", 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6550000000000001e-06 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143961 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513786+0000", 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015316303, 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016841748, 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143961 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513786+0000", 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513786+0000", 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513787+0000", 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513789+0000", 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0760000000000001e-06 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513795+0000", 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3090000000000001e-06 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513800+0000", 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143992 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514516+0000", 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01458602, 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016165008000000002, 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143992 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514516+0000", 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514516+0000", 2024-09-21T22:17:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514517+0000", 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4799999999999999e-07 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514519+0000", 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9879999999999999e-06 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514525+0000", 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514530+0000", 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7310000000000001e-06 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144056 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.519803+0000", 2024-09-21T22:17:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0092990409999999992, 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932264000000001, 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144056 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519803+0000", 2024-09-21T22:17:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.519803+0000", 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521202+0000", 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001398809 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521207+0000", 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3989999999999997e-06 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521218+0000", 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1613999999999999e-05 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521225+0000", 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9489999999999999e-06 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144120 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523168+0000", 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059342220000000003, 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076245189999999997, 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144120 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523168+0000", 2024-09-21T22:17:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523168+0000", 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523169+0000", 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8599999999999999e-07 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523171+0000", 2024-09-21T22:17:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.866e-06 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523176+0000", 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7749999999999998e-06 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523181+0000", 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144218 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527834+0000", 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001268342, 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030122230000000001, 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144218 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527834+0000", 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527834+0000", 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527835+0000", 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527837+0000", 2024-09-21T22:17:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.108e-06 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527844+0000", 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527849+0000", 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8210000000000001e-06 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143738 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510290+0000", 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018812601000000002, 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020617667999999999, 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143738 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510290+0000", 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510290+0000", 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510290+0000", 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510292+0000", 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.007e-06 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510298+0000", 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0889999999999996e-06 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510306+0000", 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0229999999999992e-06 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143866 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512877+0000", 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016225964999999998, 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018079652000000002, 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143866 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512877+0000", 2024-09-21T22:17:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512877+0000", 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512877+0000", 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512879+0000", 2024-09-21T22:17:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9069999999999999e-06 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512885+0000", 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1099999999999999e-06 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512892+0000", 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143962 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513806+0000", 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015296821, 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017208393999999998, 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143962 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513806+0000", 2024-09-21T22:17:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513806+0000", 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513806+0000", 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513808+0000", 2024-09-21T22:17:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.818e-06 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513814+0000", 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8900000000000004e-06 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513819+0000", 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143993 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514535+0000", 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014567152, 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016532137999999998, 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143993 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514535+0000", 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514535+0000", 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514536+0000", 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.15e-07 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514537+0000", 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8250000000000001e-06 2024-09-21T22:17:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514543+0000", 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6489999999999996e-06 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514548+0000", 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4519999999999999e-06 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144057 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521238+0000", 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0078649319999999998, 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098842830000000007, 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144057 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521238+0000", 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521238+0000", 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521238+0000", 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521241+0000", 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.481e-06 2024-09-21T22:17:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521247+0000", 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521252+0000", 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.057e-06 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144121 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523187+0000", 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005915834, 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079946240000000005, 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144121 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523187+0000", 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523187+0000", 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523187+0000", 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6899999999999998e-07 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523193+0000", 2024-09-21T22:17:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6899999999999997e-06 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523199+0000", 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1820000000000003e-06 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523209+0000", 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0518e-05 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144219 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527856+0000", 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001246123, 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033796130000000001, 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144219 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527856+0000", 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527856+0000", 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527857+0000", 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4600000000000005e-07 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527859+0000", 2024-09-21T22:17:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9069999999999999e-06 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527865+0000", 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8270000000000003e-06 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527869+0000", 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7049999999999998e-06 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143739 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510313+0000", 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018789334000000001, 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020980029000000001, 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143739 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510313+0000", 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510313+0000", 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510314+0000", 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510316+0000", 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0229999999999999e-06 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510322+0000", 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0009999999999998e-06 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510326+0000", 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4889999999999997e-06 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143867 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512897+0000", 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016205065000000001, 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018449994000000001, 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143867 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512897+0000", 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512897+0000", 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512898+0000", 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512905+0000", 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.148e-06 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512911+0000", 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2519999999999996e-06 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512916+0000", 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143963 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513824+0000", 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015278118, 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017579621, 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143963 2024-09-21T22:17:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513824+0000", 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513824+0000", 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513825+0000", 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513827+0000", 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513832+0000", 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7599999999999999e-06 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513843+0000", 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.057e-05 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143994 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514553+0000", 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014549034000000001, 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016903909000000002, 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143994 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514553+0000", 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514553+0000", 2024-09-21T22:17:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514554+0000", 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4400000000000001e-07 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514560+0000", 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1129999999999997e-06 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514566+0000", 2024-09-21T22:17:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0440000000000001e-06 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514571+0000", 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7310000000000001e-06 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144058 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521259+0000", 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0078434309999999997, 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010250558, 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144058 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521259+0000", 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521259+0000", 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521260+0000", 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.37e-07 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521262+0000", 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4059999999999999e-06 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521268+0000", 2024-09-21T22:17:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4030000000000004e-06 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521273+0000", 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8829999999999997e-06 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144122 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523216+0000", 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005886011, 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083453710000000007, 2024-09-21T22:17:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144122 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523216+0000", 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523216+0000", 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523217+0000", 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523219+0000", 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.108e-06 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523225+0000", 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523230+0000", 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9389999999999996e-06 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144220 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527875+0000", 2024-09-21T22:17:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0012272069999999999, 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037433470000000002, 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144220 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527875+0000", 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527875+0000", 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527876+0000", 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527878+0000", 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0020000000000001e-06 2024-09-21T22:17:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527883+0000", 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6749999999999999e-06 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527888+0000", 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8289999999999998e-06 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143740 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510332+0000", 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018770558, 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021338547999999999, 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143740 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510332+0000", 2024-09-21T22:17:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510332+0000", 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510332+0000", 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510334+0000", 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510340+0000", 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8000000000000004e-06 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510346+0000", 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5339999999999999e-06 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143868 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512924+0000", 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016178629999999999, 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018825971, 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143868 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512924+0000", 2024-09-21T22:17:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512924+0000", 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512924+0000", 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512926+0000", 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.99e-06 2024-09-21T22:17:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512932+0000", 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8950000000000003e-06 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512937+0000", 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8199999999999996e-06 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143964 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.702 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513849+0000", 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015253301, 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017979479, 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143964 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513849+0000", 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513849+0000", 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513850+0000", 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513858+0000", 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9310000000000008e-06 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513864+0000", 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9580000000000001e-06 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513870+0000", 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143995 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514577+0000", 2024-09-21T22:17:33.705 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014525767, 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017316944000000001, 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143995 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514577+0000", 2024-09-21T22:17:33.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514577+0000", 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514577+0000", 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-07 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514579+0000", 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.781e-06 2024-09-21T22:17:33.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514584+0000", 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1490000000000002e-06 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514589+0000", 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7129999999999996e-06 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144059 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.708 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521281+0000", 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0078217800000000004, 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010677437, 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144059 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521281+0000", 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521281+0000", 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521281+0000", 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521283+0000", 2024-09-21T22:17:33.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2330000000000001e-06 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521291+0000", 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5220000000000001e-06 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521296+0000", 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1970000000000004e-06 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.711 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144123 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523237+0000", 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058650610000000004, 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087789219999999998, 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144123 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523237+0000", 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523237+0000", 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523238+0000", 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523240+0000", 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9e-06 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523245+0000", 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523250+0000", 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144221 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527894+0000", 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0012085290000000001, 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041795529999999999, 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144221 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527894+0000", 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527894+0000", 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527894+0000", 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.34e-07 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527896+0000", 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7799999999999999e-06 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527902+0000", 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8880000000000002e-06 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527907+0000", 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143741 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510351+0000", 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018751230000000001, 2024-09-21T22:17:33.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021777197000000002, 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143741 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510351+0000", 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510351+0000", 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510352+0000", 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510353+0000", 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.813e-06 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510359+0000", 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510364+0000", 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8600000000000001e-06 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143869 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512943+0000", 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016159722000000001, 2024-09-21T22:17:33.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019244656999999998, 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143869 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512943+0000", 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512943+0000", 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512943+0000", 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512945+0000", 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.793e-06 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512951+0000", 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7049999999999996e-06 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512957+0000", 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9349999999999999e-06 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143965 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513876+0000", 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015226338000000001, 2024-09-21T22:17:33.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018366641999999999, 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143965 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513876+0000", 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513876+0000", 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513877+0000", 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513879+0000", 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9700000000000002e-06 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513885+0000", 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9059999999999996e-06 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513890+0000", 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.994e-06 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143996 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514594+0000", 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014508171, 2024-09-21T22:17:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017703114999999998, 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143996 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514594+0000", 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514594+0000", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514595+0000", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6399999999999998e-07 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514597+0000", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9910000000000001e-06 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514602+0000", 2024-09-21T22:17:33.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7250000000000002e-06 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514607+0000", 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8149999999999996e-06 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144060 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521320+0000", 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077825530000000002, 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011032025000000001, 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144060 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521320+0000", 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521320+0000", 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521321+0000", 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7700000000000004e-07 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521325+0000", 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1810000000000003e-06 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521332+0000", 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4710000000000001e-06 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521338+0000", 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8619999999999999e-06 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144124 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523256+0000", 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058461260000000001, 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091528519999999995, 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144124 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523256+0000", 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523256+0000", 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523919+0000", 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066261300000000005 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523924+0000", 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8570000000000003e-06 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523935+0000", 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1277999999999999e-05 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523947+0000", 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2116000000000001e-05 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144222 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527913+0000", 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001189807, 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045484610000000002, 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144222 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527913+0000", 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527913+0000", 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527913+0000", 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527915+0000", 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9929999999999998e-06 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527921+0000", 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8390000000000003e-06 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527926+0000", 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7759999999999997e-06 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143742 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510370+0000", 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018732235, 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022151015, 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143742 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510370+0000", 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510370+0000", 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510371+0000", 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510372+0000", 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.841e-06 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510378+0000", 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8039999999999998e-06 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510383+0000", 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.301e-06 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143870 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.512973+0000", 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016129457999999999, 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019602648, 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143870 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512973+0000", 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512973+0000", 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512973+0000", 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.27e-07 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512979+0000", 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7590000000000003e-06 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512986+0000", 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3949999999999998e-06 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.512991+0000", 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8899999999999998e-06 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143966 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513897+0000", 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015205880999999999, 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018737086, 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143966 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513897+0000", 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513897+0000", 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513897+0000", 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513899+0000", 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-06 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513905+0000", 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9669999999999998e-06 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513909+0000", 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143997 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514613+0000", 2024-09-21T22:17:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014489886, 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018075984999999999, 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143997 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514613+0000", 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514613+0000", 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514613+0000", 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4799999999999999e-07 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514620+0000", 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.34e-06 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514626+0000", 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.032e-06 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514631+0000", 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3989999999999997e-06 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144061 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.750 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521349+0000", 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077530999999999997, 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011396333, 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144061 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521349+0000", 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521349+0000", 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521350+0000", 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8800000000000003e-07 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521352+0000", 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3920000000000001e-06 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521358+0000", 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521364+0000", 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7760000000000003e-06 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144125 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523961+0000", 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051417420000000004, 2024-09-21T22:17:33.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088435570000000002, 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144125 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523961+0000", 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523961+0000", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523961+0000", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1200000000000003e-07 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523964+0000", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6170000000000001e-06 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523971+0000", 2024-09-21T22:17:33.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7299999999999999e-06 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523982+0000", 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1155000000000001e-05 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144223 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527931+0000", 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001171137, 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004946392, 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144223 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527931+0000", 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527931+0000", 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527932+0000", 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6899999999999998e-07 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527938+0000", 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527944+0000", 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2049999999999999e-06 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527955+0000", 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.096e-05 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143743 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2733056~1024 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.759 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.510389+0000", 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.018713732, 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022551491999999999, 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143743 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510389+0000", 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510389+0000", 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510389+0000", 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510391+0000", 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.903e-06 2024-09-21T22:17:33.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510397+0000", 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8880000000000002e-06 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.510402+0000", 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.702e-06 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.532871+0000", 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022469647999999998 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.532949+0000", 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7662000000000003e-05 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143871 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513014+0000", 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016088729, 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019990175999999998, 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143871 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513014+0000", 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513014+0000", 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513014+0000", 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000002e-07 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513017+0000", 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3149999999999999e-06 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513023+0000", 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513028+0000", 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143967 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513926+0000", 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015176576000000001, 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019129848000000001, 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.766 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143967 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513926+0000", 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513926+0000", 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513926+0000", 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513929+0000", 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.21e-06 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513935+0000", 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513940+0000", 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9019999999999998e-06 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143998 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514656+0000", 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014446466999999999, 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018448747000000001, 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143998 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514656+0000", 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514656+0000", 2024-09-21T22:17:33.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514656+0000", 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514659+0000", 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4490000000000002e-06 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514665+0000", 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4150000000000004e-06 2024-09-21T22:17:33.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514670+0000", 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5889999999999996e-06 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144062 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521371+0000", 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077314539999999996, 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011780301, 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144062 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521371+0000", 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521371+0000", 2024-09-21T22:17:33.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521372+0000", 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.51e-07 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521374+0000", 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521380+0000", 2024-09-21T22:17:33.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521393+0000", 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2872e-05 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144126 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523989+0000", 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051138440000000002, 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092159029999999992, 2024-09-21T22:17:33.775 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144126 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523989+0000", 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523989+0000", 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523989+0000", 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523991+0000", 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523994+0000", 2024-09-21T22:17:33.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6959999999999998e-06 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523997+0000", 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.96e-06 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144224 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527962+0000", 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001140971, 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052979129999999996, 2024-09-21T22:17:33.778 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144224 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527962+0000", 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527962+0000", 2024-09-21T22:17:33.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527962+0000", 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527964+0000", 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0810000000000001e-06 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527970+0000", 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1759999999999998e-06 2024-09-21T22:17:33.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527975+0000", 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4909999999999999e-06 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143872 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513035+0000", 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01606745, 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020280962, 2024-09-21T22:17:33.781 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143872 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513035+0000", 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513035+0000", 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513035+0000", 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.77e-07 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513037+0000", 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9199999999999998e-06 2024-09-21T22:17:33.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513043+0000", 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.874e-06 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513048+0000", 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0989999999999998e-06 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143968 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513946+0000", 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015156321, 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019422036, 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143968 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513946+0000", 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513946+0000", 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513947+0000", 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4299999999999998e-07 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513949+0000", 2024-09-21T22:17:33.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9589999999999998e-06 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513955+0000", 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513960+0000", 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3109999999999996e-06 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143999 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514676+0000", 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014426177, 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018745818000000001, 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143999 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514676+0000", 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514676+0000", 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514677+0000", 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514679+0000", 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514685+0000", 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.947e-06 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514697+0000", 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1990999999999999e-05 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144063 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521400+0000", 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077028909999999999, 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012070724, 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144063 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521400+0000", 2024-09-21T22:17:33.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521400+0000", 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521400+0000", 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2500000000000001e-07 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521406+0000", 2024-09-21T22:17:33.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.224e-06 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521414+0000", 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521419+0000", 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1719999999999998e-06 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144127 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.524001+0000", 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051012820000000004, 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095192599999999999, 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144127 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524001+0000", 2024-09-21T22:17:33.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524001+0000", 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524001+0000", 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.22e-07 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524003+0000", 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2190000000000001e-06 2024-09-21T22:17:33.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524009+0000", 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7290000000000003e-06 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524016+0000", 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0670000000000003e-06 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144225 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.527981+0000", 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001121765, 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005590986, 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144225 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527981+0000", 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527981+0000", 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527981+0000", 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.77e-07 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527983+0000", 2024-09-21T22:17:33.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0770000000000002e-06 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527989+0000", 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.527998+0000", 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1880000000000008e-06 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143873 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513054+0000", 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016048239999999998, 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020573026000000001, 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143873 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513054+0000", 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513054+0000", 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513055+0000", 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3300000000000002e-07 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513057+0000", 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513063+0000", 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7459999999999997e-06 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513153+0000", 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0203000000000004e-05 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143969 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513966+0000", 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015136891, 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019723514000000001, 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143969 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513966+0000", 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513966+0000", 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513966+0000", 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513968+0000", 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9439999999999999e-06 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513974+0000", 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7910000000000001e-06 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513979+0000", 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.899e-06 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144000 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514704+0000", 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014398948999999999, 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019039002999999999, 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144000 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514704+0000", 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514704+0000", 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514704+0000", 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514706+0000", 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514712+0000", 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1840000000000004e-06 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514717+0000", 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7160000000000002e-06 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144064 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521426+0000", 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076769949999999998, 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012365251000000001, 2024-09-21T22:17:33.809 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144064 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521426+0000", 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521426+0000", 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521426+0000", 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.34e-07 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521428+0000", 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.165e-06 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521434+0000", 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1099999999999999e-06 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521439+0000", 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7500000000000003e-06 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144128 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.524020+0000", 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0050820780000000003, 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098105399999999995, 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144128 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524020+0000", 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524020+0000", 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524021+0000", 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5699999999999999e-07 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524029+0000", 2024-09-21T22:17:33.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5690000000000005e-06 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524034+0000", 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9529999999999998e-06 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524037+0000", 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0989999999999999e-06 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144226 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528004+0000", 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010983259999999999, 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058817339999999996, 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144226 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528004+0000", 2024-09-21T22:17:33.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528004+0000", 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528005+0000", 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528007+0000", 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528012+0000", 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5629999999999999e-06 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528018+0000", 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3870000000000003e-06 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143874 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513163+0000", 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015939666000000002, 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020777594999999999, 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143874 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513163+0000", 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513163+0000", 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513163+0000", 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1099999999999995e-07 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513167+0000", 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.19e-06 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513173+0000", 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4280000000000001e-06 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513178+0000", 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.254e-06 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143970 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513984+0000", 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015118100000000001, 2024-09-21T22:17:33.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020005947, 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143970 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513984+0000", 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513984+0000", 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513985+0000", 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1800000000000001e-07 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513991+0000", 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9889999999999997e-06 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513997+0000", 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8680000000000004e-06 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514002+0000", 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8250000000000004e-06 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144001 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514723+0000", 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014379876, 2024-09-21T22:17:33.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019318706000000001, 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144001 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514723+0000", 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514723+0000", 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514723+0000", 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.01e-07 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514725+0000", 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8500000000000001e-06 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514731+0000", 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7980000000000002e-06 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514735+0000", 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6480000000000002e-06 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144065 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521445+0000", 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076575430000000002, 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012648589, 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144065 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521445+0000", 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521445+0000", 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521445+0000", 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521452+0000", 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521458+0000", 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6660000000000002e-06 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521468+0000", 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4210000000000001e-06 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144129 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.524041+0000", 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0050614500000000003, 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010106255, 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144129 2024-09-21T22:17:33.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524041+0000", 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524041+0000", 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524041+0000", 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.35e-07 2024-09-21T22:17:33.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524043+0000", 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.373e-06 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524047+0000", 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2660000000000003e-06 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524050+0000", 2024-09-21T22:17:33.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.587e-06 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144227 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528035+0000", 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010670899999999999, 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061659660000000002, 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144227 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528035+0000", 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528035+0000", 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528036+0000", 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528044+0000", 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5480000000000004e-06 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528051+0000", 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2880000000000004e-06 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528056+0000", 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0599999999999998e-06 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143875 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513221+0000", 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015881912000000002, 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021037042999999998, 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143875 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513221+0000", 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513221+0000", 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513221+0000", 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4099999999999998e-07 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513224+0000", 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.65e-06 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513231+0000", 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6760000000000001e-06 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513236+0000", 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1000000000000003e-06 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143971 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514008+0000", 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015094832000000001, 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020302317, 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.840 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143971 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514008+0000", 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514008+0000", 2024-09-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514008+0000", 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7399999999999999e-07 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514010+0000", 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8899999999999999e-06 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514016+0000", 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9880000000000001e-06 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514021+0000", 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144002 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514741+0000", 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014361387999999999, 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019622995000000001, 2024-09-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144002 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514741+0000", 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514741+0000", 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514741+0000", 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2099999999999998e-07 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514743+0000", 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.809e-06 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514749+0000", 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.891e-06 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514754+0000", 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144066 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521475+0000", 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076278320000000002, 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012942018, 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144066 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521475+0000", 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521475+0000", 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521475+0000", 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521477+0000", 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521483+0000", 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9490000000000001e-06 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521488+0000", 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8999999999999997e-06 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144130 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.524053+0000", 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0050493220000000002, 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010417799, 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144130 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524053+0000", 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.524053+0000", 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525481+0000", 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014282310000000001 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525486+0000", 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6689999999999997e-06 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525495+0000", 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5939999999999994e-06 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525508+0000", 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144228 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528064+0000", 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010384319999999999, 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064614160000000002, 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144228 2024-09-21T22:17:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528064+0000", 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528064+0000", 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528065+0000", 2024-09-21T22:17:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4499999999999997e-07 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528067+0000", 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4779999999999998e-06 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528073+0000", 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.246e-06 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528078+0000", 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5940000000000004e-06 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143876 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513243+0000", 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015859025999999998, 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021337529000000001, 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143876 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513243+0000", 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513243+0000", 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513244+0000", 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513246+0000", 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3479999999999998e-06 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513252+0000", 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2049999999999999e-06 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513257+0000", 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.899e-06 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143972 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514028+0000", 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015074954999999999, 2024-09-21T22:17:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020606106999999999, 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143972 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514028+0000", 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514028+0000", 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514028+0000", 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514030+0000", 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.813e-06 2024-09-21T22:17:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514036+0000", 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514046+0000", 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0176e-05 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144003 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514760+0000", 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014342285, 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019924676999999998, 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144003 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514760+0000", 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514760+0000", 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514761+0000", 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:17:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514762+0000", 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7349999999999999e-06 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514776+0000", 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3971000000000001e-05 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514781+0000", 2024-09-21T22:17:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8930000000000004e-06 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144067 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521494+0000", 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076083380000000001, 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013225208, 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144067 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521494+0000", 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521494+0000", 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521495+0000", 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521497+0000", 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521502+0000", 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.767e-06 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521508+0000", 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5210000000000002e-06 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144131 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525521+0000", 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003581683, 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092255689999999994, 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144131 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525521+0000", 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525521+0000", 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525521+0000", 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0699999999999997e-07 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525524+0000", 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525531+0000", 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6499999999999999e-06 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525536+0000", 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144229 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528085+0000", 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010175150000000001, 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066935069999999996, 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144229 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528085+0000", 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528085+0000", 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528085+0000", 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528088+0000", 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528094+0000", 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2090000000000002e-06 2024-09-21T22:17:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528098+0000", 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4279999999999998e-06 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143877 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513265+0000", 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015837974000000001, 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021543518000000001, 2024-09-21T22:17:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143877 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513265+0000", 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513265+0000", 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513265+0000", 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513267+0000", 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.367e-06 2024-09-21T22:17:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513295+0000", 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7285e-05 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513300+0000", 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143973 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514052+0000", 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015050030000000001, 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020784067999999999, 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143973 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514052+0000", 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514052+0000", 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514053+0000", 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:17:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514055+0000", 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2800000000000002e-06 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514061+0000", 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9970000000000004e-06 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514066+0000", 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3029999999999999e-06 2024-09-21T22:17:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144004 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514788+0000", 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014314617999999999, 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020075636000000001, 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144004 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514788+0000", 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514788+0000", 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518493+0000", 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037051879999999999 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518498+0000", 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5480000000000003e-06 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518509+0000", 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.169e-05 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518517+0000", 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5499999999999997e-06 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144068 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521524+0000", 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075786380000000004, 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013367501, 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144068 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521524+0000", 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521524+0000", 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521524+0000", 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521526+0000", 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1749999999999999e-06 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521532+0000", 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9429999999999997e-06 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521537+0000", 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0420000000000002e-06 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144132 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525543+0000", 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003559455, 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093760460000000007, 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144132 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525543+0000", 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525543+0000", 2024-09-21T22:17:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525543+0000", 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-07 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525546+0000", 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.058e-06 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525552+0000", 2024-09-21T22:17:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1090000000000003e-06 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525556+0000", 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144230 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528106+0000", 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000996184, 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068408549999999999, 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144230 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528106+0000", 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528106+0000", 2024-09-21T22:17:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528107+0000", 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528109+0000", 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2620000000000001e-06 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528115+0000", 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4160000000000001e-06 2024-09-21T22:17:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528121+0000", 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8449999999999999e-06 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143878 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513309+0000", 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015793854, 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021667453999999999, 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143878 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513309+0000", 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513309+0000", 2024-09-21T22:17:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513309+0000", 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513318+0000", 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9619999999999999e-06 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513325+0000", 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1879999999999996e-06 2024-09-21T22:17:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513330+0000", 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143974 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514073+0000", 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015030000999999999, 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02093126, 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143974 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514073+0000", 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514073+0000", 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514073+0000", 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7e-07 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514075+0000", 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.968e-06 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514082+0000", 2024-09-21T22:17:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6900000000000003e-06 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514086+0000", 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5220000000000001e-06 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144005 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518531+0000", 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010571904, 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016500391, 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144005 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518531+0000", 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518531+0000", 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518531+0000", 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.75e-07 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518534+0000", 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518541+0000", 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0500000000000003e-06 2024-09-21T22:17:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518546+0000", 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3530000000000002e-06 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144069 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521544+0000", 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075586380000000003, 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013514722999999999, 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144069 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521544+0000", 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521544+0000", 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521544+0000", 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521546+0000", 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9319999999999999e-06 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521552+0000", 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9499999999999998e-06 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521558+0000", 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8690000000000001e-06 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144133 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525563+0000", 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0035391490000000001, 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095231440000000007, 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144133 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525563+0000", 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525563+0000", 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525564+0000", 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525570+0000", 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7629999999999997e-06 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525576+0000", 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8419999999999999e-06 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525582+0000", 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8490000000000002e-06 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144231 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528128+0000", 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00097475299999999997, 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069854009999999996, 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144231 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528128+0000", 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528128+0000", 2024-09-21T22:17:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528128+0000", 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528130+0000", 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9860000000000001e-06 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528136+0000", 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8409999999999996e-06 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528141+0000", 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7910000000000004e-06 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143879 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513338+0000", 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015764726999999999, 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02180377, 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143879 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513338+0000", 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513338+0000", 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513338+0000", 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.58e-07 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513341+0000", 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3599999999999999e-06 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513347+0000", 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2949999999999999e-06 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513352+0000", 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0590000000000002e-06 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143975 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514102+0000", 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015000064, 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021066239, 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143975 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514102+0000", 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514102+0000", 2024-09-21T22:17:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514103+0000", 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514110+0000", 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.362e-06 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514116+0000", 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514121+0000", 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144006 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518553+0000", 2024-09-21T22:17:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010549011, 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016642312999999999, 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144006 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518553+0000", 2024-09-21T22:17:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518553+0000", 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518554+0000", 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518560+0000", 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7509999999999997e-06 2024-09-21T22:17:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518567+0000", 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8750000000000002e-06 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518572+0000", 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1379999999999998e-06 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144070 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521564+0000", 2024-09-21T22:17:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075381959999999996, 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013658829000000001, 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144070 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521564+0000", 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521564+0000", 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521565+0000", 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6100000000000002e-07 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521567+0000", 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0059999999999999e-06 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521573+0000", 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0399999999999998e-06 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521577+0000", 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7439999999999998e-06 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144134 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525589+0000", 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003513324, 2024-09-21T22:17:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096611739999999998, 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144134 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525589+0000", 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525589+0000", 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525590+0000", 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525592+0000", 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2249999999999999e-06 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525598+0000", 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0519999999999998e-06 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525603+0000", 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8999999999999997e-06 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144232 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528146+0000", 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00095619200000000002, 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071315340000000001, 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144232 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528146+0000", 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528146+0000", 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528147+0000", 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528149+0000", 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9970000000000001e-06 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528154+0000", 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3820000000000003e-06 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528168+0000", 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4409e-05 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143880 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513358+0000", 2024-09-21T22:17:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015744588, 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021948256999999999, 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143880 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513358+0000", 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513358+0000", 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513358+0000", 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513360+0000", 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.058e-06 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513367+0000", 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7229999999999998e-06 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513372+0000", 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.622e-06 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143976 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514129+0000", 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014973983999999999, 2024-09-21T22:17:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021205215999999999, 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143976 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514129+0000", 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514129+0000", 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514129+0000", 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7199999999999999e-07 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514131+0000", 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0660000000000002e-06 2024-09-21T22:17:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514138+0000", 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514143+0000", 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0810000000000001e-06 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144007 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518617+0000", 2024-09-21T22:17:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010485339999999999, 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016743630999999998, 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144007 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518617+0000", 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518617+0000", 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518618+0000", 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0800000000000004e-07 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518620+0000", 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6110000000000001e-06 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518629+0000", 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5660000000000007e-06 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518635+0000", 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9630000000000003e-06 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144071 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521583+0000", 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00751924, 2024-09-21T22:17:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013804601, 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144071 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521583+0000", 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521583+0000", 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521584+0000", 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521586+0000", 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8819999999999999e-06 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521591+0000", 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8109999999999999e-06 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521602+0000", 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.112e-05 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144135 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525609+0000", 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034939150000000002, 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098066820000000006, 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144135 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525609+0000", 2024-09-21T22:17:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525609+0000", 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525609+0000", 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525611+0000", 2024-09-21T22:17:33.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0260000000000002e-06 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525618+0000", 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1029999999999996e-06 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525623+0000", 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8709999999999996e-06 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144233 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528175+0000", 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00092718300000000004, 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072671869999999996, 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144233 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528175+0000", 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528175+0000", 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528176+0000", 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528178+0000", 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528184+0000", 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.066e-06 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528189+0000", 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7140000000000001e-06 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143881 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513379+0000", 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015723918, 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022091792999999998, 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143881 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513379+0000", 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513379+0000", 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513379+0000", 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5899999999999996e-07 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513381+0000", 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513387+0000", 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9699999999999996e-06 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513399+0000", 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1807000000000001e-05 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143977 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514149+0000", 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014953032, 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021347809999999998, 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143977 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514149+0000", 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514149+0000", 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514150+0000", 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-07 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514152+0000", 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.007e-06 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514158+0000", 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2199999999999997e-06 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514163+0000", 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8890000000000001e-06 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.954 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144008 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518643+0000", 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010459473, 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016881149000000002, 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144008 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518643+0000", 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518643+0000", 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518643+0000", 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518653+0000", 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.38e-06 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518660+0000", 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3919999999999997e-06 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518670+0000", 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3910000000000004e-06 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144072 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521610+0000", 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074925180000000001, 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013941026, 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144072 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521610+0000", 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521610+0000", 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521610+0000", 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2e-07 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521613+0000", 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521620+0000", 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6390000000000003e-06 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521625+0000", 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0719999999999999e-06 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144136 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525629+0000", 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034732959999999998, 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099490069999999993, 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144136 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525629+0000", 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525629+0000", 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525630+0000", 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.65e-07 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525632+0000", 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1220000000000002e-06 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525637+0000", 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525642+0000", 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.78e-06 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144234 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528195+0000", 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00090771500000000002, 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074100470000000003, 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144234 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528195+0000", 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528195+0000", 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528195+0000", 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528197+0000", 2024-09-21T22:17:33.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.796e-06 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528203+0000", 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3489999999999997e-06 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528208+0000", 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2699999999999998e-06 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143882 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513406+0000", 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015696647000000001, 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022332218000000001, 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143882 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513406+0000", 2024-09-21T22:17:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513406+0000", 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513406+0000", 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513415+0000", 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5669999999999995e-06 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513422+0000", 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7680000000000003e-06 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513427+0000", 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.57e-06 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143978 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514170+0000", 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014932948, 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021623059, 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143978 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514170+0000", 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514170+0000", 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514170+0000", 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514172+0000", 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514179+0000", 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040000000000004e-06 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514184+0000", 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1529999999999996e-06 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144009 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518677+0000", 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010425640999999999, 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017148890999999999, 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144009 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518677+0000", 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518677+0000", 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518677+0000", 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518680+0000", 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.322e-06 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518686+0000", 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.72e-06 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518691+0000", 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144073 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521631+0000", 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074712210000000001, 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014221508000000001, 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144073 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521631+0000", 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521631+0000", 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521632+0000", 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521634+0000", 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.199e-06 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521640+0000", 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5220000000000004e-06 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521645+0000", 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9400000000000001e-06 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144137 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525661+0000", 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034413289999999999, 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010220204, 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144137 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525661+0000", 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525661+0000", 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525662+0000", 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525664+0000", 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2979999999999999e-06 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525670+0000", 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3949999999999998e-06 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525675+0000", 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.313e-06 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144235 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528214+0000", 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00088878099999999995, 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076949660000000001, 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144235 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528214+0000", 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528214+0000", 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528214+0000", 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3799999999999997e-07 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528220+0000", 2024-09-21T22:17:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.592e-06 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528226+0000", 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9880000000000001e-06 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528231+0000", 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8049999999999997e-06 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143883 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513434+0000", 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015668604999999999, 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022507031, 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143883 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513434+0000", 2024-09-21T22:17:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513434+0000", 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513434+0000", 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1600000000000001e-07 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513437+0000", 2024-09-21T22:17:33.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513443+0000", 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3749999999999999e-06 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513448+0000", 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9389999999999996e-06 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143979 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514190+0000", 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014912623, 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021796485000000001, 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143979 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514190+0000", 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514190+0000", 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514190+0000", 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-07 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514192+0000", 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9640000000000002e-06 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514198+0000", 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0739999999999998e-06 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514203+0000", 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7339999999999999e-06 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144010 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.990 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518698+0000", 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010404556000000001, 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017318977999999999, 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144010 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518698+0000", 2024-09-21T22:17:33.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518698+0000", 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518698+0000", 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-07 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518700+0000", 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518707+0000", 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518713+0000", 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.331e-06 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144074 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521652+0000", 2024-09-21T22:17:33.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074507419999999998, 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014393624000000001, 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144074 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521652+0000", 2024-09-21T22:17:33.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521652+0000", 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521652+0000", 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521659+0000", 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0430000000000002e-06 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521666+0000", 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8199999999999999e-06 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521671+0000", 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144138 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525682+0000", 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034209700000000002, 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010390923999999999, 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144138 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:33.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525682+0000", 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525682+0000", 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525682+0000", 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525684+0000", 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525690+0000", 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525695+0000", 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9080000000000003e-06 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144236 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528237+0000", 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00086514299999999997, 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078652889999999993, 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144236 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528237+0000", 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528237+0000", 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528238+0000", 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.51e-07 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528240+0000", 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9479999999999998e-06 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528245+0000", 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528250+0000", 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.622e-06 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143884 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513454+0000", 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015648012999999999, 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022677594999999998, 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143884 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513454+0000", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513454+0000", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513455+0000", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513457+0000", 2024-09-21T22:17:34.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.159e-06 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513463+0000", 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0820000000000004e-06 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513468+0000", 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6469999999999997e-06 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143980 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514208+0000", 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014894343000000001, 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021969803, 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143980 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514208+0000", 2024-09-21T22:17:34.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514208+0000", 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514208+0000", 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0100000000000001e-07 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514210+0000", 2024-09-21T22:17:34.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8080000000000001e-06 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514216+0000", 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0560000000000001e-06 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514221+0000", 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4490000000000001e-06 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144011 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.008 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518720+0000", 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010382822999999999, 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017486772000000001, 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144011 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518720+0000", 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518720+0000", 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518720+0000", 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4899999999999995e-07 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518722+0000", 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1880000000000001e-06 2024-09-21T22:17:34.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518729+0000", 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4819999999999999e-06 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518734+0000", 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.685e-06 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144075 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.011 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521678+0000", 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074244999999999997, 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014557466999999999, 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144075 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521678+0000", 2024-09-21T22:17:34.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521678+0000", 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521678+0000", 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521681+0000", 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.401e-06 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521686+0000", 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3639999999999998e-06 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521691+0000", 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6689999999999997e-06 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144139 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525700+0000", 2024-09-21T22:17:34.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034021070000000001, 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010562442, 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144139 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525700+0000", 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525700+0000", 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525701+0000", 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525709+0000", 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1599999999999998e-06 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525715+0000", 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525724+0000", 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5399999999999996e-06 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144237 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528256+0000", 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00084651699999999997, 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080355370000000006, 2024-09-21T22:17:34.017 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144237 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528256+0000", 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528256+0000", 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528256+0000", 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528258+0000", 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528264+0000", 2024-09-21T22:17:34.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7540000000000003e-06 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528269+0000", 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143885 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513474+0000", 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015628533, 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022847308, 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.020 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143885 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513474+0000", 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513474+0000", 2024-09-21T22:17:34.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513474+0000", 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3599999999999999e-07 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513476+0000", 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0650000000000001e-06 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513483+0000", 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8589999999999999e-06 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513489+0000", 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143981 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514227+0000", 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01487521, 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022136893000000001, 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143981 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514227+0000", 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514227+0000", 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514228+0000", 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514230+0000", 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9700000000000002e-06 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514235+0000", 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.823e-06 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514246+0000", 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0397000000000001e-05 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144012 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518741+0000", 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010361982, 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017652369000000001, 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144012 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518741+0000", 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518741+0000", 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518741+0000", 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518743+0000", 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9589999999999998e-06 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518749+0000", 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518754+0000", 2024-09-21T22:17:34.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7380000000000002e-06 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144076 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.521697+0000", 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074051940000000004, 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014724599, 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144076 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521697+0000", 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.521697+0000", 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522811+0000", 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011132970000000001 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522824+0000", 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3383e-05 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522834+0000", 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8980000000000008e-06 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522840+0000", 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4930000000000003e-06 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144140 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525731+0000", 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033712830000000001, 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010717666000000001, 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144140 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525731+0000", 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525731+0000", 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525732+0000", 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3200000000000005e-07 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525734+0000", 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525740+0000", 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2570000000000004e-06 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525745+0000", 2024-09-21T22:17:34.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8319999999999996e-06 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144238 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.528274+0000", 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00082811500000000004, 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082033620000000005, 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.035 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144238 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528274+0000", 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.528274+0000", 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529774+0000", 2024-09-21T22:17:34.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001499794 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529786+0000", 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1423000000000001e-05 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529795+0000", 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2529999999999993e-06 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529803+0000", 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1200000000000002e-06 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.037 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143886 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513495+0000", 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015607098999999999, 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023020466, 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143886 2024-09-21T22:17:34.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513495+0000", 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513495+0000", 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513496+0000", 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.39e-07 2024-09-21T22:17:34.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513498+0000", 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1280000000000002e-06 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513504+0000", 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8510000000000004e-06 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513510+0000", 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.818e-06 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143982 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514253+0000", 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014849753, 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022306647999999998, 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143982 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514253+0000", 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514253+0000", 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514253+0000", 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7399999999999999e-07 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514259+0000", 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514265+0000", 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3539999999999996e-06 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514270+0000", 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144013 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518760+0000", 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010342517000000001, 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017827987999999999, 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.044 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144013 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518760+0000", 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518760+0000", 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518760+0000", 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518762+0000", 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0940000000000002e-06 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518775+0000", 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2513e-05 2024-09-21T22:17:34.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518780+0000", 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2229999999999998e-06 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144077 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.522853+0000", 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062497589999999997, 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013762158, 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144077 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522853+0000", 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522853+0000", 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522853+0000", 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5000000000000003e-07 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522860+0000", 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2949999999999999e-06 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522866+0000", 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7089999999999996e-06 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522871+0000", 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9690000000000002e-06 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144141 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525751+0000", 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033514310000000002, 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010892864, 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144141 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525751+0000", 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525751+0000", 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525752+0000", 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8100000000000003e-07 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525753+0000", 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9319999999999999e-06 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525759+0000", 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.835e-06 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525764+0000", 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144239 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.529816+0000", 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9992862, 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068558009999999999, 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144239 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529816+0000", 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529816+0000", 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529817+0000", 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4199999999999995e-07 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529819+0000", 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529826+0000", 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3799999999999999e-06 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529831+0000", 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:34.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143887 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513525+0000", 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015577463, 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023178279999999999, 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143887 2024-09-21T22:17:34.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513525+0000", 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513525+0000", 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513525+0000", 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:17:34.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513546+0000", 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0169999999999998e-05 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513552+0000", 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8870000000000003e-06 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513558+0000", 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6030000000000004e-06 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.058 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143983 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514289+0000", 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014813777, 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022454345000000001, 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143983 2024-09-21T22:17:34.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514289+0000", 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514289+0000", 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514289+0000", 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514291+0000", 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.351e-06 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514300+0000", 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0460000000000006e-06 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514304+0000", 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5589999999999999e-06 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144014 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518845+0000", 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010257258999999999, 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017933215999999998, 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144014 2024-09-21T22:17:34.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518845+0000", 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518845+0000", 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518846+0000", 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1799999999999995e-07 2024-09-21T22:17:34.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518848+0000", 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5739999999999998e-06 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518856+0000", 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518861+0000", 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1989999999999997e-06 2024-09-21T22:17:34.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144078 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.522879+0000", 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062235600000000004, 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013927089, 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144078 2024-09-21T22:17:34.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522879+0000", 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522879+0000", 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522879+0000", 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:17:34.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522882+0000", 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2350000000000002e-06 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522887+0000", 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522892+0000", 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4560000000000002e-06 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.067 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144142 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525776+0000", 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033263490000000001, 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011058194, 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144142 2024-09-21T22:17:34.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525776+0000", 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525776+0000", 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525777+0000", 2024-09-21T22:17:34.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9200000000000001e-07 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525779+0000", 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1639999999999999e-06 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525785+0000", 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1659999999999999e-06 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525790+0000", 2024-09-21T22:17:34.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0069999999999997e-06 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144240 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.529856+0000", 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9992461, 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070056229999999999, 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144240 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529856+0000", 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529856+0000", 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529857+0000", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529859+0000", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529866+0000", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4130000000000003e-06 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529871+0000", 2024-09-21T22:17:34.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143888 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513567+0000", 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015535418, 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023325164999999998, 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143888 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513567+0000", 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513567+0000", 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513568+0000", 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1600000000000001e-07 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513570+0000", 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513576+0000", 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3439999999999997e-06 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513581+0000", 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143984 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514311+0000", 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01479165, 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022622498000000001, 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143984 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514311+0000", 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514311+0000", 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514311+0000", 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514313+0000", 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9539999999999998e-06 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514319+0000", 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0009999999999998e-06 2024-09-21T22:17:34.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514324+0000", 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144015 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518869+0000", 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010233396000000001, 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018093929000000002, 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144015 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518869+0000", 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518869+0000", 2024-09-21T22:17:34.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518869+0000", 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518872+0000", 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4059999999999999e-06 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518878+0000", 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4500000000000001e-06 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518883+0000", 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1320000000000002e-06 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144079 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.522899+0000", 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062036590000000003, 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014091332, 2024-09-21T22:17:34.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144079 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522899+0000", 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522899+0000", 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522899+0000", 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522902+0000", 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.334e-06 2024-09-21T22:17:34.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522907+0000", 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9109999999999998e-06 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522912+0000", 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144143 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525797+0000", 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033055269999999999, 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011221596, 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144143 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525797+0000", 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525797+0000", 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525797+0000", 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.34e-07 2024-09-21T22:17:34.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525799+0000", 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525805+0000", 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7450000000000001e-06 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525810+0000", 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5299999999999998e-06 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.089 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144241 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.529878+0000", 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9992242, 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071686919999999999, 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144241 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529878+0000", 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529878+0000", 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529879+0000", 2024-09-21T22:17:34.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529881+0000", 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1880000000000001e-06 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529887+0000", 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0279999999999997e-06 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529898+0000", 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0628999999999999e-05 2024-09-21T22:17:34.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143889 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513587+0000", 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01551521, 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023490317, 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143889 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513587+0000", 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513587+0000", 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513588+0000", 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513596+0000", 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9980000000000003e-06 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513602+0000", 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2280000000000003e-06 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513607+0000", 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.259e-06 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143985 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514330+0000", 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014772545999999999, 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022788032999999999, 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143985 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514330+0000", 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514330+0000", 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514330+0000", 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.65e-07 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514332+0000", 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.773e-06 2024-09-21T22:17:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514338+0000", 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8289999999999996e-06 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514343+0000", 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.887e-06 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144016 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518890+0000", 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010212598999999999, 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018257662000000001, 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144016 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518890+0000", 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518890+0000", 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518890+0000", 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.37e-07 2024-09-21T22:17:34.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518893+0000", 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0849999999999999e-06 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518899+0000", 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.19e-06 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518904+0000", 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:17:34.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144080 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.522933+0000", 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.006169234, 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014241445, 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.103 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144080 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522933+0000", 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522933+0000", 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522934+0000", 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522936+0000", 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2369999999999999e-06 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522942+0000", 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9769999999999997e-06 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522954+0000", 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2381999999999999e-05 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144144 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525816+0000", 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032866549999999999, 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011385885, 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144144 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525816+0000", 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525816+0000", 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525816+0000", 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525818+0000", 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9520000000000001e-06 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525823+0000", 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525828+0000", 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4469999999999999e-06 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144242 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.529905+0000", 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.999198, 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073259279999999998, 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144242 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529905+0000", 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529905+0000", 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529905+0000", 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529907+0000", 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.238e-06 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529913+0000", 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529918+0000", 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8609999999999997e-06 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143890 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513614+0000", 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015488339, 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023646354000000001, 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143890 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513614+0000", 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513614+0000", 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513615+0000", 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513617+0000", 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1969999999999999e-06 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513623+0000", 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8730000000000004e-06 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513632+0000", 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7100000000000002e-06 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143986 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514348+0000", 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014754282000000001, 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022952937999999999, 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.116 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143986 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514348+0000", 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514348+0000", 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514349+0000", 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4999999999999998e-07 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514356+0000", 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0190000000000001e-06 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514362+0000", 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2439999999999998e-06 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514367+0000", 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0019999999999997e-06 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144017 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518910+0000", 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010192491999999999, 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018419649999999999, 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144017 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518910+0000", 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518910+0000", 2024-09-21T22:17:34.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518910+0000", 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518912+0000", 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518919+0000", 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2920000000000001e-06 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518929+0000", 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.078e-05 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144081 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.522962+0000", 2024-09-21T22:17:34.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0061408349999999999, 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014397630999999999, 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144081 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522962+0000", 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522962+0000", 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522962+0000", 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6699999999999999e-07 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522964+0000", 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1129999999999999e-06 2024-09-21T22:17:34.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522971+0000", 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9550000000000003e-06 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522976+0000", 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144145 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525854+0000", 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032488360000000002, 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011533168999999999, 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144145 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525854+0000", 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525854+0000", 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525854+0000", 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3000000000000001e-07 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525861+0000", 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.216e-06 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525868+0000", 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525874+0000", 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6720000000000001e-06 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144243 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.529924+0000", 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9991784, 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074917669999999999, 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144243 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529924+0000", 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529924+0000", 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529925+0000", 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529926+0000", 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7230000000000001e-06 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529932+0000", 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9359999999999996e-06 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529937+0000", 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143955 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513638+0000", 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015464011999999999, 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023807206000000001, 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143955 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513638+0000", 2024-09-21T22:17:34.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513638+0000", 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513639+0000", 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513641+0000", 2024-09-21T22:17:34.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513647+0000", 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1070000000000001e-06 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513652+0000", 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8119999999999998e-06 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143987 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514373+0000", 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014729186999999999, 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023116245000000001, 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143987 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514373+0000", 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514373+0000", 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514374+0000", 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514376+0000", 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514381+0000", 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7019999999999998e-06 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514386+0000", 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7670000000000003e-06 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144018 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.518936+0000", 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010166069999999999, 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018580749000000001, 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144018 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518936+0000", 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518936+0000", 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518937+0000", 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.51e-07 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518942+0000", 2024-09-21T22:17:34.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518949+0000", 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.518954+0000", 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2229999999999998e-06 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144082 3.1b 3.685603b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.522982+0000", 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0061201709999999998, 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01456474, 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144082 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522982+0000", 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522982+0000", 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522983+0000", 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1399999999999998e-07 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522984+0000", 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.807e-06 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522990+0000", 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.614e-06 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.522995+0000", 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4859999999999999e-06 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144146 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525883+0000", 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032193590000000002, 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011691589, 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144146 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.144 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525883+0000", 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525883+0000", 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525884+0000", 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.53e-07 2024-09-21T22:17:34.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525886+0000", 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0430000000000002e-06 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525892+0000", 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7669999999999998e-06 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525897+0000", 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.989e-06 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144244 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.529943+0000", 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9991598, 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076603840000000001, 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.147 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144244 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529943+0000", 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529943+0000", 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529943+0000", 2024-09-21T22:17:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529945+0000", 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-06 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529951+0000", 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7819999999999999e-06 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529955+0000", 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4669999999999998e-06 2024-09-21T22:17:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143956 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.513658+0000", 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01544475, 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023975751999999999, 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143956 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513658+0000", 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513658+0000", 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513658+0000", 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1e-07 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513660+0000", 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513666+0000", 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.513670+0000", 2024-09-21T22:17:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4139999999999996e-06 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:143988 3.1f 3.48ed47f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.514392+0000", 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014710979000000001, 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023286628, 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 143988 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514392+0000", 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514392+0000", 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514392+0000", 2024-09-21T22:17:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1100000000000002e-07 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514393+0000", 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.629e-06 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514399+0000", 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8189999999999997e-06 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.514404+0000", 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4460000000000003e-06 2024-09-21T22:17:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144115 3.1f 3.e01f2bdf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.523001+0000", 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.006101052, 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014704267, 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144115 2024-09-21T22:17:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523001+0000", 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523001+0000", 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523002+0000", 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523004+0000", 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2019999999999998e-06 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523051+0000", 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6619000000000002e-05 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.523057+0000", 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0769999999999996e-06 2024-09-21T22:17:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144147 3.1b 3.801aa29b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.525904+0000", 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0031987809999999999, 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011829335, 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144147 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525904+0000", 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525904+0000", 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525904+0000", 2024-09-21T22:17:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1099999999999996e-07 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525906+0000", 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.827e-06 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525912+0000", 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.525917+0000", 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7280000000000003e-06 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:144245 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:33.529961+0000", 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9991417, 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078009059999999998, 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 144245 2024-09-21T22:17:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529961+0000", 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529961+0000", 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529961+0000", 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:17:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529963+0000", 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9520000000000001e-06 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529969+0000", 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7989999999999999e-06 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.529973+0000", 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:17:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 201 2024-09-21T22:17:34.165 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:34.166 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:34.166 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:34.165+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:34.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:34.265+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:34.309 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:34.309 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:34.318 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:34.367 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:34.367+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:34.468 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:34.467+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138954 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1862656~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.955789+0000", 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.568315578, 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063238053000000002, 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138954 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955789+0000", 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955789+0000", 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955789+0000", 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955791+0000", 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.328e-06 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955798+0000", 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2430000000000002e-06 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955802+0000", 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7659999999999998e-06 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.018860+0000", 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063057516999999993 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.018935+0000", 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5278000000000007e-05 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019027+0000", 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1488000000000002e-05 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138955 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1870848~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.955808+0000", 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.568296106, 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063693388000000004, 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138955 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955808+0000", 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955808+0000", 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955808+0000", 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5699999999999998e-07 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955810+0000", 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0449999999999999e-06 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955816+0000", 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6999999999999996e-06 2024-09-21T22:17:34.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955821+0000", 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6739999999999996e-06 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019059+0000", 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063238589999999997 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019406+0000", 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034705499999999998 2024-09-21T22:17:34.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019501+0000", 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4967000000000001e-05 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138956 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1879040~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.955826+0000", 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5682776779999998, 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063916535999999996, 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138956 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955826+0000", 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955826+0000", 2024-09-21T22:17:34.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955827+0000", 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955829+0000", 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955835+0000", 2024-09-21T22:17:34.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7250000000000002e-06 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955839+0000", 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7809999999999996e-06 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019531+0000", 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063692028999999997 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019602+0000", 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0896999999999996e-05 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019743+0000", 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014070099999999999 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138957 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1887232~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.955858+0000", 2024-09-21T22:17:34.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5682465059999999, 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064141466999999994, 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138957 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955858+0000", 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955858+0000", 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955858+0000", 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955880+0000", 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1908000000000001e-05 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955888+0000", 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1319999999999994e-06 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955894+0000", 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019782+0000", 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063887852999999994 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019901+0000", 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118924 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.019999+0000", 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8540000000000002e-05 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138958 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1895424~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.955901+0000", 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5682027270000001, 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064337892999999993, 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138958 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.544 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955901+0000", 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955901+0000", 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955902+0000", 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:17:34.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955904+0000", 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6000000000000001e-06 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955910+0000", 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955915+0000", 2024-09-21T22:17:34.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8199999999999996e-06 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.020054+0000", 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064138574000000004 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.020138+0000", 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3888999999999996e-05 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.020239+0000", 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101586 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138959 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1903616~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.955921+0000", 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5681833890000001, 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064517702999999996, 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138959 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955921+0000", 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.955921+0000", 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.957773+0000", 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018525519999999999 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.957778+0000", 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.957788+0000", 2024-09-21T22:17:34.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6989999999999998e-06 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.957794+0000", 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8419999999999999e-06 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.020271+0000", 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062476298999999999 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.020344+0000", 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3559999999999994e-05 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.020438+0000", 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4166999999999995e-05 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138964 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1944576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958727+0000", 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5653774629999999, 2024-09-21T22:17:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063083693999999996, 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138964 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958727+0000", 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958727+0000", 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958727+0000", 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.15e-07 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958729+0000", 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9400000000000001e-06 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958735+0000", 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8329999999999999e-06 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958739+0000", 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5310000000000003e-06 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.021572+0000", 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06283263 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.021646+0000", 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3918999999999995e-05 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.021810+0000", 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016452599999999999 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138965 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1952768~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958745+0000", 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5653593020000001, 2024-09-21T22:17:34.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063255931000000001, 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138965 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958745+0000", 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958745+0000", 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958745+0000", 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7399999999999999e-07 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958747+0000", 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.086e-06 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958753+0000", 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6269999999999997e-06 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958757+0000", 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3429999999999998e-06 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.021841+0000", 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063083531999999998 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.021914+0000", 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3159999999999997e-05 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022001+0000", 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6809000000000002e-05 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138966 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1960960~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958763+0000", 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5653414839999999, 2024-09-21T22:17:34.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063424317999999993, 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138966 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958763+0000", 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958763+0000", 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958763+0000", 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0199999999999998e-07 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958765+0000", 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2879999999999999e-06 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958776+0000", 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0522e-05 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958781+0000", 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419999999999997e-06 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022029+0000", 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063248483999999994 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022101+0000", 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1626999999999997e-05 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022187+0000", 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6353000000000005e-05 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138967 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1969152~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958787+0000", 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5653175799999999, 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063583319999999999, 2024-09-21T22:17:34.564 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138967 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958787+0000", 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958787+0000", 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958787+0000", 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958789+0000", 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4420000000000001e-06 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958795+0000", 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6239999999999999e-06 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958800+0000", 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9130000000000002e-06 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022215+0000", 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063414818999999997 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022285+0000", 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9783000000000006e-05 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022370+0000", 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5340999999999995e-05 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138968 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1977344~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.568 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958822+0000", 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5652823759999999, 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063734207000000001, 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138968 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958822+0000", 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958822+0000", 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958822+0000", 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8299999999999997e-07 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958825+0000", 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3290000000000001e-06 2024-09-21T22:17:34.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958831+0000", 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958836+0000", 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7539999999999997e-06 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022399+0000", 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063562481000000004 2024-09-21T22:17:34.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022469+0000", 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0947999999999999e-05 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022556+0000", 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6512000000000001e-05 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.572 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138969 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1985536~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958842+0000", 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.565261993, 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064282132000000006, 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138969 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958842+0000", 2024-09-21T22:17:34.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958842+0000", 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958843+0000", 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1600000000000002e-07 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958850+0000", 2024-09-21T22:17:34.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4309999999999997e-06 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958856+0000", 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958860+0000", 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4000000000000002e-06 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022584+0000", 2024-09-21T22:17:34.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063723813000000004 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.022653+0000", 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9368000000000004e-05 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023124+0000", 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047080499999999998 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138970 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 1993728~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958866+0000", 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5652379160000001, 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064455037000000007, 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138970 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958866+0000", 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958866+0000", 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958867+0000", 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.53e-07 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958869+0000", 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9589999999999998e-06 2024-09-21T22:17:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958874+0000", 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6319999999999996e-06 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958879+0000", 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6970000000000001e-06 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023156+0000", 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064277237000000001 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023229+0000", 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2866000000000003e-05 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023321+0000", 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2293000000000006e-05 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138971 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2001920~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958884+0000", 2024-09-21T22:17:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.565219806, 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064623888000000004, 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138971 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958884+0000", 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958884+0000", 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958885+0000", 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958887+0000", 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9120000000000001e-06 2024-09-21T22:17:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958892+0000", 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5840000000000002e-06 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958897+0000", 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5549999999999996e-06 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023351+0000", 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064454182999999998 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023422+0000", 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1046999999999999e-05 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023508+0000", 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6279000000000005e-05 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138972 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2010112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958902+0000", 2024-09-21T22:17:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5652020549999999, 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064789596000000005, 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138972 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958902+0000", 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958902+0000", 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958902+0000", 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1300000000000001e-07 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958904+0000", 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9750000000000001e-06 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958910+0000", 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5210000000000002e-06 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958914+0000", 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5329999999999996e-06 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023537+0000", 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064622114999999994 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023606+0000", 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9345999999999996e-05 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023692+0000", 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5792999999999997e-05 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138973 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2018304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.958920+0000", 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5651842359999999, 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065252399000000003, 2024-09-21T22:17:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138973 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958920+0000", 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.958920+0000", 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960041+0000", 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011208870000000001 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960045+0000", 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960059+0000", 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.345e-05 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960067+0000", 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023720+0000", 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063653480999999998 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.023778+0000", 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7951000000000001e-05 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024172+0000", 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039431200000000002 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138974 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2026496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.960079+0000", 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5640250020000002, 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064242149999999998, 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138974 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960079+0000", 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960079+0000", 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960080+0000", 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4000000000000002e-07 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960082+0000", 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7080000000000002e-06 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960090+0000", 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3459999999999996e-06 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960096+0000", 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.896e-06 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024192+0000", 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064095999000000001 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024239+0000", 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7759999999999997e-05 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024321+0000", 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1901000000000001e-05 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138975 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2034688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.960104+0000", 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5640006440000001, 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064444085999999998, 2024-09-21T22:17:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138975 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960104+0000", 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960104+0000", 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960104+0000", 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960106+0000", 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4360000000000001e-06 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960113+0000", 2024-09-21T22:17:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3620000000000002e-06 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960118+0000", 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.994e-06 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024371+0000", 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064253743000000002 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024448+0000", 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6987e-05 2024-09-21T22:17:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024548+0000", 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.912e-05 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138976 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2042880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.960124+0000", 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5639797039999999, 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064677118000000006, 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138976 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960124+0000", 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960124+0000", 2024-09-21T22:17:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960125+0000", 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960127+0000", 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1280000000000002e-06 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960133+0000", 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0929999999999999e-06 2024-09-21T22:17:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960138+0000", 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024604+0000", 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064466269000000007 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024689+0000", 2024-09-21T22:17:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4915999999999998e-05 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024802+0000", 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112339 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:138977 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 2051072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:32.960145+0000", 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.563959571, 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064873945000000002, 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138977 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960145+0000", 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.960145+0000", 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.962791+0000", 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026460730000000001 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.962805+0000", 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4068e-05 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.962817+0000", 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1926000000000001e-05 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:32.962828+0000", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024850+0000", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062022490999999999 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.024924+0000", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3409000000000001e-05 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:33.025019+0000", 2024-09-21T22:17:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4689000000000001e-05 2024-09-21T22:17:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:34.608 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:34.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:34.610 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:34.608+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:34.710 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:34.709+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:34.775 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:34.776 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:34.776 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:34.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:34.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:34.829+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:34.912 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:34.911+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:34.912 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:34.990 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:34.990 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:34.990 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:34.990 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:34.990 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:35.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:17:35.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:35.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:35.045+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:35.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:35.112+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:35.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:35.153 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:35.191 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:35.191 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:35.211 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:35.211 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:35.214 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:35.213+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:35.219 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:35.219 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:35.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:35.248 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:35.249 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:35.277 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:35.303 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:35.303 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:35.314 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:35.314+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:35.334 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:35.334 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:35.370 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:35.370 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:35.412 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:35.412 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:35.415 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:35.414+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:35.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:35.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:35.515+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:35.617 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:35.616+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:35.629 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:35.630 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:35.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:35.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:35.727+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:35.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:35.818+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:35.852 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:35.852 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:35.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:35.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:35.918+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:35.972 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:35.972 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:35.979 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:35.979 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:35.979 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T22:17:35.979 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.615768 2024-09-21T22:17:35.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.6157681786413136 2024-09-21T22:17:35.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:36.001 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:17:36.024 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:36.024+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:36.089 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:36.089 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:36.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:36.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:36.120+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:36.222 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:36.221+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:36.245 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:36.246 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:36.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:36.338 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:36.338+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:36.400 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:36.401 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:36.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:36.424 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:36.423+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:36.524 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:36.524+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:36.556 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:36.556 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:36.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:36.649 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:36.648+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:36.709 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:36.709 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:36.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:36.726 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:36.725+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:36.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:36.827+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:36.861 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:36.861 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:36.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.0 primary-affinity to 0.615768 (8403542) 2024-09-21T22:17:36.928 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:36.927+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:36.977 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:36.977 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:36.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:37.030 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:37.029+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:37.043 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-21T22:17:37.130 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:37.129+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:37.135 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:37.135 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:37.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:37.231 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:37.231+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:37.288 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:37.288 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:37.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:37.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:37.331+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:37.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:37.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:37.435+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:37.440 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:37.440 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:37.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:37.511 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:37.511 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:37.528 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:37.528 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:37.533 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:37.532+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:37.544 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:37.544 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:37.554 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:37.554 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:37.559 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:37.560 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:37.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:37.576 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:37.577 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:37.593 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:37.625 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:37.625 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:37.635 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:37.634+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:37.642 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:37.642 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:37.681 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:37.682 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:37.682 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:37.682 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:37.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:37.735 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:37.735+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:37.830 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:37.830 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:37.830 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:37.830 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:37.830 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:37.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:37.835+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:37.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:37.937 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:37.936+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:37.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.080101107000004, 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:37.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:17:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:37.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.077479034000007, 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:38.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:17:38.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:38.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0947738359999999, 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.004 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:17:38.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0454879849999998, 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160313 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5550080~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.945025+0000", 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0452604210000001, 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057262691999999997, 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160313 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945025+0000", 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945025+0000", 2024-09-21T22:17:38.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945184+0000", 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015922700000000001 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945187+0000", 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1319999999999998e-06 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945196+0000", 2024-09-21T22:17:38.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1099999999999992e-06 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945203+0000", 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4710000000000004e-06 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002101+0000", 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056898689000000002 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002184+0000", 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2876999999999999e-05 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002287+0000", 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103186 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160314 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5558272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.945213+0000", 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0450724830000002, 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057247944000000002, 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160314 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945213+0000", 2024-09-21T22:17:38.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945213+0000", 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946778+0000", 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001564988 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946783+0000", 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2780000000000001e-06 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946793+0000", 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0645999999999999e-05 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946801+0000", 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4730000000000003e-06 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002310+0000", 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055509428 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002377+0000", 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6252000000000002e-05 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002461+0000", 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3879000000000001e-05 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160323 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5632000~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.043295305, 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057265854999999997, 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160323 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:38.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946992+0000", 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-06 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946998+0000", 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3230000000000003e-06 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947004+0000", 2024-09-21T22:17:38.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004016+0000", 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057012459000000001 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004166+0000", 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150221 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004256+0000", 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9315999999999997e-05 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160324 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5640192~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0432753190000001, 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057423746999999997, 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160324 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:38.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947027+0000", 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6820000000000002e-05 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947029+0000", 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3489999999999999e-06 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947035+0000", 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947041+0000", 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3750000000000002e-06 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004283+0000", 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057242800000000003 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9294000000000004e-05 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004433+0000", 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0737999999999998e-05 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:38.031 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.043237295, 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:17:38.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0431351439999998, 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:17:38.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0393148679999999, 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.044 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0392947299999999, 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.039274212, 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:17:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:17:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160854 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5715968~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978918+0000", 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.011366728, 2024-09-21T22:17:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057390573, 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160854 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978918+0000", 2024-09-21T22:17:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978918+0000", 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978919+0000", 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978921+0000", 2024-09-21T22:17:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8190000000000001e-06 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978927+0000", 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3330000000000002e-06 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978932+0000", 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8539999999999996e-06 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036115+0000", 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057182877 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036211+0000", 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6225999999999997e-05 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036309+0000", 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8072999999999994e-05 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.011347668, 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:17:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0113280979999999, 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:17:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.011309507, 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0112898270000001, 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:17:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0112614670000002, 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:17:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:17:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0112399249999999, 2024-09-21T22:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:17:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.084 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:38.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:17:38.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4578 write 0xd176c7 thru 0xd249d7 (0xd311 bytes) 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4579 punch from 0x26f9bf1 to 0x2704d04, (0xb113 bytes) 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4580 write 0x7806e53 thru 0x7808022 (0x11d0 bytes) 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4581 write 0x927c9cd thru 0x9280d8c (0x43c0 bytes) 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4582 punch from 0xfa9668 to 0xfaae42, (0x17da bytes) 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4584 punch from 0x3062d12 to 0x3069a08, (0x6cf6 bytes) 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4585 read 0xa70ec9 thru 0xa79542 (0x867a bytes) 2024-09-21T22:17:38.087 INFO:teuthology.orchestra.run.smithi134.stdout:4586 punch from 0x8e34482 to 0x8e3969d, (0x521b bytes) 2024-09-21T22:17:38.088 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:38.084+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:38.088 INFO:teuthology.orchestra.run.smithi134.stdout:4587 trunc from 0xd9c19c5 to 0x8cfe50f 2024-09-21T22:17:38.100 INFO:teuthology.orchestra.run.smithi134.stdout:4588 clone 28 order 24 su 4194304 sc 9 2024-09-21T22:17:38.186 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:38.185+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:38.194 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:38.194 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:38.195 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:38.195 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:38.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:38.287 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:38.286+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:38.309 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:38.309 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:38.309 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:38.309 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:38.309 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:38.317 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:38.388 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:38.387+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5333254379999999, 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:17:38.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:17:38.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5333069209999999, 2024-09-21T22:17:38.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:17:38.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:17:38.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.470 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5331343349999997, 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:17:38.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.533112493, 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5330919559999998, 2024-09-21T22:17:38.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5330674269999998, 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:17:38.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5322175690000002, 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:17:38.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.532191182, 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:17:38.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:38.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:17:38.494 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5321686159999999, 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.495 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:17:38.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:17:38.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:17:38.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5321469059999999, 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5321257660000001, 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:17:38.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:17:38.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5321038910000002, 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5304886030000002, 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:17:38.512 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:17:38.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:17:38.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5304688249999998, 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5304493460000002, 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.530430945, 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:38.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5303985459999998, 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5303784070000002, 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160176 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5263126420000002, 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074083248000000004, 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160176 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933867+0000", 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933869+0000", 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1210000000000001e-06 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933874+0000", 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933879+0000", 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4830000000000001e-06 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007941+0000", 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074061907999999996 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007950+0000", 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7329999999999992e-06 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160177 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:38.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5262946259999999, 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074112131999999997, 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160177 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:38.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933885+0000", 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933887+0000", 2024-09-21T22:17:38.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933892+0000", 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933896+0000", 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4209999999999997e-06 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007986+0000", 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074089981999999999 2024-09-21T22:17:38.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007996+0000", 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.543 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:38.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:38.545 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:38.544+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:38.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:38.644+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:38.649 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:38.649 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:38.649 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:38.650 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:38.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:38.746 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:38.745+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:38.801 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:38.802 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:38.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:38.847 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:38.846+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:38.948 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:38.947+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.038409043000001, 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:17:38.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:38.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915667425999999, 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915657886999995, 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:38.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:38.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.967 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915649047000002, 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.968 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.971 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915639841000001, 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.972 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915630867000004, 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:17:38.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.979 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915621962000003, 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:17:38.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.983 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915600221999995, 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:38.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915590797999997, 2024-09-21T22:17:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:17:38.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915581899000003, 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.995 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.915572945999998, 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:38.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:17:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:38.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.914078203000003, 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:17:39.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:17:39.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.914068086, 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:39.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:17:39.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:17:39.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.914058581000006, 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:17:39.008 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:17:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.914044841999996, 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:39.016 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.914035532, 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.054024533000003, 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:17:39.020 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:17:39.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.050403111999998, 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:17:39.026 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:17:39.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:17:39.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:17:39.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:17:39.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.467932578000003, 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.749269638000001, 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.043 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:39.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:39.045 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:17:39.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:39.086+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:39.149 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:39.149+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:39.188 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:39.188 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:39.188 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:39.188 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:39.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:39.251 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:39.250+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:39.299 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:39.299 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:39.299 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:39.300 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:39.300 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:39.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:39.351 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:39.351+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 115.90963787, 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.413 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:39.417 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 112.894454411, 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:39.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 112.88300797300001, 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.332920745, 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:17:39.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 94.277832982000007, 2024-09-21T22:17:39.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.006740292999993, 2024-09-21T22:17:39.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:39.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.001833719000004, 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:17:39.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:17:39.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.442 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 92.998623120000005, 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:17:39.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 92.993601423000001, 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:17:39.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:17:39.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 92.991614091000002, 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.467760499999997, 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:39.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:39.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.424598888999995, 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:17:39.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.423098147999994, 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:39.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:17:39.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97072 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'409, mlcod=84'406)", 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.488150382000001, 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039520709999999997, 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922780+0000", 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3740000000000001e-06 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922789+0000", 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T22:17:39.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922808+0000", 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8481000000000001e-05 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922822+0000", 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922885+0000", 2024-09-21T22:17:39.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3336000000000005e-05 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922910+0000", 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5072999999999999e-05 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926670+0000", 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003760191 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926730+0000", 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0126e-05 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.443411159999997, 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:17:39.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:17:39.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:17:39.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.438527084, 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.480 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.437739387000001, 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.430731944999998, 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:17:39.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:17:39.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:17:39.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.454807281000001, 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:17:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.337259983, 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:17:39.493 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:17:39.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:17:39.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:39.498 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:39.499 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:39.499 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:39.498+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:39.600 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:39.599+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:39.616 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:39.616 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:39.616 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:39.616 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:39.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:39.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:39.701 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:39.700+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:39.770 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:39.770 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:39.770 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:39.770 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:39.770 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:39.775 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:39.775 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:39.779 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:39.791 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:39.792 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:39.807 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:39.807 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:39.823 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:39.822+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:39.823 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:39.823 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:39.839 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:39.839 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:39.857 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:39.857 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:39.874 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:39.874 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:39.884 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:39.885 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:39.890 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:39.890 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:39.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:39.935 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:39.934+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:40.004 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:40.003+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:40.046 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:40.047 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:40.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:40.143 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:40.143+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:40.203 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:40.203 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:40.205 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:40.204+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:40.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:40.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:40.305+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:40.357 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:40.357 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:40.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:40.411 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:40.410+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:40.471 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:40.472 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:40.480 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:40.509 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:40.508+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:40.610 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:40.609+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:40.653 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:40.653 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:40.662 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:40.747 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:40.746+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:40.807 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:40.807 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:40.811 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:40.810+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:40.816 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:40.911 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:40.911+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:40.960 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:40.960 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:40.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:41.012 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:41.011+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:41.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:17:41.074 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:41.075 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:41.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:41.128 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:41.127+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:41.134 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-21T22:17:41.190 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:41.190 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:41.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:41.245 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:41.244+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:41.314 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:41.314 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:41.314 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:41.313+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:41.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:41.380 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.381 INFO:teuthology.orchestra.run.smithi134.stdout:4591 writesame 0xbe1497 thru 0xbea47f data_size 0x7(0x8fe9 bytes) 2024-09-21T22:17:41.388 INFO:teuthology.orchestra.run.smithi134.stdout:4592 trunc from 0x8cfe50f to 0x9353bf6 2024-09-21T22:17:41.394 INFO:teuthology.orchestra.run.smithi134.stdout:4593 write 0x7272f71 thru 0x727d6f1 (0xa781 bytes) 2024-09-21T22:17:41.395 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.395 INFO:teuthology.orchestra.run.smithi134.stdout:4595 write 0x42cbc20 thru 0x42cc3b4 (0x795 bytes) 2024-09-21T22:17:41.397 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.397 INFO:teuthology.orchestra.run.smithi134.stdout:4597 write 0x654c47e thru 0x654f3c0 (0x2f43 bytes) 2024-09-21T22:17:41.398 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.408 INFO:teuthology.orchestra.run.smithi134.stdout:4599 write 0xd1c08c5 thru 0xd1c48d9 (0x4015 bytes) 2024-09-21T22:17:41.411 INFO:teuthology.orchestra.run.smithi134.stdout:4600 writesame 0x603f6e8 thru 0x604bbba data_size 0x1(0xc4d3 bytes) 2024-09-21T22:17:41.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:41.414+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:41.436 INFO:teuthology.orchestra.run.smithi134.stdout:4601 punch from 0xcb4dd6c to 0xcb58a5c, (0xacf0 bytes) 2024-09-21T22:17:41.436 INFO:teuthology.orchestra.run.smithi134.stdout:4602 write 0x98ebd5a thru 0x98ec104 (0x3ab bytes) 2024-09-21T22:17:41.440 INFO:teuthology.orchestra.run.smithi134.stdout:4603 punch from 0x7801f89 to 0x780ce34, (0xaeab bytes) 2024-09-21T22:17:41.440 INFO:teuthology.orchestra.run.smithi134.stdout:4604 write 0x962e78 thru 0x96a37c (0x7505 bytes) 2024-09-21T22:17:41.441 INFO:teuthology.orchestra.run.smithi134.stdout:4605 read 0x115f7ac thru 0x115fd64 (0x5b9 bytes) 2024-09-21T22:17:41.442 INFO:teuthology.orchestra.run.smithi134.stdout:4606 write 0x384b4e9 thru 0x384dc23 (0x273b bytes) 2024-09-21T22:17:41.443 INFO:teuthology.orchestra.run.smithi134.stdout:4609 writesame 0xc1c576a thru 0xc1d31f7 data_size 0x4b(0xda8e bytes) 2024-09-21T22:17:41.457 INFO:teuthology.orchestra.run.smithi134.stdout:4610 trunc from 0xd1c48da to 0x42aac03 2024-09-21T22:17:41.476 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:41.477 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:41.487 INFO:teuthology.orchestra.run.smithi134.stdout:4612 writesame 0xc2dd072 thru 0xc2ec222 data_size 0x1(0xf1b1 bytes) 2024-09-21T22:17:41.487 INFO:teuthology.orchestra.run.smithi134.stdout:4613 write 0xb14210a thru 0xb14c349 (0xa240 bytes) 2024-09-21T22:17:41.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:41.490 INFO:teuthology.orchestra.run.smithi134.stdout:4614 writesame 0x5314d19 thru 0x531ab0a data_size 0x25(0x5df2 bytes) 2024-09-21T22:17:41.495 INFO:teuthology.orchestra.run.smithi134.stdout:4615 trunc from 0xc2ec223 to 0x86d7e5e 2024-09-21T22:17:41.517 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:41.516+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:41.518 INFO:teuthology.orchestra.run.smithi134.stdout:4616 write 0xe1b76d1 thru 0xe1bda2f (0x635f bytes) 2024-09-21T22:17:41.521 INFO:teuthology.orchestra.run.smithi134.stdout:4617 read 0x32106dc thru 0x32147e5 (0x410a bytes) 2024-09-21T22:17:41.521 INFO:teuthology.orchestra.run.smithi134.stdout:4621 write 0x9cc85b6 thru 0x9cd211e (0x9b69 bytes) 2024-09-21T22:17:41.524 INFO:teuthology.orchestra.run.smithi134.stdout:4622 read 0xbec42d5 thru 0xbecf1af (0xaedb bytes) 2024-09-21T22:17:41.524 INFO:teuthology.orchestra.run.smithi134.stdout:4624 read 0xb1f6ebc thru 0xb1fc88e (0x59d3 bytes) 2024-09-21T22:17:41.524 INFO:teuthology.orchestra.run.smithi134.stdout:4625 read 0xc8a80b9 thru 0xc8b4c73 (0xcbbb bytes) 2024-09-21T22:17:41.537 INFO:teuthology.orchestra.run.smithi134.stdout:4626 trunc from 0xe1bda30 to 0x3e3eb5b 2024-09-21T22:17:41.548 INFO:teuthology.orchestra.run.smithi134.stdout:4627 read 0x23f5613 thru 0x240289f (0xd28d bytes) 2024-09-21T22:17:41.549 INFO:teuthology.orchestra.run.smithi134.stdout:4628 read 0x2fbfb94 thru 0x2fc4cee (0x515b bytes) 2024-09-21T22:17:41.558 INFO:teuthology.orchestra.run.smithi134.stdout:4630 trunc from 0x3e3eb5b to 0xb24fa1c 2024-09-21T22:17:41.573 INFO:teuthology.orchestra.run.smithi134.stdout:4631 trunc from 0xb24fa1c to 0x422a854 2024-09-21T22:17:41.580 INFO:teuthology.orchestra.run.smithi134.stdout:4632 punch from 0x17898d5 to 0x17920a7, (0x87d2 bytes) 2024-09-21T22:17:41.589 INFO:teuthology.orchestra.run.smithi134.stdout:4633 trunc from 0x422a854 to 0xb76dd63 2024-09-21T22:17:41.594 INFO:teuthology.orchestra.run.smithi134.stdout:4634 write 0x64f1e81 thru 0x64f7d01 (0x5e81 bytes) 2024-09-21T22:17:41.596 INFO:teuthology.orchestra.run.smithi134.stdout:4636 write 0x9b47f72 thru 0x9b4cf06 (0x4f95 bytes) 2024-09-21T22:17:41.599 INFO:teuthology.orchestra.run.smithi134.stdout:4637 read 0x796f03c thru 0x7975174 (0x6139 bytes) 2024-09-21T22:17:41.608 INFO:teuthology.orchestra.run.smithi134.stdout:4639 trunc from 0xb76dd63 to 0x471b296 2024-09-21T22:17:41.610 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:41.611 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:41.618 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:41.617+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:41.619 INFO:teuthology.orchestra.run.smithi134.stdout:4641 trunc from 0x471b296 to 0x4c536bc 2024-09-21T22:17:41.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:41.635 INFO:teuthology.orchestra.run.smithi134.stdout:4643 write 0x8680e88 thru 0x868be51 (0xafca bytes) 2024-09-21T22:17:41.637 INFO:teuthology.orchestra.run.smithi134.stdout:4644 write 0x1f8f74e thru 0x1f93766 (0x4019 bytes) 2024-09-21T22:17:41.638 INFO:teuthology.orchestra.run.smithi134.stdout:4645 write 0x42e223c thru 0x42e9de7 (0x7bac bytes) 2024-09-21T22:17:41.639 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.645 INFO:teuthology.orchestra.run.smithi134.stdout:4647 trunc from 0x868be52 to 0xd8e85b8 2024-09-21T22:17:41.650 INFO:teuthology.orchestra.run.smithi134.stdout:4649 punch from 0x5a2f4fe to 0x5a339d1, (0x44d3 bytes) 2024-09-21T22:17:41.650 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.651 INFO:teuthology.orchestra.run.smithi134.stdout:4651 write 0x8131e0e thru 0x8137615 (0x5808 bytes) 2024-09-21T22:17:41.657 INFO:teuthology.orchestra.run.smithi134.stdout:4652 trunc from 0xd8e85b8 to 0x8ed4793 2024-09-21T22:17:41.669 INFO:teuthology.orchestra.run.smithi134.stdout:4656 write 0x934e980 thru 0x935ca31 (0xe0b2 bytes) 2024-09-21T22:17:41.672 INFO:teuthology.orchestra.run.smithi134.stdout:4657 read 0x14816cd thru 0x148cfbd (0xb8f1 bytes) 2024-09-21T22:17:41.673 INFO:teuthology.orchestra.run.smithi134.stdout:4658 read 0x4cafbcf thru 0x4cbaedc (0xb30e bytes) 2024-09-21T22:17:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:4659 write 0x6e65fe2 thru 0x6e6a187 (0x41a6 bytes) 2024-09-21T22:17:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:4660 write 0x1740a46 thru 0x174eb66 (0xe121 bytes) 2024-09-21T22:17:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:4661 writesame 0x908b0aa thru 0x9098e22 data_size 0x1(0xdd79 bytes) 2024-09-21T22:17:41.700 INFO:teuthology.orchestra.run.smithi134.stdout:4662 read 0x1a29588 thru 0x1a366cc (0xd145 bytes) 2024-09-21T22:17:41.705 INFO:teuthology.orchestra.run.smithi134.stdout:4664 trunc from 0x935ca32 to 0xd018f99 2024-09-21T22:17:41.710 INFO:teuthology.orchestra.run.smithi134.stdout:4666 write 0xcac86d5 thru 0xcacf985 (0x72b1 bytes) 2024-09-21T22:17:41.713 INFO:teuthology.orchestra.run.smithi134.stdout:4667 writesame 0x1984edb thru 0x198a26c data_size 0x2(0x5392 bytes) 2024-09-21T22:17:41.718 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:41.718+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:41.735 INFO:teuthology.orchestra.run.smithi134.stdout:4668 trunc from 0xd018f99 to 0x8a2595 2024-09-21T22:17:41.756 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:41.756 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:41.757 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.770 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:41.775 INFO:teuthology.orchestra.run.smithi134.stdout:4670 write 0xaf3d31e thru 0xaf42ffe (0x5ce1 bytes) 2024-09-21T22:17:41.778 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.785 INFO:teuthology.orchestra.run.smithi134.stdout:4673 write 0xbfec23b thru 0xbff3210 (0x6fd6 bytes) 2024-09-21T22:17:41.788 INFO:teuthology.orchestra.run.smithi134.stdout:4675 punch from 0xb24f86b to 0xb251999, (0x212e bytes) 2024-09-21T22:17:41.788 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.788 INFO:teuthology.orchestra.run.smithi134.stdout:4677 write 0x23565e8 thru 0x235cc77 (0x6690 bytes) 2024-09-21T22:17:41.790 INFO:teuthology.orchestra.run.smithi134.stdout:4678 write 0xff2877 thru 0xfff05c (0xc7e6 bytes) 2024-09-21T22:17:41.794 INFO:teuthology.orchestra.run.smithi134.stdout:4680 trunc from 0xbff3211 to 0xba0916b 2024-09-21T22:17:41.800 INFO:teuthology.orchestra.run.smithi134.stdout:4681 writesame 0x1d01a19 thru 0x1d09362 data_size 0x87(0x794a bytes) 2024-09-21T22:17:41.803 INFO:teuthology.orchestra.run.smithi134.stdout:4682 read 0x8d39558 thru 0x8d459e6 (0xc48f bytes) 2024-09-21T22:17:41.804 INFO:teuthology.orchestra.run.smithi134.stdout:4686 write 0xb2099c4 thru 0xb21500d (0xb64a bytes) 2024-09-21T22:17:41.807 INFO:teuthology.orchestra.run.smithi134.stdout:4688 writesame 0x26e2e1c thru 0x26e40d3 data_size 0x4(0x12b8 bytes) 2024-09-21T22:17:41.809 INFO:teuthology.orchestra.run.smithi134.stdout:4689 write 0x19a131 thru 0x19c6af (0x257f bytes) 2024-09-21T22:17:41.818 INFO:teuthology.orchestra.run.smithi134.stdout:4693 write 0xe49b2c4 thru 0xe49ff69 (0x4ca6 bytes) 2024-09-21T22:17:41.819 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:41.817+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:41.821 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.821 INFO:teuthology.orchestra.run.smithi134.stdout:4698 read 0x7d6a0c4 thru 0x7d7a045 (0xff82 bytes) 2024-09-21T22:17:41.822 INFO:teuthology.orchestra.run.smithi134.stdout:4700 write 0x6c17467 thru 0x6c2136e (0x9f08 bytes) 2024-09-21T22:17:41.829 INFO:teuthology.orchestra.run.smithi134.stdout:4702 trunc from 0xe49ff6a to 0x89bc385 2024-09-21T22:17:41.841 INFO:teuthology.orchestra.run.smithi134.stdout:4703 read 0x533a2a1 thru 0x5349a8c (0xf7ec bytes) 2024-09-21T22:17:41.841 INFO:teuthology.orchestra.run.smithi134.stdout:4704 punch from 0x6496ce4 to 0x649d94f, (0x6c6b bytes) 2024-09-21T22:17:41.841 INFO:teuthology.orchestra.run.smithi134.stdout:4705 write 0xf70ebc thru 0xf78bc1 (0x7d06 bytes) 2024-09-21T22:17:41.843 INFO:teuthology.orchestra.run.smithi134.stdout:4707 read 0x72f13ca thru 0x72f8599 (0x71d0 bytes) 2024-09-21T22:17:41.843 INFO:teuthology.orchestra.run.smithi134.stdout:4708 punch from 0x83f0998 to 0x83f3022, (0x268a bytes) 2024-09-21T22:17:41.843 INFO:teuthology.orchestra.run.smithi134.stdout:4710 read 0x5c4916f thru 0x5c590b9 (0xff4b bytes) 2024-09-21T22:17:41.852 INFO:teuthology.orchestra.run.smithi134.stdout:4711 write 0xb2e4863 thru 0xb2ee4f9 (0x9c97 bytes) 2024-09-21T22:17:41.855 INFO:teuthology.orchestra.run.smithi134.stdout:4713 write 0x45004d1 thru 0x450d5c7 (0xd0f7 bytes) 2024-09-21T22:17:41.857 INFO:teuthology.orchestra.run.smithi134.stdout:4714 read 0x9180847 thru 0x918c06d (0xb827 bytes) 2024-09-21T22:17:41.857 INFO:teuthology.orchestra.run.smithi134.stdout:4716 writesame 0x8aa0e92 thru 0x8aaf10d data_size 0x82(0xe27c bytes) 2024-09-21T22:17:41.858 INFO:teuthology.orchestra.run.smithi134.stdout:4717 read 0x7354917 thru 0x7357142 (0x282c bytes) 2024-09-21T22:17:41.859 INFO:teuthology.orchestra.run.smithi134.stdout:4718 writesame 0xaa8a72d thru 0xaa9a669 data_size 0x13(0xff3d bytes) 2024-09-21T22:17:41.863 INFO:teuthology.orchestra.run.smithi134.stdout:4719 write 0x53a4c60 thru 0x53a7d67 (0x3108 bytes) 2024-09-21T22:17:41.864 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.865 INFO:teuthology.orchestra.run.smithi134.stdout:4721 write 0x4cb1db4 thru 0x4cb7cd0 (0x5f1d bytes) 2024-09-21T22:17:41.866 INFO:teuthology.orchestra.run.smithi134.stdout:4723 write 0x1898d89 thru 0x18a6661 (0xd8d9 bytes) 2024-09-21T22:17:41.869 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.869 INFO:teuthology.orchestra.run.smithi134.stdout:4727 write 0x67ffbe5 thru 0x6807d8b (0x81a7 bytes) 2024-09-21T22:17:41.870 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.870 INFO:teuthology.orchestra.run.smithi134.stdout:4730 write 0x8fa3b6d thru 0x8fae2a8 (0xa73c bytes) 2024-09-21T22:17:41.872 INFO:teuthology.orchestra.run.smithi134.stdout:4731 read 0x7ca73bf thru 0x7cb3e80 (0xcac2 bytes) 2024-09-21T22:17:41.872 INFO:teuthology.orchestra.run.smithi134.stdout:4732 write 0x30e37ad thru 0x30e97c7 (0x601b bytes) 2024-09-21T22:17:41.874 INFO:teuthology.orchestra.run.smithi134.stdout:4733 read 0x608f7bb thru 0x609be01 (0xc647 bytes) 2024-09-21T22:17:41.874 INFO:teuthology.orchestra.run.smithi134.stdout:4734 read 0x81d503b thru 0x81d91ea (0x41b0 bytes) 2024-09-21T22:17:41.874 INFO:teuthology.orchestra.run.smithi134.stdout:4736 write 0x6f895a5 thru 0x6f90feb (0x7a47 bytes) 2024-09-21T22:17:41.875 INFO:teuthology.orchestra.run.smithi134.stdout:4737 write 0x98944b8 thru 0x98a4164 (0xfcad bytes) 2024-09-21T22:17:41.878 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.878 INFO:teuthology.orchestra.run.smithi134.stdout:4739 writesame 0x29b24df thru 0x29b7532 data_size 0x35(0x5054 bytes) 2024-09-21T22:17:41.880 INFO:teuthology.orchestra.run.smithi134.stdout:4740 write 0x3aecfd2 thru 0x3af55e6 (0x8615 bytes) 2024-09-21T22:17:41.882 INFO:teuthology.orchestra.run.smithi134.stdout:4743 writesame 0x72d540 thru 0x7309cc data_size 0x1(0x348d bytes) 2024-09-21T22:17:41.889 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:41.889 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:41.890 INFO:teuthology.orchestra.run.smithi134.stdout:4744 read 0x396c5c1 thru 0x397224f (0x5c8f bytes) 2024-09-21T22:17:41.899 INFO:teuthology.orchestra.run.smithi134.stdout:4749 writesame 0xd452933 thru 0xd45c224 data_size 0x1(0x98f2 bytes) 2024-09-21T22:17:41.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:41.900 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.900 INFO:teuthology.orchestra.run.smithi134.stdout:4752 read 0x18761db thru 0x18839aa (0xd7d0 bytes) 2024-09-21T22:17:41.901 INFO:teuthology.orchestra.run.smithi134.stdout:4753 read 0x7e318f5 thru 0x7e348c6 (0x2fd2 bytes) 2024-09-21T22:17:41.901 INFO:teuthology.orchestra.run.smithi134.stdout:4759 punch from 0x1d2c3ab to 0x1d2ee76, (0x2acb bytes) 2024-09-21T22:17:41.901 INFO:teuthology.orchestra.run.smithi134.stdout:4761 writesame 0x81c273b thru 0x81c7741 data_size 0x1(0x5007 bytes) 2024-09-21T22:17:41.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:41.912 INFO:teuthology.orchestra.run.smithi134.stdout:4762 writesame 0xac7eb44 thru 0xac89e70 data_size 0x1(0xb32d bytes) 2024-09-21T22:17:41.913 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:41.913 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:41.914 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-21T22:17:41.914 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T22:17:41.914 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T22:17:41.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-21T22:17:41.942 INFO:teuthology.orchestra.run.smithi134.stdout:4764 trunc from 0xd45c225 to 0xaf8975a 2024-09-21T22:17:41.952 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:41.957 INFO:teuthology.orchestra.run.smithi134.stdout:4767 write 0xb3ca5e2 thru 0xb3cb6cb (0x10ea bytes) 2024-09-21T22:17:41.959 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:41.958+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:41.967 INFO:teuthology.orchestra.run.smithi134.stdout:4768 writesame 0xb887b22 thru 0xb88919d data_size 0x2(0x167c bytes) 2024-09-21T22:17:41.967 INFO:teuthology.orchestra.run.smithi134.stdout:4771 read 0x380ff27 thru 0x3811cb7 (0x1d91 bytes) 2024-09-21T22:17:41.967 INFO:teuthology.orchestra.run.smithi134.stdout:4772 punch from 0x6b7bb03 to 0x6b885f8, (0xcaf5 bytes) 2024-09-21T22:17:41.971 INFO:teuthology.orchestra.run.smithi134.stdout:4773 trunc from 0xb88919e to 0x7e1252b 2024-09-21T22:17:41.983 INFO:teuthology.orchestra.run.smithi134.stdout:4775 clone 29 order 18 su 65536 sc 14 2024-09-21T22:17:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:42.022 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:42.021+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:42.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:42.023 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:42.023 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T22:17:42.024 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:42.031 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:42.031 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:42.031 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:17:42.050 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:42.050 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:42.068 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:42.068 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:42.086 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:42.086 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:42.102 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:42.103 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:42.119 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:42.119 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:42.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:42.120+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:42.136 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:42.136 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:42.140 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:42.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:42.140 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:42.140 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:42.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:42.153 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:42.153 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:42.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:42.220+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:42.257 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:42.257 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:42.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:42.350 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:42.348+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 101.495394963, 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372653346000007, 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372643807000003, 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372634966999996, 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:17:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372625760999995, 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:17:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372616786999998, 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372607881999997, 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:17:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372586142000003, 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372576718000005, 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:17:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:17:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372567818999997, 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:17:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:17:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.372558866000006, 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:17:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44906 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2011136~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.371064122999996, 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057417137, 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44906 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038835+0000", 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038836+0000", 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3799999999999999e-07 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038837+0000", 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.325e-06 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038840+0000", 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038843+0000", 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3870000000000002e-06 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096066+0000", 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057223807000000002 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096148+0000", 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1425000000000001e-05 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096252+0000", 2024-09-21T22:17:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104664 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.371054005999994, 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.371044501, 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.371030762000004, 2024-09-21T22:17:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:17:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.371021451999994, 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.511010452999997, 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:17:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:17:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:17:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.507389031999999, 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:17:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:17:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.924918497999997, 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:17:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:17:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.206255557999999, 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:17:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:17:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.500 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:42.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:42.501 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:42.500+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:42.602 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:42.601+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:42.644 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:42.644 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:42.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:42.702 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:42.702+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:42.756 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:42.756 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:42.756 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:42.756 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:42.756 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:42.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:42.808 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:42.806+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:42.867 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:42.867 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:42.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:42.867 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:42.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.867 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:960 3.4 e30/23 3:238502c8:::rbd_data.1185ff358907.0000000000000008:head v 30'7, mlcod=28'5)", 2024-09-21T22:17:42.867 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 119.364304731, 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041661299999999997, 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.501291+0000", 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-07 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502030+0000", 2024-09-21T22:17:42.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073885200000000002 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502048+0000", 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8301999999999999e-05 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502059+0000", 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.047e-05 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502123+0000", 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4175000000000001e-05 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.502148+0000", 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4836000000000001e-05 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505407+0000", 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003258978 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:43.505457+0000", 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0275999999999998e-05 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.349121272, 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.337674834, 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 105.787587606, 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:17:42.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 97.732499842999999, 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:17:42.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:17:42.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.887 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.461407154, 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.456500579999997, 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:42.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:17:42.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:17:42.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16602 3.9 e51/23 3:92fbf175:::rbd_data.1185fc79843.00000000000000aa:head v 51'92, mlcod=50'90)", 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.453289980999998, 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040121410000000003, 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412305+0000", 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412306+0000", 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5499999999999998e-07 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412312+0000", 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3849999999999999e-06 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412322+0000", 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7359999999999996e-06 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412331+0000", 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.32e-06 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412392+0000", 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-05 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.412412+0000", 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9775999999999998e-05 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416263+0000", 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003850905 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.416318+0000", 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4864000000000002e-05 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.448268283999994, 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:17:42.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.446280951999995, 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.922427361000004, 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:42.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:17:42.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:17:42.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.879265750000002, 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:42.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:17:42.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.877765009000001, 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97072 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'409, mlcod=84'406)", 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.942817243, 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039520709999999997, 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.920 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922778+0000", 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922780+0000", 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3740000000000001e-06 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922789+0000", 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922808+0000", 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8481000000000001e-05 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922822+0000", 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922885+0000", 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3336000000000005e-05 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.922910+0000", 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5072999999999999e-05 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926670+0000", 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003760191 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.926730+0000", 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0126e-05 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.898078021000003, 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.924 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:17:42.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.893193945, 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.892406248, 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.885398805999998, 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.909474142000001, 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:42.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:17:42.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:17:42.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7919268439999998, 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:42.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:17:42.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:42.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:42.948 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:42.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:42.949 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:42.947+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:43.050 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:43.049+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:43.065 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:43.065 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:43.078 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:43.163 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:43.162+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:43.253 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:43.252+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:43.273 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:43.273 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:43.273 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:43.274 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:43.274 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:43.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:43.370 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:43.369+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:43.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:43.452+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:43.484 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:43.484 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:43.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:43.484 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:43.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.484 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 119.914965274, 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.488 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 116.958625735, 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.489 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:17:43.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.906607576, 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:17:43.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:17:43.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:17:43.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:43.500 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.800769025999998, 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:43.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.799384685000007, 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.506 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:17:43.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.281042385999996, 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.279166505000006, 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.517 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:17:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:17:43.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:17:43.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 75.009424210000006, 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.521 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:17:43.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.526 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.893654377999994, 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.515841158000001, 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.532 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.536 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.663515365999999, 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:17:43.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:17:43.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.387978750999999, 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:17:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:17:43.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:17:43.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:126975 3.1d 3:ba76c7d7:::rbd_data.11859234a8c3.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:29.424496+0000", 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.054990653000001, 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013560575, 2024-09-21T22:17:43.548 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 126975 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424496+0000", 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424496+0000", 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424497+0000", 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424500+0000", 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000004e-06 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424510+0000", 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3360000000000001e-06 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424515+0000", 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0239999999999997e-06 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424561+0000", 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5945999999999997e-05 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424612+0000", 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0819999999999998e-05 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.426882+0000", 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022705469999999999 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.437951+0000", 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011068506000000001 2024-09-21T22:17:43.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.437981+0000", 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0528000000000003e-05 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.438020+0000", 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8824e-05 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.438056+0000", 2024-09-21T22:17:43.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6452999999999998e-05 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178703 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 1703936~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085706+0000", 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39378015100000002, 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012208666, 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.554 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178703 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085706+0000", 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085706+0000", 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085707+0000", 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085709+0000", 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5009999999999999e-06 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085716+0000", 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2589999999999997e-06 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085720+0000", 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6160000000000004e-06 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097378+0000", 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657667 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097428+0000", 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0244999999999998e-05 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097915+0000", 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00048699099999999999 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178704 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 2621440~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085727+0000", 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39375924899999998, 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012639134, 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.558 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178704 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085727+0000", 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085727+0000", 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085728+0000", 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085730+0000", 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.429e-06 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085736+0000", 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6010000000000002e-06 2024-09-21T22:17:43.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085740+0000", 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097888+0000", 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012148112000000001 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097954+0000", 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5664e-05 2024-09-21T22:17:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098366+0000", 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041226899999999999 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178706 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 851968~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085746+0000", 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39374012400000002, 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01314953, 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.562 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178706 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085746+0000", 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085746+0000", 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085747+0000", 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0899999999999997e-07 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085749+0000", 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085755+0000", 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085759+0000", 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.583e-06 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098396+0000", 2024-09-21T22:17:43.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012636547999999999 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098474+0000", 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7795999999999999e-05 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098896+0000", 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00042237299999999998 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178707 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 1769472~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085765+0000", 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39372126499999999, 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01371788, 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178707 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085765+0000", 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085765+0000", 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085766+0000", 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085768+0000", 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2740000000000002e-06 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085774+0000", 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8939999999999998e-06 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085779+0000", 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5670000000000002e-06 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098935+0000", 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013156078999999999 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099011+0000", 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5108e-05 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099483+0000", 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000472583 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.570 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178708 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 2686976~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.393700942, 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014235467999999999, 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178708 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.571 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:17:43.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085788+0000", 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085794+0000", 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085799+0000", 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0100000000000003e-06 2024-09-21T22:17:43.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099516+0000", 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013716943000000001 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099600+0000", 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4387000000000004e-05 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100021+0000", 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00042102799999999999 2024-09-21T22:17:43.574 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178709 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.39227165600000002, 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013023948, 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.575 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178709 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:43.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0900000000000001e-07 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087219+0000", 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6169999999999998e-06 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087227+0000", 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1720000000000007e-06 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087234+0000", 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5300000000000002e-06 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100072+0000", 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012837987 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100158+0000", 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6043000000000003e-05 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100239+0000", 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:180152 3.14 3:2b1e41b5:::rbd_object_map.11858019d25.000000000000003c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.327900+0000", 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.151586147, 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012792553999999999, 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:43.579 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 180152 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327900+0000", 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327900+0000", 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:43.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327901+0000", 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1399999999999997e-07 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327905+0000", 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2080000000000002e-06 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327912+0000", 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327917+0000", 2024-09-21T22:17:43.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8899999999999998e-06 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.333822+0000", 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059049740000000003 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.333870+0000", 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7814e-05 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.334120+0000", 2024-09-21T22:17:43.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025028799999999999 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.335737+0000", 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0016176700000000001 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.340592+0000", 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048543229999999998 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.340649+0000", 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6743000000000002e-05 2024-09-21T22:17:43.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.340693+0000", 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4372000000000001e-05 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:43.584 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:43.585 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:43.586 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:43.585+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:43.686 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:43.686+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:43.730 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:43.730 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:43.730 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:43.730 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:43.739 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:43.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:43.786+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:43.883 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:43.883 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:43.883 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:43.883 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:43.883 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:43.888 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:43.888+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:43.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:43.989 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:43.989+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:44.036 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087258782000006, 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.037 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087238611000004, 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.041 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:44.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087219665000006, 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.045 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087200301999999, 2024-09-21T22:17:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087167653999998, 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087116487000003, 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087089814999999, 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087065015999997, 2024-09-21T22:17:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087034067999994, 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.087009850000001, 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.086985498000004, 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.086961255000006, 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.086931519999993, 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 99.086896050000007, 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.049364844999999, 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.856497185999999, 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.851130654000002, 2024-09-21T22:17:44.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:44.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:44.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:44.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.833565860999997, 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.108 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:44.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:44.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.801184868000007, 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:44.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:44.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 69.753381422000004, 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:44.118 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:44.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:44.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:44.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:44.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:44.123 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:44.123 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:17:44.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:44.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:44.123+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:44.138 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-21T22:17:44.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:44.226 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:44.225+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:44.281 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:44.281 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:44.281 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:44.281 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:44.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:44.331 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:44.330+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:44.331 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:44.331 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:44.355 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:44.372 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:44.388 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:44.389 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:44.404 INFO:teuthology.orchestra.run.smithi134.stdout:4776 trunc from 0x7e1252b to 0xce7a9dd 2024-09-21T22:17:44.406 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:44.406 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:44.415 INFO:teuthology.orchestra.run.smithi134.stdout:4778 writesame 0xa9282e thru 0xa9985a data_size 0xd(0x702d bytes) 2024-09-21T22:17:44.419 INFO:teuthology.orchestra.run.smithi134.stdout:4783 writesame 0x2f9020c thru 0x2f90a7c data_size 0x1(0x871 bytes) 2024-09-21T22:17:44.424 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:44.424 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:44.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:44.426+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:44.434 INFO:teuthology.orchestra.run.smithi134.stdout:4784 trunc from 0xce7a9dd to 0x3657851 2024-09-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:44.446 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:44.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:44.477 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:44.477 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:44.505 INFO:teuthology.orchestra.run.smithi134.stdout:4785 writesame 0xa89a5c9 thru 0xa8a9d83 data_size 0x1(0xf7bb bytes) 2024-09-21T22:17:44.505 INFO:teuthology.orchestra.run.smithi134.stdout:4786 read 0xef2a10 thru 0xefcf96 (0xa587 bytes) 2024-09-21T22:17:44.505 INFO:teuthology.orchestra.run.smithi134.stdout:4788 read 0x9713ae thru 0x980e3c (0xfa8f bytes) 2024-09-21T22:17:44.506 INFO:teuthology.orchestra.run.smithi134.stdout:4790 read 0x7a40caa thru 0x7a4af99 (0xa2f0 bytes) 2024-09-21T22:17:44.506 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:44.506 INFO:teuthology.orchestra.run.smithi134.stdout:4792 write 0xa4e46eb thru 0xa4ee00f (0x9925 bytes) 2024-09-21T22:17:44.508 INFO:teuthology.orchestra.run.smithi134.stdout:4793 read 0x3bdf99a thru 0x3be3f1d (0x4584 bytes) 2024-09-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi134.stdout:4795 trunc from 0xa8a9d84 to 0xcc5d7b4 2024-09-21T22:17:44.516 INFO:teuthology.orchestra.run.smithi134.stdout:4796 clone 30 order 25 su 524288 sc 10 2024-09-21T22:17:44.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:44.528+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:44.572 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:44.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:44.629+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:44.676 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:44.676 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:44.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:44.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:44.729+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:44.789 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:44.789 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:44.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:44.842 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:44.841+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:44.901 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:44.901 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:44.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:44.952 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:44.951+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:45.042 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:17:45.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:45.040+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:45.133 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.133 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.133 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:45.131+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:45.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:45.234 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:45.234+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:45.286 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.286 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:45.338 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:45.336+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:45.396 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.396 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:45.436 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:45.435+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:45.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:45.535+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:45.548 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.548 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:45.638 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:45.637+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:45.698 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.699 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:45.739 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:45.739+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:45.809 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.810 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:45.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:45.861+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:45.921 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:45.921 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:45.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:45.939 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:45.939+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:46.041 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:46.039+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:46.090 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:46.090 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:46.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:46.146 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:46.144+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:46.242 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:46.241+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:46.320 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:46.321 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:46.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:46.380 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:46.378+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:46.438 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:46.438 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:46.443 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:46.443+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:46.446 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:46.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:46.544 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:46.544+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:46.592 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:46.593 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:46.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:46.645 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:46.645+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:46.651 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:46.652 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:46.668 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:46.669 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:46.684 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:46.684 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:46.700 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:46.707 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:46.707 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:46.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:46.717 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:46.717 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:46.734 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:46.734 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:46.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:46.744+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:46.750 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:46.751 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:46.767 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:46.767 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:46.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:46.846+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:46.859 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:46.859 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:46.859 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:46.859 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:46.859 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:46.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:46.948 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:46.946+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:1607 3.9 3:933c4985:::rbd_data.11856a5cf33b.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.409237752, 2024-09-21T22:17:46.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011997875, 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 1607 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564521+0000", 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564545+0000", 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4196999999999999e-05 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564548+0000", 2024-09-21T22:17:46.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.88e-06 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564555+0000", 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1489999999999997e-06 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.564561+0000", 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1209999999999998e-06 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576357+0000", 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011796157 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576425+0000", 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8052000000000005e-05 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:43.576519+0000", 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4319000000000003e-05 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:46.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:2360 3.14 3:2976e8b6:::rbd_data.118555b0e245.0000000000000005:head [write 0~988821 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.452898213, 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013835458, 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 2360 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.981 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520861+0000", 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:46.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.520862+0000", 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.16e-07 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522648+0000", 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001786045 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522660+0000", 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2085e-05 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522666+0000", 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9869999999999996e-06 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522722+0000", 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6314000000000003e-05 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522844+0000", 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012178 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:46.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.522986+0000", 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000142223 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.532136+0000", 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0091500049999999993 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534583+0000", 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0024467550000000001 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:46.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534644+0000", 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0668999999999998e-05 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:46.534696+0000", 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2679000000000002e-05 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8863 3.14 3:2d7f9196:::rbd_data.1185acca6c1f.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 110.400880054, 2024-09-21T22:17:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012032321, 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8863 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572879+0000", 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572880+0000", 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3600000000000003e-07 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572884+0000", 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8279999999999996e-06 2024-09-21T22:17:46.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572892+0000", 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9309999999999997e-06 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572897+0000", 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.578e-06 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572943+0000", 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5634999999999999e-05 2024-09-21T22:17:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.572995+0000", 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2834999999999998e-05 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.574798+0000", 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001802204 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:46.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584804+0000", 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010006631 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584838+0000", 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3816999999999998e-05 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584875+0000", 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6455000000000002e-05 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.584911+0000", 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6671000000000002e-05 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16958 3.1a 3:58ba9964:::rbd_data.1185fc79843.0000000000000069:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.295041504, 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013029361, 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:46.992 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16958 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678717+0000", 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678718+0000", 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6400000000000001e-07 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678723+0000", 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678733+0000", 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0779e-05 2024-09-21T22:17:46.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678739+0000", 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3210000000000004e-06 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678786+0000", 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6832000000000002e-05 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.678877+0000", 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1402000000000003e-05 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680728+0000", 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001851068 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691650+0000", 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010921899000000001 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691678+0000", 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7892e-05 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691711+0000", 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3325999999999999e-05 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.691747+0000", 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5639000000000002e-05 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:16961 3.14 3:2ebe619b:::rbd_data.1185fc79843.000000000000006d:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:46.997 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 100.29365716300001, 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013229098, 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 16961 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:46.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680102+0000", 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680103+0000", 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:46.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680107+0000", 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3889999999999998e-06 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680117+0000", 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.6490000000000003e-06 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680123+0000", 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.139e-06 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680185+0000", 2024-09-21T22:17:47.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1821000000000003e-05 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.680317+0000", 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013209699999999999 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.682591+0000", 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022748059999999999 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693255+0000", 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.010663181000000001 2024-09-21T22:17:47.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693265+0000", 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0429e-05 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693296+0000", 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1007000000000003e-05 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:06.693331+0000", 2024-09-21T22:17:47.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4839999999999998e-05 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.775314863999995, 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:47.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.773438983000005, 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:17:47.008 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40503 3.9 3:90a9f81f:::rbd_data.118542b14bcd.0000000000000296:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.503696688000005, 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012150098999999999, 2024-09-21T22:17:47.012 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40503 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470062+0000", 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470064+0000", 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.426e-06 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470070+0000", 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5969999999999997e-06 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470086+0000", 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6028999999999998e-05 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470095+0000", 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0319999999999992e-06 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470166+0000", 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0720000000000001e-05 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.470315+0000", 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014883999999999999 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.472380+0000", 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020649209999999999 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482100+0000", 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0097199520000000005 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482115+0000", 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5497000000000001e-05 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482167+0000", 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1344999999999997e-05 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.482212+0000", 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5739999999999999e-05 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:40607 3.14 3:2f2ec865:::rbd_data.118542b14bcd.0000000000000108:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 78.387926856000007, 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012270138999999999, 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 40607 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585832+0000", 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585833+0000", 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7999999999999993e-07 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585839+0000", 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8159999999999999e-06 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585851+0000", 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2408e-05 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585858+0000", 2024-09-21T22:17:47.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9709999999999998e-06 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.585922+0000", 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3602000000000005e-05 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.586036+0000", 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000114104 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.588500+0000", 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.002463799 2024-09-21T22:17:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598027+0000", 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0095273700000000003 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598038+0000", 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0504e-05 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598071+0000", 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2809999999999999e-05 2024-09-21T22:17:47.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:28.598102+0000", 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1775e-05 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.010113636, 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.027 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 45.157787843999998, 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:17:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:17:47.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.882251228999998, 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.033 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:17:47.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:126975 3.1d 3:ba76c7d7:::rbd_data.11859234a8c3.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:29.424496+0000", 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 17.549263131, 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013560575, 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.038 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 126975 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424496+0000", 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424496+0000", 2024-09-21T22:17:47.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424497+0000", 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5099999999999999e-07 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424500+0000", 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000004e-06 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424510+0000", 2024-09-21T22:17:47.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3360000000000001e-06 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424515+0000", 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0239999999999997e-06 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424561+0000", 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5945999999999997e-05 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.424612+0000", 2024-09-21T22:17:47.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0819999999999998e-05 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.426882+0000", 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0022705469999999999 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.437951+0000", 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011068506000000001 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.437981+0000", 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0528000000000003e-05 2024-09-21T22:17:47.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.438020+0000", 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8824e-05 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:29.438056+0000", 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6452999999999998e-05 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178703 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 1703936~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.043 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085706+0000", 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.8880526290000001, 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012208666, 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178703 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085706+0000", 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085706+0000", 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085707+0000", 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085709+0000", 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5009999999999999e-06 2024-09-21T22:17:47.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085716+0000", 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2589999999999997e-06 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085720+0000", 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6160000000000004e-06 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097378+0000", 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.011657667 2024-09-21T22:17:47.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097428+0000", 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0244999999999998e-05 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097915+0000", 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00048699099999999999 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.047 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178704 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 2621440~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085727+0000", 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.888031727, 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012639134, 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178704 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085727+0000", 2024-09-21T22:17:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085727+0000", 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085728+0000", 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085730+0000", 2024-09-21T22:17:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.429e-06 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085736+0000", 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6010000000000002e-06 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085740+0000", 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7090000000000001e-06 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097888+0000", 2024-09-21T22:17:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012148112000000001 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.097954+0000", 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5664e-05 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098366+0000", 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041226899999999999 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178706 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 851968~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085746+0000", 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.8880126019999999, 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01314953, 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178706 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085746+0000", 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085746+0000", 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085747+0000", 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0899999999999997e-07 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085749+0000", 2024-09-21T22:17:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085755+0000", 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9359999999999996e-06 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085759+0000", 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.583e-06 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098396+0000", 2024-09-21T22:17:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012636547999999999 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098474+0000", 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7795999999999999e-05 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098896+0000", 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00042237299999999998 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178707 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 1769472~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085765+0000", 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.887993743, 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01371788, 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178707 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085765+0000", 2024-09-21T22:17:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085765+0000", 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085766+0000", 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085768+0000", 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2740000000000002e-06 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085774+0000", 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8939999999999998e-06 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085779+0000", 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5670000000000002e-06 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.098935+0000", 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013156078999999999 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099011+0000", 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5108e-05 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099483+0000", 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000472583 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178708 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:3b [sparse-read 2686976~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.8879734199999998, 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014235467999999999, 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178708 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085786+0000", 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085788+0000", 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:17:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085794+0000", 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.085799+0000", 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0100000000000003e-06 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099516+0000", 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013716943000000001 2024-09-21T22:17:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.099600+0000", 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4387000000000004e-05 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100021+0000", 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00042102799999999999 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178709 3.3 3:c61c1244:::rbd_data.1185bfc0be28.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:47.063 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.8865441340000002, 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.013023948, 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178709 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087215+0000", 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0900000000000001e-07 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087219+0000", 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6169999999999998e-06 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087227+0000", 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1720000000000007e-06 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.087234+0000", 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5300000000000002e-06 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100072+0000", 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012837987 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100158+0000", 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6043000000000003e-05 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.100239+0000", 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:180152 3.14 3:2b1e41b5:::rbd_object_map.11858019d25.000000000000003c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.327900+0000", 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 3.6458586249999998, 2024-09-21T22:17:47.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.012792553999999999, 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 180152 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327900+0000", 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327900+0000", 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327901+0000", 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1399999999999997e-07 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327905+0000", 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2080000000000002e-06 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327912+0000", 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.327917+0000", 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8899999999999998e-06 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.333822+0000", 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0059049740000000003 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.333870+0000", 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7814e-05 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.334120+0000", 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025028799999999999 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.335737+0000", 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0016176700000000001 2024-09-21T22:17:47.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.340592+0000", 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048543229999999998 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.340649+0000", 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6743000000000002e-05 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.340693+0000", 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4372000000000001e-05 2024-09-21T22:17:47.072 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.073 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.073 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.073 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.073 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.073 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:47.073 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:17:47.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:17:47.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:17:47.075 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-21T22:17:47.075 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:47.073+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:47.076 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:47.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:47.173+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:47.180 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:47.180 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:47.180 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:47.180 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:47.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:47.199 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.199 INFO:teuthology.orchestra.run.smithi134.stdout:4799 read 0x4e282dc thru 0x4e318e9 (0x960e bytes) 2024-09-21T22:17:47.200 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.200 INFO:teuthology.orchestra.run.smithi134.stdout:4802 write 0x686716d thru 0x686ab15 (0x39a9 bytes) 2024-09-21T22:17:47.205 INFO:teuthology.orchestra.run.smithi134.stdout:4803 write 0xbe05228 thru 0xbe05d83 (0xb5c bytes) 2024-09-21T22:17:47.206 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.206 INFO:teuthology.orchestra.run.smithi134.stdout:4807 read 0x6586e8d thru 0x6587748 (0x8bc bytes) 2024-09-21T22:17:47.207 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.207 INFO:teuthology.orchestra.run.smithi134.stdout:4810 read 0x2f79fc3 thru 0x2f81812 (0x7850 bytes) 2024-09-21T22:17:47.215 INFO:teuthology.orchestra.run.smithi134.stdout:4813 write 0xe6ed0ca thru 0xe6ede34 (0xd6b bytes) 2024-09-21T22:17:47.217 INFO:teuthology.orchestra.run.smithi134.stdout:4814 write 0xbc871bd thru 0xbc96122 (0xef66 bytes) 2024-09-21T22:17:47.218 INFO:teuthology.orchestra.run.smithi134.stdout:4816 read 0x5d20421 thru 0x5d235d9 (0x31b9 bytes) 2024-09-21T22:17:47.219 INFO:teuthology.orchestra.run.smithi134.stdout:4817 writesame 0x1f1954b thru 0x1f1efea data_size 0x28(0x5aa0 bytes) 2024-09-21T22:17:47.220 INFO:teuthology.orchestra.run.smithi134.stdout:4818 write 0xa926778 thru 0xa9328c0 (0xc149 bytes) 2024-09-21T22:17:47.222 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.222 INFO:teuthology.orchestra.run.smithi134.stdout:4820 punch from 0x5328dbf to 0x532c3fa, (0x363b bytes) 2024-09-21T22:17:47.238 INFO:teuthology.orchestra.run.smithi134.stdout:4824 trunc from 0xe6ede35 to 0x12945e0 2024-09-21T22:17:47.248 INFO:teuthology.orchestra.run.smithi134.stdout:4825 read 0x46f620 thru 0x47c741 (0xd122 bytes) 2024-09-21T22:17:47.248 INFO:teuthology.orchestra.run.smithi134.stdout:4826 read 0x5a9bd7 thru 0x5abcd8 (0x2102 bytes) 2024-09-21T22:17:47.249 INFO:teuthology.orchestra.run.smithi134.stdout:4827 read 0x626771 thru 0x627b8e (0x141e bytes) 2024-09-21T22:17:47.249 INFO:teuthology.orchestra.run.smithi134.stdout:4828 read 0x62f282 thru 0x630cf8 (0x1a77 bytes) 2024-09-21T22:17:47.250 INFO:teuthology.orchestra.run.smithi134.stdout:4829 read 0x69e614 thru 0x6a3b0b (0x54f8 bytes) 2024-09-21T22:17:47.257 INFO:teuthology.orchestra.run.smithi134.stdout:4830 trunc from 0x12945e0 to 0x68f1d64 2024-09-21T22:17:47.264 INFO:teuthology.orchestra.run.smithi134.stdout:4831 punch from 0x202dd0 to 0x20f0e4, (0xc314 bytes) 2024-09-21T22:17:47.264 INFO:teuthology.orchestra.run.smithi134.stdout:4833 writesame 0x6521d8 thru 0x65d4d1 data_size 0x2(0xb2fa bytes) 2024-09-21T22:17:47.276 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:47.274+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:47.279 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.287 INFO:teuthology.orchestra.run.smithi134.stdout:4836 writesame 0x81856a5 thru 0x818f25e data_size 0x1f(0x9bba bytes) 2024-09-21T22:17:47.294 INFO:teuthology.orchestra.run.smithi134.stdout:4837 trunc from 0x818f25f to 0x4702441 2024-09-21T22:17:47.305 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:47.305 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:47.305 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:47.305 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:47.305 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:47.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:47.321 INFO:teuthology.orchestra.run.smithi134.stdout:4838 write 0xdca57f8 thru 0xdcabb11 (0x631a bytes) 2024-09-21T22:17:47.329 INFO:teuthology.orchestra.run.smithi134.stdout:4840 write 0xecb1195 thru 0xecb34e2 (0x234e bytes) 2024-09-21T22:17:47.331 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.331 INFO:teuthology.orchestra.run.smithi134.stdout:4843 punch from 0x84e931d to 0x84e936b, (0x4e bytes) 2024-09-21T22:17:47.345 INFO:teuthology.orchestra.run.smithi134.stdout:4844 trunc from 0xecb34e3 to 0x2f477dc 2024-09-21T22:17:47.353 INFO:teuthology.orchestra.run.smithi134.stdout:4845 punch from 0x4e218c to 0x4e338a, (0x11fe bytes) 2024-09-21T22:17:47.355 INFO:teuthology.orchestra.run.smithi134.stdout:4846 trunc from 0x2f477dc to 0x152f4dc 2024-09-21T22:17:47.363 INFO:teuthology.orchestra.run.smithi134.stdout:4847 read 0x24efe5 thru 0x25e5a2 (0xf5be bytes) 2024-09-21T22:17:47.364 INFO:teuthology.orchestra.run.smithi134.stdout:4848 read 0xe9a7bf thru 0xe9f441 (0x4c83 bytes) 2024-09-21T22:17:47.364 INFO:teuthology.orchestra.run.smithi134.stdout:4849 read 0x13d5e0e thru 0x13e56d9 (0xf8cc bytes) 2024-09-21T22:17:47.364 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.364 INFO:teuthology.orchestra.run.smithi134.stdout:4852 read 0x3e41ea thru 0x3e43fc (0x213 bytes) 2024-09-21T22:17:47.365 INFO:teuthology.orchestra.run.smithi134.stdout:4853 write 0x12b7ca6 thru 0x12b893d (0xc98 bytes) 2024-09-21T22:17:47.366 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:47.366 INFO:teuthology.orchestra.run.smithi134.stdout:4855 read 0x790fdc thru 0x796097 (0x50bc bytes) 2024-09-21T22:17:47.376 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:47.376+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:47.387 INFO:teuthology.orchestra.run.smithi134.stdout:4858 writesame 0xbdf243a thru 0xbdf89ec data_size 0x5(0x65b3 bytes) 2024-09-21T22:17:47.395 INFO:teuthology.orchestra.run.smithi134.stdout:4859 write 0xc546284 thru 0xc54fa0e (0x978b bytes) 2024-09-21T22:17:47.396 INFO:teuthology.orchestra.run.smithi134.stdout:4862 read 0x297ad50 thru 0x29837b0 (0x8a61 bytes) 2024-09-21T22:17:47.397 INFO:teuthology.orchestra.run.smithi134.stdout:4863 read 0xe003ca thru 0xe07b7b (0x77b2 bytes) 2024-09-21T22:17:47.397 INFO:teuthology.orchestra.run.smithi134.stdout:4865 write 0x45727ec thru 0x4576cf2 (0x4507 bytes) 2024-09-21T22:17:47.399 INFO:teuthology.orchestra.run.smithi134.stdout:4866 writesame 0x29dabae thru 0x29e5414 data_size 0x1(0xa867 bytes) 2024-09-21T22:17:47.420 INFO:teuthology.orchestra.run.smithi134.stdout:4867 write 0x46719ce thru 0x4677beb (0x621e bytes) 2024-09-21T22:17:47.422 INFO:teuthology.orchestra.run.smithi134.stdout:4869 read 0x60b5792 thru 0x60b7143 (0x19b2 bytes) 2024-09-21T22:17:47.423 INFO:teuthology.orchestra.run.smithi134.stdout:4870 writesame 0xa488b49 thru 0xa496205 data_size 0x1(0xd6bd bytes) 2024-09-21T22:17:47.426 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:47.426 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:47.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:47.426 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:47.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.426 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12170 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1523712~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.47689323199999, 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040263359999999998, 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12170 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947340+0000", 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4400000000000001e-07 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947342+0000", 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0700000000000001e-06 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947349+0000", 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3629999999999999e-06 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947353+0000", 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6489999999999999e-06 2024-09-21T22:17:47.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987084+0000", 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.039730533999999998 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987156+0000", 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2064999999999995e-05 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987603+0000", 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044723499999999998 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12171 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1572864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.47687306100001, 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040658037000000001, 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.431 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12171 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:47.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947360+0000", 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947362+0000", 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9999999999999999e-06 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947368+0000", 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7350000000000001e-06 2024-09-21T22:17:47.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947373+0000", 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987642+0000", 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040269854000000001 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.987733+0000", 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0299999999999999e-05 2024-09-21T22:17:47.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988018+0000", 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028525499999999999 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.47685411499999, 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.435 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:47.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:17:47.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.476834752, 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.439 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.443 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.476802104, 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.444 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:17:47.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.47675093700001, 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.448 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:17:47.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.476724265, 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.476699466, 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:17:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:17:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.476668518, 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:17:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.4766443, 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:17:47.470 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.47661994800001, 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.471 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:17:47.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:17:47.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.47659570499999, 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:17:47.475 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:17:47.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.479 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.47656597, 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:17:47.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:17:47.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:47.484 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.4765305, 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:17:47.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.438999295000002, 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:47.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:47.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.494 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.246131636000001, 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:47.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:17:47.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:17:47.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.240765104000005, 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.500 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:17:47.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:17:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.504 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.223200310999999, 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:17:47.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:17:47.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:17:47.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.190819317999996, 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.509 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:17:47.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:17:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.143015872000007, 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.513 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.519 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:4871 trunc from 0xc54fa0f to 0xc3dc314 2024-09-21T22:17:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:4872 write 0x1aa048b thru 0x1aa2b2b (0x26a1 bytes) 2024-09-21T22:17:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:4873 read 0x4efd7c5 thru 0x4f076b8 (0x9ef4 bytes) 2024-09-21T22:17:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:4875 read 0x986483 thru 0x99125e (0xaddc bytes) 2024-09-21T22:17:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:4876 clone 31 order 25 su 131072 sc 8 2024-09-21T22:17:47.521 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:47.519+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:47.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:47.621 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:47.621+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:47.666 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:47.666 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:47.667 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:47.667 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:47.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:47.722 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:47.721+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:47.819 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:47.819 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:47.819 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:47.820 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:47.820 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:47.823 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:47.822+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:47.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:47.924 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:47.923+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:47.974 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:47.974 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:47.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 111.46120792000001, 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.975 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:17:47.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:17:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 107.058265617, 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:17:47.980 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:47.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 107.05820276199999, 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.987 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:17:47.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:47.993 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9314399230000001, 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:47.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.997 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9314048320000001, 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:47.998 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:47.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.931390393, 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.002 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:48.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.005 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.006 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9313757339999995, 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.010 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9313626910000004, 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:48.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:17:48.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.014 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9313392020000002, 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9313260640000003, 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:17:48.018 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:17:48.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9313159290000002, 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.022 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9312154069999998, 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.026 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:17:48.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9311976140000002, 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:17:48.030 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:17:48.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9311770939999997, 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.034 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:17:48.037 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9311550930000001, 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:17:48.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:17:48.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.041 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9231811649999999, 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.043 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178642 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3735552~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9059735849999999, 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015880737999999998, 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178642 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066650+0000", 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5300000000000003e-07 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066654+0000", 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5709999999999999e-06 2024-09-21T22:17:48.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066665+0000", 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0209e-05 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066671+0000", 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7120000000000003e-06 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080727+0000", 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014055896 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080811+0000", 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3710999999999999e-05 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082530+0000", 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017187859999999999 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:17:48.049 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9057788550000003, 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.052 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.905636758, 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.053 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:17:48.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:17:48.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:17:48.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 4.9052408730000003, 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:17:48.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:17:48.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.061 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:48.062 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:17:48.062 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:17:48.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:48.063 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:48.061+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:48.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:17:48.163 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:48.162+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:48.208 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:48.208 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:48.208 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:48.208 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:48.217 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:48.302 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:48.301+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:48.362 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:48.362 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:48.365 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:48.364+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:48.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:48.465 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:48.464+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114782101000003, 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114736481999998, 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:17:48.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114663749000002, 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114616871999999, 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.529 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:17:48.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:17:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114552132, 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.533 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:48.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:48.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114515902999997, 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.537 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114421976000003, 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:48.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:17:48.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114398207999997, 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.545 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:17:48.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114333337000005, 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.549 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114295713999994, 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.553 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:17:48.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:17:48.556 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114254920999997, 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.557 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:17:48.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114179460000003, 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:17:48.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:48.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114109087000003, 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:48.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:17:48.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:17:48.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.568 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114075412000005, 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:17:48.570 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:17:48.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.572 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.114006660000001, 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:48.573 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:17:48.574 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.575 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:48.576 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.113962263999994, 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:17:48.578 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:17:48.579 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.580 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.113871316000001, 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:48.581 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:17:48.582 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:17:48.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.584 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.113842792, 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.585 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.586 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.587 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.113810498000007, 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:17:48.588 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.589 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.590 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:17:48.591 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.113772365000003, 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:48.592 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:48.593 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:17:48.594 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:48.595 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:48.596 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:48.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:48.598 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:48.596+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:48.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:48.696+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:48.701 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:48.701 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:48.701 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:48.702 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:48.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:48.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:48.799 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:48.799+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:48.856 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:48.856 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:48.856 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:48.856 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:48.856 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:48.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:48.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:48.907+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:48.917 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:48.917 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:48.935 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:48.935 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:48.952 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:48.952 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:48.968 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:48.968 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:48.973 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:48.973 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:48.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:48.986 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:48.986 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:49.003 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:49.003 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:49.004 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:49.001+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:49.020 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:49.020 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:49.037 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:49.037 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:49.060 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:17:49.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:17:49.102 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:49.101+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:49.109 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:49.109 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:49.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:49.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:49.204+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:49.281 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:49.281 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:49.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:49.332 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:49.330+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:49.404 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:49.403+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:49.436 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:49.436 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:49.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:49.504 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:49.503+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:49.549 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:49.549 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:49.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:49.605 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:49.603+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:49.661 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:49.661 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:49.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:49.706 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:49.705+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:49.807 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:49.806+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:49.812 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:49.812 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:49.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:49.907 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:49.907+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:49.924 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:49.924 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:49.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:50.009 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:50.007+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:50.035 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:50.035 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:50.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:50.072 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:17:50.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:17:50.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:17:50.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:50.128+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:50.185 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:50.186 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:50.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:50.209 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-21T22:17:50.241 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:50.241+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:50.310 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:50.310+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:50.315 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:50.315 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:50.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:50.411 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:50.410+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:50.469 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:50.469 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:50.478 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:50.492 INFO:teuthology.orchestra.run.smithi134.stdout:4878 trunc from 0xc3dc314 to 0x883c6e6 2024-09-21T22:17:50.503 INFO:teuthology.orchestra.run.smithi134.stdout:4880 write 0x6f21106 thru 0x6f23d3b (0x2c36 bytes) 2024-09-21T22:17:50.504 INFO:teuthology.orchestra.run.smithi134.stdout:4881 write 0x18b201a thru 0x18c0591 (0xe578 bytes) 2024-09-21T22:17:50.516 INFO:teuthology.orchestra.run.smithi134.stdout:4882 write 0xb89b6f7 thru 0xb8ab5a0 (0xfeaa bytes) 2024-09-21T22:17:50.517 INFO:teuthology.orchestra.run.smithi134.stdout:4883 write 0x1692b58 thru 0x169aeab (0x8354 bytes) 2024-09-21T22:17:50.519 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:50.519+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:50.528 INFO:teuthology.orchestra.run.smithi134.stdout:4884 trunc from 0xb8ab5a1 to 0x3db9a60 2024-09-21T22:17:50.535 INFO:teuthology.orchestra.run.smithi134.stdout:4886 punch from 0x34d4060 to 0x34d4f1c, (0xebc bytes) 2024-09-21T22:17:50.544 INFO:teuthology.orchestra.run.smithi134.stdout:4887 writesame 0x69042ea thru 0x69061dd data_size 0xe(0x1ef4 bytes) 2024-09-21T22:17:50.551 INFO:teuthology.orchestra.run.smithi134.stdout:4888 trunc from 0x69061de to 0x2295e23 2024-09-21T22:17:50.558 INFO:teuthology.orchestra.run.smithi134.stdout:4890 read 0xa2b98a thru 0xa2ea50 (0x30c7 bytes) 2024-09-21T22:17:50.567 INFO:teuthology.orchestra.run.smithi134.stdout:4891 write 0x4e7c06a thru 0x4e7d83c (0x17d3 bytes) 2024-09-21T22:17:50.569 INFO:teuthology.orchestra.run.smithi134.stdout:4892 punch from 0x20f9ba3 to 0x20fb585, (0x19e2 bytes) 2024-09-21T22:17:50.569 INFO:teuthology.orchestra.run.smithi134.stdout:4895 punch from 0x123befa to 0x1242d6c, (0x6e72 bytes) 2024-09-21T22:17:50.569 INFO:teuthology.orchestra.run.smithi134.stdout:4898 write 0x22a5c65 thru 0x22addef (0x818b bytes) 2024-09-21T22:17:50.570 INFO:teuthology.orchestra.run.smithi134.stdout:4899 writesame 0x2a2ff2d thru 0x2a3be16 data_size 0x7(0xbeea bytes) 2024-09-21T22:17:50.582 INFO:teuthology.orchestra.run.smithi134.stdout:4900 write 0x6673c41 thru 0x6679469 (0x5829 bytes) 2024-09-21T22:17:50.588 INFO:teuthology.orchestra.run.smithi134.stdout:4901 trunc from 0x667946a to 0x28a5628 2024-09-21T22:17:50.597 INFO:teuthology.orchestra.run.smithi134.stdout:4902 trunc from 0x28a5628 to 0x123b7ee 2024-09-21T22:17:50.604 INFO:teuthology.orchestra.run.smithi134.stdout:4904 read 0x12365b0 thru 0x1236ec5 (0x916 bytes) 2024-09-21T22:17:50.612 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:50.611+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:50.615 INFO:teuthology.orchestra.run.smithi134.stdout:4905 writesame 0x587bb47 thru 0x5886c7a data_size 0x16(0xb134 bytes) 2024-09-21T22:17:50.630 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:50.630 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:50.631 INFO:teuthology.orchestra.run.smithi134.stdout:4906 writesame 0xc9db14c thru 0xc9e6efe data_size 0x1(0xbdb3 bytes) 2024-09-21T22:17:50.632 INFO:teuthology.orchestra.run.smithi134.stdout:4907 writesame 0x45ee11a thru 0x45eea33 data_size 0x2(0x91a bytes) 2024-09-21T22:17:50.634 INFO:teuthology.orchestra.run.smithi134.stdout:4909 read 0xbd148f1 thru 0xbd203e9 (0xbaf9 bytes) 2024-09-21T22:17:50.634 INFO:teuthology.orchestra.run.smithi134.stdout:4910 writesame 0x72987d7 thru 0x72a05dd data_size 0xb(0x7e07 bytes) 2024-09-21T22:17:50.637 INFO:teuthology.orchestra.run.smithi134.stdout:4911 writesame 0x3847a08 thru 0x3851002 data_size 0x7(0x95fb bytes) 2024-09-21T22:17:50.640 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:50.641 INFO:teuthology.orchestra.run.smithi134.stdout:4912 writesame 0x1687a5 thru 0x1734f8 data_size 0x2(0xad54 bytes) 2024-09-21T22:17:50.653 INFO:teuthology.orchestra.run.smithi134.stdout:4913 trunc from 0xc9e6eff to 0xb22daf4 2024-09-21T22:17:50.660 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.660 INFO:teuthology.orchestra.run.smithi134.stdout:4916 write 0x4c0f55d thru 0x4c0f5bf (0x63 bytes) 2024-09-21T22:17:50.661 INFO:teuthology.orchestra.run.smithi134.stdout:4917 read 0xa3d7943 thru 0xa3def3b (0x75f9 bytes) 2024-09-21T22:17:50.661 INFO:teuthology.orchestra.run.smithi134.stdout:4918 read 0x9c94fb5 thru 0x9ca3dff (0xee4b bytes) 2024-09-21T22:17:50.670 INFO:teuthology.orchestra.run.smithi134.stdout:4919 write 0xd4fea72 thru 0xd509a92 (0xb021 bytes) 2024-09-21T22:17:50.671 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.671 INFO:teuthology.orchestra.run.smithi134.stdout:4921 read 0xb6c633f thru 0xb6cdd92 (0x7a54 bytes) 2024-09-21T22:17:50.672 INFO:teuthology.orchestra.run.smithi134.stdout:4922 write 0x7cbbd7d thru 0x7cc804f (0xc2d3 bytes) 2024-09-21T22:17:50.673 INFO:teuthology.orchestra.run.smithi134.stdout:4923 read 0x741ce74 thru 0x741e185 (0x1312 bytes) 2024-09-21T22:17:50.674 INFO:teuthology.orchestra.run.smithi134.stdout:4924 punch from 0x5f15fac to 0x5f17e14, (0x1e68 bytes) 2024-09-21T22:17:50.674 INFO:teuthology.orchestra.run.smithi134.stdout:4926 read 0x8831d3c thru 0x8840df8 (0xf0bd bytes) 2024-09-21T22:17:50.674 INFO:teuthology.orchestra.run.smithi134.stdout:4927 write 0x21c98c5 thru 0x21d57ec (0xbf28 bytes) 2024-09-21T22:17:50.675 INFO:teuthology.orchestra.run.smithi134.stdout:4928 writesame 0x8b345df thru 0x8b35d83 data_size 0x1(0x17a5 bytes) 2024-09-21T22:17:50.678 INFO:teuthology.orchestra.run.smithi134.stdout:4929 read 0xb7a618c thru 0xb7b13f9 (0xb26e bytes) 2024-09-21T22:17:50.684 INFO:teuthology.orchestra.run.smithi134.stdout:4930 write 0xd8991db thru 0xd8a29ab (0x97d1 bytes) 2024-09-21T22:17:50.685 INFO:teuthology.orchestra.run.smithi134.stdout:4931 read 0x3df8e3 thru 0x3e6c4b (0x7369 bytes) 2024-09-21T22:17:50.686 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.686 INFO:teuthology.orchestra.run.smithi134.stdout:4933 punch from 0x3570e71 to 0x357ad2e, (0x9ebd bytes) 2024-09-21T22:17:50.700 INFO:teuthology.orchestra.run.smithi134.stdout:4939 trunc from 0xd8a29ac to 0x1917067 2024-09-21T22:17:50.708 INFO:teuthology.orchestra.run.smithi134.stdout:4940 trunc from 0x1917067 to 0x23e423d 2024-09-21T22:17:50.713 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:50.711+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:50.724 INFO:teuthology.orchestra.run.smithi134.stdout:4941 write 0x6fec168 thru 0x6ff51bd (0x9056 bytes) 2024-09-21T22:17:50.725 INFO:teuthology.orchestra.run.smithi134.stdout:4942 trunc from 0x6ff51be to 0x706f27e 2024-09-21T22:17:50.731 INFO:teuthology.orchestra.run.smithi134.stdout:4944 read 0xff27e3 thru 0xfff719 (0xcf37 bytes) 2024-09-21T22:17:50.732 INFO:teuthology.orchestra.run.smithi134.stdout:4946 punch from 0x4def6b0 to 0x4df4365, (0x4cb5 bytes) 2024-09-21T22:17:50.732 INFO:teuthology.orchestra.run.smithi134.stdout:4949 read 0x4c0f841 thru 0x4c1e9c6 (0xf186 bytes) 2024-09-21T22:17:50.732 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.740 INFO:teuthology.orchestra.run.smithi134.stdout:4954 write 0x9304114 thru 0x93044e2 (0x3cf bytes) 2024-09-21T22:17:50.748 INFO:teuthology.orchestra.run.smithi134.stdout:4956 trunc from 0x93044e3 to 0x354108c 2024-09-21T22:17:50.756 INFO:teuthology.orchestra.run.smithi134.stdout:4958 read 0x275da13 thru 0x2767fb6 (0xa5a4 bytes) 2024-09-21T22:17:50.771 INFO:teuthology.orchestra.run.smithi134.stdout:4959 write 0xa724139 thru 0xa731b96 (0xda5e bytes) 2024-09-21T22:17:50.772 INFO:teuthology.orchestra.run.smithi134.stdout:4960 punch from 0x7951c26 to 0x7954ad4, (0x2eae bytes) 2024-09-21T22:17:50.772 INFO:teuthology.orchestra.run.smithi134.stdout:4961 writesame 0x2b1f2b1 thru 0x2b23d21 data_size 0x13(0x4a71 bytes) 2024-09-21T22:17:50.774 INFO:teuthology.orchestra.run.smithi134.stdout:4962 write 0x2eee542 thru 0x2ef2557 (0x4016 bytes) 2024-09-21T22:17:50.776 INFO:teuthology.orchestra.run.smithi134.stdout:4963 trunc from 0xa731b97 to 0x9f5537c 2024-09-21T22:17:50.783 INFO:teuthology.orchestra.run.smithi134.stdout:4965 write 0x9838b5 thru 0x98e347 (0xaa93 bytes) 2024-09-21T22:17:50.785 INFO:teuthology.orchestra.run.smithi134.stdout:4966 punch from 0x1a072e to 0x1a86d2, (0x7fa4 bytes) 2024-09-21T22:17:50.785 INFO:teuthology.orchestra.run.smithi134.stdout:4967 punch from 0x211f8ed to 0x212d100, (0xd813 bytes) 2024-09-21T22:17:50.785 INFO:teuthology.orchestra.run.smithi134.stdout:4968 read 0x5a34604 thru 0x5a3ddb8 (0x97b5 bytes) 2024-09-21T22:17:50.785 INFO:teuthology.orchestra.run.smithi134.stdout:4969 read 0x9d8aa49 thru 0x9d9315d (0x8715 bytes) 2024-09-21T22:17:50.787 INFO:teuthology.orchestra.run.smithi134.stdout:4970 trunc from 0x9f5537c to 0xb3a4d7a 2024-09-21T22:17:50.791 INFO:teuthology.orchestra.run.smithi134.stdout:4971 write 0x9a04afe thru 0x9a0b513 (0x6a16 bytes) 2024-09-21T22:17:50.793 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:50.793 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:50.801 INFO:teuthology.orchestra.run.smithi134.stdout:4973 trunc from 0xb3a4d7a to 0x471c830 2024-09-21T22:17:50.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:50.809 INFO:teuthology.orchestra.run.smithi134.stdout:4974 read 0x40bd725 thru 0x40c03c1 (0x2c9d bytes) 2024-09-21T22:17:50.810 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.810 INFO:teuthology.orchestra.run.smithi134.stdout:4976 write 0x3fd4992 thru 0x3fd78ff (0x2f6e bytes) 2024-09-21T22:17:50.811 INFO:teuthology.orchestra.run.smithi134.stdout:4979 read 0x4199ec thru 0x42493a (0xaf4f bytes) 2024-09-21T22:17:50.811 INFO:teuthology.orchestra.run.smithi134.stdout:4980 read 0x7c7928 thru 0x7d476e (0xce47 bytes) 2024-09-21T22:17:50.828 INFO:teuthology.orchestra.run.smithi134.stdout:4981 write 0xca6c0e3 thru 0xca6db95 (0x1ab3 bytes) 2024-09-21T22:17:50.829 INFO:teuthology.orchestra.run.smithi134.stdout:4982 read 0x7a7573f thru 0x7a766e0 (0xfa2 bytes) 2024-09-21T22:17:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:4983 punch from 0x248b245 to 0x2497c08, (0xc9c3 bytes) 2024-09-21T22:17:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:4984 punch from 0x31deb9b to 0x31e1669, (0x2ace bytes) 2024-09-21T22:17:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:4985 read 0x277ec9b thru 0x277f4e4 (0x84a bytes) 2024-09-21T22:17:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:4987 write 0x6b02e92 thru 0x6b08cbf (0x5e2e bytes) 2024-09-21T22:17:50.831 INFO:teuthology.orchestra.run.smithi134.stdout:4988 write 0x1a7fc48 thru 0x1a84166 (0x451f bytes) 2024-09-21T22:17:50.833 INFO:teuthology.orchestra.run.smithi134.stdout:4989 write 0x94b2fb5 thru 0x94b50c4 (0x2110 bytes) 2024-09-21T22:17:50.834 INFO:teuthology.orchestra.run.smithi134.stdout:4992 write 0x7db8aa1 thru 0x7dbda90 (0x4ff0 bytes) 2024-09-21T22:17:50.845 INFO:teuthology.orchestra.run.smithi134.stdout:4993 trunc from 0xca6db96 to 0x48e4143 2024-09-21T22:17:50.847 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:50.846+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:50.852 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.852 INFO:teuthology.orchestra.run.smithi134.stdout:4996 read 0x19aa3d4 thru 0x19b865d (0xe28a bytes) 2024-09-21T22:17:50.870 INFO:teuthology.orchestra.run.smithi134.stdout:4997 writesame 0xcb99de4 thru 0xcb9fc42 data_size 0x1(0x5e5f bytes) 2024-09-21T22:17:50.870 INFO:teuthology.orchestra.run.smithi134.stdout:4998 read 0x58d1a99 thru 0x58d2999 (0xf01 bytes) 2024-09-21T22:17:50.870 INFO:teuthology.orchestra.run.smithi134.stdout:4999 write 0xca75488 thru 0xca7a2ec (0x4e65 bytes) 2024-09-21T22:17:50.871 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.874 INFO:teuthology.orchestra.run.smithi134.stdout:5001 trunc from 0xcb9fc43 to 0xb0e6b09 2024-09-21T22:17:50.881 INFO:teuthology.orchestra.run.smithi134.stdout:5003 punch from 0x88364b8 to 0x883928c, (0x2dd4 bytes) 2024-09-21T22:17:50.881 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.881 INFO:teuthology.orchestra.run.smithi134.stdout:5005 write 0x5f38851 thru 0x5f44e8b (0xc63b bytes) 2024-09-21T22:17:50.883 INFO:teuthology.orchestra.run.smithi134.stdout:5006 read 0x6309f70 thru 0x630a887 (0x918 bytes) 2024-09-21T22:17:50.890 INFO:teuthology.orchestra.run.smithi134.stdout:5007 writesame 0xd1ed1dc thru 0xd1ee8dc data_size 0xd(0x1701 bytes) 2024-09-21T22:17:50.892 INFO:teuthology.orchestra.run.smithi134.stdout:5008 read 0x94baddd thru 0x94c04a6 (0x56ca bytes) 2024-09-21T22:17:50.892 INFO:teuthology.orchestra.run.smithi134.stdout:5009 read 0x7b14970 thru 0x7b1ee3d (0xa4ce bytes) 2024-09-21T22:17:50.893 INFO:teuthology.orchestra.run.smithi134.stdout:5011 read 0x5cba84a thru 0x5cc7ad8 (0xd28f bytes) 2024-09-21T22:17:50.894 INFO:teuthology.orchestra.run.smithi134.stdout:5012 punch from 0xcd8e239 to 0xcd987e5, (0xa5ac bytes) 2024-09-21T22:17:50.894 INFO:teuthology.orchestra.run.smithi134.stdout:5014 punch from 0x2207a51 to 0x2214c42, (0xd1f1 bytes) 2024-09-21T22:17:50.894 INFO:teuthology.orchestra.run.smithi134.stdout:5015 writesame 0xbba54a6 thru 0xbba5b9e data_size 0x15(0x6f9 bytes) 2024-09-21T22:17:50.895 INFO:teuthology.orchestra.run.smithi134.stdout:5016 write 0x6741571 thru 0x6747ffc (0x6a8c bytes) 2024-09-21T22:17:50.896 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.896 INFO:teuthology.orchestra.run.smithi134.stdout:5018 punch from 0x4429c0d to 0x4439403, (0xf7f6 bytes) 2024-09-21T22:17:50.896 INFO:teuthology.orchestra.run.smithi134.stdout:5019 write 0xa7b5461 thru 0xa7b6744 (0x12e4 bytes) 2024-09-21T22:17:50.898 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.898 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.898 INFO:teuthology.orchestra.run.smithi134.stdout:5027 write 0x65a9c3 thru 0x661d87 (0x73c5 bytes) 2024-09-21T22:17:50.900 INFO:teuthology.orchestra.run.smithi134.stdout:5030 read 0x9f6f05b thru 0x9f729d4 (0x397a bytes) 2024-09-21T22:17:50.900 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:5037 writesame 0xe52a7fe thru 0xe5304cf data_size 0x2(0x5cd2 bytes) 2024-09-21T22:17:50.912 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:50.912 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:50.916 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:50.914+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:50.918 INFO:teuthology.orchestra.run.smithi134.stdout:5038 trunc from 0xe5304d0 to 0x69cecb8 2024-09-21T22:17:50.922 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:50.925 INFO:teuthology.orchestra.run.smithi134.stdout:5039 punch from 0x4498e8b to 0x449c57e, (0x36f3 bytes) 2024-09-21T22:17:50.925 INFO:teuthology.orchestra.run.smithi134.stdout:5040 read 0x154caa4 thru 0x154d37e (0x8db bytes) 2024-09-21T22:17:50.925 INFO:teuthology.orchestra.run.smithi134.stdout:5043 read 0x414409b thru 0x414f79d (0xb703 bytes) 2024-09-21T22:17:50.926 INFO:teuthology.orchestra.run.smithi134.stdout:5044 read 0x117f8d1 thru 0x1187644 (0x7d74 bytes) 2024-09-21T22:17:50.940 INFO:teuthology.orchestra.run.smithi134.stdout:5045 write 0xde2427a thru 0xde2b428 (0x71af bytes) 2024-09-21T22:17:50.941 INFO:teuthology.orchestra.run.smithi134.stdout:5046 write 0x828924c thru 0x829879c (0xf551 bytes) 2024-09-21T22:17:50.943 INFO:teuthology.orchestra.run.smithi134.stdout:5047 write 0x30aae22 thru 0x30bab85 (0xfd64 bytes) 2024-09-21T22:17:50.944 INFO:teuthology.orchestra.run.smithi134.stdout:5048 read 0xc9583cf thru 0xc95d184 (0x4db6 bytes) 2024-09-21T22:17:50.944 INFO:teuthology.orchestra.run.smithi134.stdout:5049 writesame 0xc2e4a88 thru 0xc2ecedb data_size 0x12(0x8454 bytes) 2024-09-21T22:17:50.947 INFO:teuthology.orchestra.run.smithi134.stdout:5050 punch from 0xa425ea7 to 0xa434df2, (0xef4b bytes) 2024-09-21T22:17:50.947 INFO:teuthology.orchestra.run.smithi134.stdout:5052 read 0xb8abbf5 thru 0xb8b858e (0xc99a bytes) 2024-09-21T22:17:50.947 INFO:teuthology.orchestra.run.smithi134.stdout:5053 punch from 0xe3897c to 0xe428de, (0x9f62 bytes) 2024-09-21T22:17:50.947 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.948 INFO:teuthology.orchestra.run.smithi134.stdout:5055 trunc from 0xde2b429 to 0xd35d89e 2024-09-21T22:17:50.954 INFO:teuthology.orchestra.run.smithi134.stdout:5056 read 0x49c4506 thru 0x49c8b1f (0x461a bytes) 2024-09-21T22:17:50.955 INFO:teuthology.orchestra.run.smithi134.stdout:5057 punch from 0x606e48c to 0x60704ff, (0x2073 bytes) 2024-09-21T22:17:50.955 INFO:teuthology.orchestra.run.smithi134.stdout:5058 punch from 0xc80311d to 0xc80fe3e, (0xcd21 bytes) 2024-09-21T22:17:50.955 INFO:teuthology.orchestra.run.smithi134.stdout:5060 read 0xbb0b206 thru 0xbb0e492 (0x328d bytes) 2024-09-21T22:17:50.955 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.955 INFO:teuthology.orchestra.run.smithi134.stdout:5062 writesame 0x4360950 thru 0x4362adc data_size 0x7(0x218d bytes) 2024-09-21T22:17:50.956 INFO:teuthology.orchestra.run.smithi134.stdout:5063 punch from 0xcbce51c to 0xcbd3a59, (0x553d bytes) 2024-09-21T22:17:50.956 INFO:teuthology.orchestra.run.smithi134.stdout:5064 write 0x2184425 thru 0x2192eb5 (0xea91 bytes) 2024-09-21T22:17:50.958 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:50.958 INFO:teuthology.orchestra.run.smithi134.stdout:5066 write 0x91b7495 thru 0x91c1eeb (0xaa57 bytes) 2024-09-21T22:17:50.966 INFO:teuthology.orchestra.run.smithi134.stdout:5068 write 0xe758aa8 thru 0xe7675ee (0xeb47 bytes) 2024-09-21T22:17:50.968 INFO:teuthology.orchestra.run.smithi134.stdout:5070 punch from 0x406c777 to 0x407969f, (0xcf28 bytes) 2024-09-21T22:17:50.968 INFO:teuthology.orchestra.run.smithi134.stdout:5071 write 0x4d02b98 thru 0x4d0a7ad (0x7c16 bytes) 2024-09-21T22:17:50.982 INFO:teuthology.orchestra.run.smithi134.stdout:5072 trunc from 0xe7675ef to 0x3b3f933 2024-09-21T22:17:51.005 INFO:teuthology.orchestra.run.smithi134.stdout:5073 write 0xcca995d thru 0xccb7870 (0xdf14 bytes) 2024-09-21T22:17:51.011 INFO:teuthology.orchestra.run.smithi134.stdout:5074 trunc from 0xccb7871 to 0x9ea57bf 2024-09-21T22:17:51.017 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:51.016+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:51.018 INFO:teuthology.orchestra.run.smithi134.stdout:5075 write 0x5f816ce thru 0x5f867c3 (0x50f6 bytes) 2024-09-21T22:17:51.020 INFO:teuthology.orchestra.run.smithi134.stdout:5077 write 0x4bf403e thru 0x4bf9ca1 (0x5c64 bytes) 2024-09-21T22:17:51.029 INFO:teuthology.orchestra.run.smithi134.stdout:5078 writesame 0xbde8be1 thru 0xbdea326 data_size 0x9(0x1746 bytes) 2024-09-21T22:17:51.031 INFO:teuthology.orchestra.run.smithi134.stdout:5079 read 0x762d01b thru 0x763b1ef (0xe1d5 bytes) 2024-09-21T22:17:51.039 INFO:teuthology.orchestra.run.smithi134.stdout:5080 write 0xd541ea9 thru 0xd54a759 (0x88b1 bytes) 2024-09-21T22:17:51.040 INFO:teuthology.orchestra.run.smithi134.stdout:5082 write 0xa68a2a2 thru 0xa69593d (0xb69c bytes) 2024-09-21T22:17:51.042 INFO:teuthology.orchestra.run.smithi134.stdout:5083 read 0x43c5e8d thru 0x43cf5f3 (0x9767 bytes) 2024-09-21T22:17:51.042 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:51.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:5087 trunc from 0xd54a75a to 0x271485c 2024-09-21T22:17:51.063 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:17:51.068 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:17:51.077 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:51.077 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:51.083 INFO:teuthology.orchestra.run.smithi134.stdout:5088 writesame 0x983019a thru 0x9831a42 data_size 0x1(0x18a9 bytes) 2024-09-21T22:17:51.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:17:51.088 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:51.091 INFO:teuthology.orchestra.run.smithi134.stdout:5089 write 0xa8bc3bd thru 0xa8bea80 (0x26c4 bytes) 2024-09-21T22:17:51.102 INFO:teuthology.orchestra.run.smithi134.stdout:5090 write 0xd5118a0 thru 0xd5196cd (0x7e2e bytes) 2024-09-21T22:17:51.106 INFO:teuthology.orchestra.run.smithi134.stdout:5091 writesame 0x86ba1bc thru 0x86bfd0b data_size 0x18(0x5b50 bytes) 2024-09-21T22:17:51.108 INFO:teuthology.orchestra.run.smithi134.stdout:5092 punch from 0x1bcd18b to 0x1bcfc23, (0x2a98 bytes) 2024-09-21T22:17:51.108 INFO:teuthology.orchestra.run.smithi134.stdout:5093 punch from 0x2290216 to 0x229c042, (0xbe2c bytes) 2024-09-21T22:17:51.113 INFO:teuthology.orchestra.run.smithi134.stdout:5094 write 0xd82a11a thru 0xd835bb4 (0xba9b bytes) 2024-09-21T22:17:51.115 INFO:teuthology.orchestra.run.smithi134.stdout:5095 punch from 0x53c6a6 to 0x543204, (0x6b5e bytes) 2024-09-21T22:17:51.115 INFO:teuthology.orchestra.run.smithi134.stdout:5096 write 0x572e522 thru 0x573815c (0x9c3b bytes) 2024-09-21T22:17:51.116 INFO:teuthology.orchestra.run.smithi134.stdout:5097 write 0x9474d68 thru 0x9477e3e (0x30d7 bytes) 2024-09-21T22:17:51.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:51.116+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:51.131 INFO:teuthology.orchestra.run.smithi134.stdout:5098 trunc from 0xd835bb5 to 0x27d026b 2024-09-21T22:17:51.138 INFO:teuthology.orchestra.run.smithi134.stdout:5100 read 0x1dd839 thru 0x1ebe12 (0xe5da bytes) 2024-09-21T22:17:51.139 INFO:teuthology.orchestra.run.smithi134.stdout:5101 read 0xfebef2 thru 0xffb253 (0xf362 bytes) 2024-09-21T22:17:51.139 INFO:teuthology.orchestra.run.smithi134.stdout:5102 read 0x1cbf6 thru 0x20d7f (0x418a bytes) 2024-09-21T22:17:51.140 INFO:teuthology.orchestra.run.smithi134.stdout:5103 punch from 0x1c9f5d5 to 0x1ca9bb6, (0xa5e1 bytes) 2024-09-21T22:17:51.151 INFO:teuthology.orchestra.run.smithi134.stdout:5104 writesame 0x6b69ca3 thru 0x6b79139 data_size 0x7(0xf497 bytes) 2024-09-21T22:17:51.162 INFO:teuthology.orchestra.run.smithi134.stdout:5105 write 0x9c6a889 thru 0x9c7388b (0x9003 bytes) 2024-09-21T22:17:51.165 INFO:teuthology.orchestra.run.smithi134.stdout:5106 trunc from 0x9c7388c to 0xa650829 2024-09-21T22:17:51.170 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:51.179 INFO:teuthology.orchestra.run.smithi134.stdout:5110 writesame 0xd72fce8 thru 0xd73f8db data_size 0xac(0xfbf4 bytes) 2024-09-21T22:17:51.181 INFO:teuthology.orchestra.run.smithi134.stdout:5113 punch from 0x98fb383 to 0x990052f, (0x51ac bytes) 2024-09-21T22:17:51.181 INFO:teuthology.orchestra.run.smithi134.stdout:5114 write 0x5335d03 thru 0x533d057 (0x7355 bytes) 2024-09-21T22:17:51.184 INFO:teuthology.orchestra.run.smithi134.stdout:5115 trunc from 0xd73f8dc to 0xe44af5c 2024-09-21T22:17:51.189 INFO:teuthology.orchestra.run.smithi134.stdout:5116 write 0x9f5ac91 thru 0x9f6a481 (0xf7f1 bytes) 2024-09-21T22:17:51.191 INFO:teuthology.orchestra.run.smithi134.stdout:5117 write 0xbd2ea53 thru 0xbd3a0fe (0xb6ac bytes) 2024-09-21T22:17:51.193 INFO:teuthology.orchestra.run.smithi134.stdout:5118 punch from 0x80871b3 to 0x808ac31, (0x3a7e bytes) 2024-09-21T22:17:51.193 INFO:teuthology.orchestra.run.smithi134.stdout:5119 write 0xbc53635 thru 0xbc5f605 (0xbfd1 bytes) 2024-09-21T22:17:51.199 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:51.200 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:51.200 INFO:teuthology.orchestra.run.smithi134.stdout:5120 write 0xe789993 thru 0xe79731a (0xd988 bytes) 2024-09-21T22:17:51.213 INFO:teuthology.orchestra.run.smithi134.stdout:5122 trunc from 0xe79731b to 0x43f1420 2024-09-21T22:17:51.218 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:51.216+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:51.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:51.221 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:51.238 INFO:teuthology.orchestra.run.smithi134.stdout:5123 write 0xcd9a517 thru 0xcda13c4 (0x6eae bytes) 2024-09-21T22:17:51.239 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:51.239 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:51.240 INFO:teuthology.orchestra.run.smithi134.stdout:5124 punch from 0xb3b467e to 0xb3b4c83, (0x605 bytes) 2024-09-21T22:17:51.241 INFO:teuthology.orchestra.run.smithi134.stdout:5125 read 0x28cc8b8 thru 0x28ce798 (0x1ee1 bytes) 2024-09-21T22:17:51.241 INFO:teuthology.orchestra.run.smithi134.stdout:5126 punch from 0x8252919 to 0x825cf28, (0xa60f bytes) 2024-09-21T22:17:51.241 INFO:teuthology.orchestra.run.smithi134.stdout:5127 writesame 0xb6d8637 thru 0xb6e09b7 data_size 0x1(0x8381 bytes) 2024-09-21T22:17:51.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:51.250 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:51.250 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:51.262 INFO:teuthology.orchestra.run.smithi134.stdout:5128 read 0x2eee3f thru 0x2f841f (0x95e1 bytes) 2024-09-21T22:17:51.263 INFO:teuthology.orchestra.run.smithi134.stdout:5130 writesame 0x48fcaa0 thru 0x490485f data_size 0x8(0x7dc0 bytes) 2024-09-21T22:17:51.265 INFO:teuthology.orchestra.run.smithi134.stdout:5131 write 0x36f8d76 thru 0x36fd53f (0x47ca bytes) 2024-09-21T22:17:51.266 INFO:teuthology.orchestra.run.smithi134.stdout:5133 punch from 0x78207ee to 0x782db70, (0xd382 bytes) 2024-09-21T22:17:51.267 INFO:teuthology.orchestra.run.smithi134.stdout:5135 read 0x4bab1eb thru 0x4bbaea7 (0xfcbd bytes) 2024-09-21T22:17:51.269 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:51.269 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:51.278 INFO:teuthology.orchestra.run.smithi134.stdout:5136 trunc from 0xcda13c5 to 0x3a7e976 2024-09-21T22:17:51.287 INFO:teuthology.orchestra.run.smithi134.stdout:5137 clone 32 order 19 su 8192 sc 10 2024-09-21T22:17:51.301 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:51.301 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:51.319 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:51.317+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:51.332 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:51.332 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:51.351 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:51.351 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:51.355 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:51.355 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:51.355 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:51.355 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:51.355 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:51.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:51.367 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:51.367 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:51.420 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:51.419+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:51.468 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:51.468 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 114.955173716, 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.469 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:17:51.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:17:51.474 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 110.552231413, 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.475 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:17:51.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:17:51.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:17:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 110.55216855800001, 2024-09-21T22:17:51.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:17:51.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:17:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:51.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.488 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4254057190000005, 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.489 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4253706279999996, 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.493 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4253561890000004, 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:17:51.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:17:51.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4253415300000007, 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:17:51.502 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:17:51.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.506 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4253284869999998, 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:17:51.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.511 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4253049979999997, 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4252918599999997, 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.516 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:17:51.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.520 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4252817249999996, 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:17:51.524 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4251812029999993, 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:17:51.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.529 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4251634099999997, 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:17:51.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:17:51.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:17:51.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4251428900000001, 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.534 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.535 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:17:51.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:17:51.537 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:17:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4251208890000004, 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:17:51.539 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:17:51.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:17:51.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:17:51.542 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.4171469610000003, 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.545 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:17:51.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:17:51.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.546 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.546 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.546 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:17:51.546 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:17:51.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:17:51.547 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178642 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3735552~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:17:51.548 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.3999393809999994, 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015880737999999998, 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178642 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.549 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.550 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:17:51.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.551 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.551 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.551 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066650+0000", 2024-09-21T22:17:51.551 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5300000000000003e-07 2024-09-21T22:17:51.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066654+0000", 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5709999999999999e-06 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.552 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066665+0000", 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0209e-05 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066671+0000", 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7120000000000003e-06 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080727+0000", 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014055896 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.553 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080811+0000", 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3710999999999999e-05 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082530+0000", 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017187859999999999 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.554 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.3997446510000007, 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.555 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:17:51.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:17:51.557 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.558 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.3996025539999994, 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.560 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.561 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:17:51.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.563 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.3992066689999998, 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:51.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:17:51.566 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:17:51.567 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:17:51.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.568 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:51.568 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:51.568 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:51.569 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:51.570 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:51.569+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:51.670 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:51.669+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:51.714 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:51.714 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:51.714 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:51.715 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:51.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:51.807 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:51.806+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:51.865 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:51.865 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:51.866 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:51.872 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:51.871+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:51.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:17:51.912 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T22:17:51.997 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:51.996+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:52.020 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64124 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1546240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.020 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618511806000001, 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02641723, 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64124 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:52.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399983+0000", 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399984+0000", 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399986+0000", 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399990+0000", 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0810000000000004e-06 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.399993+0000", 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.819e-06 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426291+0000", 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026298459999999999 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426337+0000", 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5952000000000003e-05 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426400+0000", 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3184999999999999e-05 2024-09-21T22:17:52.024 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64125 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1574912~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618466186999996, 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026574187999999999, 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.025 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64125 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400029+0000", 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.44e-07 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400032+0000", 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2730000000000001e-06 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400036+0000", 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8029999999999996e-06 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400039+0000", 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0429999999999999e-06 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426433+0000", 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026393658 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426496+0000", 2024-09-21T22:17:52.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2475000000000001e-05 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426603+0000", 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000107392 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:52.029 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618393454, 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:52.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:17:52.033 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618346576999997, 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.034 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.035 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:17:52.036 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:17:52.037 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618281836999998, 2024-09-21T22:17:52.038 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.039 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:17:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:17:52.041 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.042 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618245607999995, 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.043 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.045 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:17:52.046 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618151681000001, 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.047 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.048 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.049 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.050 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.051 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618127912999995, 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.053 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:17:52.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:17:52.055 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618063042000003, 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:17:52.056 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.057 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.060 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.618025419000006, 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:17:52.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:17:52.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617984625999995, 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.065 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:17:52.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617909165, 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.069 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:17:52.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:17:52.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617838792000001, 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.074 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:17:52.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:17:52.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617805117000003, 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.078 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:52.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:52.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.082 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617736364999999, 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:17:52.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:17:52.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.086 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617691969000006, 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617601020999999, 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.091 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.095 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617572496999998, 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:17:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:17:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.617540203000004, 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:17:52.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:17:52.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 76.61750207, 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:17:52.104 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.105 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:52.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:52.108 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:52.110 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:52.110 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:52.109+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:52.211 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:52.210+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:52.214 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:52.214 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:52.215 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:52.215 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:52.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:52.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:52.310+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:52.326 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:52.326 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:52.326 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:52.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:52.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:52.418+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:52.480 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:52.480 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 112.568544484, 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:17:52.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:17:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 112.565922411, 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.583217213000001, 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.533931362000001, 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:52.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160313 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5550080~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.945025+0000", 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.533703798000001, 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057262691999999997, 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160313 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945025+0000", 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945025+0000", 2024-09-21T22:17:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945184+0000", 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015922700000000001 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945187+0000", 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1319999999999998e-06 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945196+0000", 2024-09-21T22:17:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1099999999999992e-06 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945203+0000", 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4710000000000004e-06 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002101+0000", 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056898689000000002 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002184+0000", 2024-09-21T22:17:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2876999999999999e-05 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002287+0000", 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103186 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160314 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5558272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.945213+0000", 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.533515860000001, 2024-09-21T22:17:52.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057247944000000002, 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160314 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945213+0000", 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.945213+0000", 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946778+0000", 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001564988 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946783+0000", 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2780000000000001e-06 2024-09-21T22:17:52.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946793+0000", 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0645999999999999e-05 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946801+0000", 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4730000000000003e-06 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002310+0000", 2024-09-21T22:17:52.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055509428 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002377+0000", 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6252000000000002e-05 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002461+0000", 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3879000000000001e-05 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160323 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5632000~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.531738682, 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057265854999999997, 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160323 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.510 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946990+0000", 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946992+0000", 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-06 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.946998+0000", 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3230000000000003e-06 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947004+0000", 2024-09-21T22:17:52.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004016+0000", 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057012459000000001 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004166+0000", 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150221 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004256+0000", 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9315999999999997e-05 2024-09-21T22:17:52.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160324 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5640192~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.531718695999999, 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057423746999999997, 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160324 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947027+0000", 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6820000000000002e-05 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947029+0000", 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3489999999999999e-06 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947035+0000", 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947041+0000", 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3750000000000002e-06 2024-09-21T22:17:52.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004283+0000", 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057242800000000003 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9294000000000004e-05 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004433+0000", 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0737999999999998e-05 2024-09-21T22:17:52.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.531680672, 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.518 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.531578521, 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:17:52.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:17:52.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.527758245000001, 2024-09-21T22:17:52.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.527738107000001, 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:52.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:17:52.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.527717589000002, 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:17:52.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160854 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5715968~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978918+0000", 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.499810105000002, 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057390573, 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160854 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978918+0000", 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978918+0000", 2024-09-21T22:17:52.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978919+0000", 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978921+0000", 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8190000000000001e-06 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978927+0000", 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3330000000000002e-06 2024-09-21T22:17:52.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978932+0000", 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8539999999999996e-06 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036115+0000", 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057182877 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036211+0000", 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6225999999999997e-05 2024-09-21T22:17:52.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036309+0000", 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8072999999999994e-05 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.499791044999998, 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:17:52.543 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:52.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.499771474999999, 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:17:52.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:17:52.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.499752883999999, 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.552 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:52.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.499733204000002, 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:52.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.499704844, 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:52.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:17:52.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.499683302000001, 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:17:52.565 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:17:52.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:17:52.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.569 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:52.571 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:52.570+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:52.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:52.672 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:52.671+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:52.714 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:52.714 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:52.714 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:52.714 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:52.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:52.773 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:52.772+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:52.825 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:52.825 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:52.825 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:52.825 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:52.826 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:52.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:52.877 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:52.876+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:52.900 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T22:17:52.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.035283235000001, 2024-09-21T22:17:52.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:52.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.035264718000001, 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:17:52.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:17:52.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.035092131999999, 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.973 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.977 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.03507029, 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:17:52.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.035049752999999, 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.035025224000002, 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:17:52.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.034175365999999, 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:17:52.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:17:52.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.034148979000001, 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:52.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:52.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:52.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:52.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.034126412999999, 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:53.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:17:53.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:17:53.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.034104703000001, 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:53.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.034083562999999, 2024-09-21T22:17:53.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.012 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.034061688000001, 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:53.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.032446400000001, 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:17:53.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:17:53.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:17:53.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.032426621999999, 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:17:53.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:17:53.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.032407143, 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:17:53.025 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:17:53.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.032388741999998, 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:17:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.032356343, 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.034 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:53.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.038 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.032336204, 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:53.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160176 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.028270439, 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074083248000000004, 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160176 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933867+0000", 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933869+0000", 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1210000000000001e-06 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933874+0000", 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933879+0000", 2024-09-21T22:17:53.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4830000000000001e-06 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007941+0000", 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074061907999999996 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007950+0000", 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7329999999999992e-06 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160177 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.028252423000001, 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074112131999999997, 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160177 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:53.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933885+0000", 2024-09-21T22:17:53.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:17:53.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:53.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933887+0000", 2024-09-21T22:17:53.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:17:53.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:53.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933892+0000", 2024-09-21T22:17:53.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2024-09-21T22:17:53.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:53.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933896+0000", 2024-09-21T22:17:53.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4209999999999997e-06 2024-09-21T22:17:53.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:53.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007986+0000", 2024-09-21T22:17:53.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074089981999999999 2024-09-21T22:17:53.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:53.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:53.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:53.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007996+0000", 2024-09-21T22:17:53.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:17:53.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:53.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:53.053 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:53.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:53.056 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:53.053+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:53.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:17:53.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:53.154+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:53.255 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:53.254+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:53.273 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:53.273 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:53.273 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:53.273 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:53.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:53.357 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:53.356+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:53.379 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:53.458 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:53.456+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:53.517 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:53.517 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:53.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:53.558 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:53.557+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:53.590 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:53.590 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:53.608 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:53.608 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:53.626 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:53.642 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:53.643 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:53.659 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:53.658+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:53.659 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:53.659 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:53.676 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:53.677 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:53.681 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:53.681 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:53.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:53.694 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:53.694 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:53.710 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:53.711 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:53.763 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:53.762+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:53.797 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:53.797 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:53.805 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:53.889 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:53.888+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:53.948 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:53.948 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:53.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:53.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:53.997+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:54.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:54.061+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:54.086 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:17:54.091 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:17:54.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:17:54.107 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.108 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:54.156 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-21T22:17:54.197 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:54.196+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:54.227 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.227 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:54.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:54.263+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:54.338 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.339 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.347 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:54.384 INFO:teuthology.orchestra.run.smithi134.stdout:5138 punch from 0x3522024 to 0x3530622, (0xe5fe bytes) 2024-09-21T22:17:54.390 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:54.389+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:54.402 INFO:teuthology.orchestra.run.smithi134.stdout:5139 write 0xaf14cfd thru 0xaf21c65 (0xcf69 bytes) 2024-09-21T22:17:54.410 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:54.410 INFO:teuthology.orchestra.run.smithi134.stdout:5141 read 0x9079318 thru 0x907d038 (0x3d21 bytes) 2024-09-21T22:17:54.410 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:54.410 INFO:teuthology.orchestra.run.smithi134.stdout:5144 read 0x58949f8 thru 0x58a3368 (0xe971 bytes) 2024-09-21T22:17:54.410 INFO:teuthology.orchestra.run.smithi134.stdout:5145 read 0x380e251 thru 0x3819a11 (0xb7c1 bytes) 2024-09-21T22:17:54.412 INFO:teuthology.orchestra.run.smithi134.stdout:5147 write 0x33d7497 thru 0x33e43ec (0xcf56 bytes) 2024-09-21T22:17:54.415 INFO:teuthology.orchestra.run.smithi134.stdout:5148 read 0x766f828 thru 0x7670374 (0xb4d bytes) 2024-09-21T22:17:54.415 INFO:teuthology.orchestra.run.smithi134.stdout:5149 write 0x6c53c34 thru 0x6c61d4a (0xe117 bytes) 2024-09-21T22:17:54.425 INFO:teuthology.orchestra.run.smithi134.stdout:5150 read 0x9b4ddef thru 0x9b5a707 (0xc919 bytes) 2024-09-21T22:17:54.425 INFO:teuthology.orchestra.run.smithi134.stdout:5151 punch from 0xf912ab to 0xf9185b, (0x5b0 bytes) 2024-09-21T22:17:54.425 INFO:teuthology.orchestra.run.smithi134.stdout:5152 write 0x9388a62 thru 0x938a149 (0x16e8 bytes) 2024-09-21T22:17:54.438 INFO:teuthology.orchestra.run.smithi134.stdout:5153 write 0xddbab67 thru 0xddc9ea6 (0xf340 bytes) 2024-09-21T22:17:54.448 INFO:teuthology.orchestra.run.smithi134.stdout:5154 punch from 0xc1bcf57 to 0xc1c75bd, (0xa666 bytes) 2024-09-21T22:17:54.448 INFO:teuthology.orchestra.run.smithi134.stdout:5156 writesame 0x636430 thru 0x63f947 data_size 0x34(0x9518 bytes) 2024-09-21T22:17:54.450 INFO:teuthology.orchestra.run.smithi134.stdout:5158 write 0x12f95ee thru 0x13030ff (0x9b12 bytes) 2024-09-21T22:17:54.455 INFO:teuthology.orchestra.run.smithi134.stdout:5160 read 0xb9503a2 thru 0xb953112 (0x2d71 bytes) 2024-09-21T22:17:54.459 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.460 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.465 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:54.464+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:54.467 INFO:teuthology.orchestra.run.smithi134.stdout:5161 trunc from 0xddc9ea7 to 0x3854825 2024-09-21T22:17:54.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:54.484 INFO:teuthology.orchestra.run.smithi134.stdout:5163 read 0x3152b71 thru 0x3156193 (0x3623 bytes) 2024-09-21T22:17:54.496 INFO:teuthology.orchestra.run.smithi134.stdout:5165 write 0x8f45bbb thru 0x8f4ea1c (0x8e62 bytes) 2024-09-21T22:17:54.503 INFO:teuthology.orchestra.run.smithi134.stdout:5167 read 0x1b6b6ee thru 0x1b6f4a4 (0x3db7 bytes) 2024-09-21T22:17:54.503 INFO:teuthology.orchestra.run.smithi134.stdout:5168 write 0x8b7d605 thru 0x8b89790 (0xc18c bytes) 2024-09-21T22:17:54.512 INFO:teuthology.orchestra.run.smithi134.stdout:5169 write 0x23dc71f thru 0x23e62cd (0x9baf bytes) 2024-09-21T22:17:54.515 INFO:teuthology.orchestra.run.smithi134.stdout:5170 write 0x159776b thru 0x15a4c2e (0xd4c4 bytes) 2024-09-21T22:17:54.518 INFO:teuthology.orchestra.run.smithi134.stdout:5172 writesame 0x470a920 thru 0x470ac5c data_size 0x1(0x33d bytes) 2024-09-21T22:17:54.520 INFO:teuthology.orchestra.run.smithi134.stdout:5173 read 0x2593a65 thru 0x2597fa8 (0x4544 bytes) 2024-09-21T22:17:54.521 INFO:teuthology.orchestra.run.smithi134.stdout:5174 punch from 0x48d499d to 0x48e1f46, (0xd5a9 bytes) 2024-09-21T22:17:54.521 INFO:teuthology.orchestra.run.smithi134.stdout:5175 writesame 0x8d3e817 thru 0x8d4155e data_size 0x54(0x2d48 bytes) 2024-09-21T22:17:54.522 INFO:teuthology.orchestra.run.smithi134.stdout:5176 punch from 0x7e5fae0 to 0x7e6951d, (0x9a3d bytes) 2024-09-21T22:17:54.523 INFO:teuthology.orchestra.run.smithi134.stdout:5177 punch from 0x72284c2 to 0x7237e68, (0xf9a6 bytes) 2024-09-21T22:17:54.535 INFO:teuthology.orchestra.run.smithi134.stdout:5178 writesame 0xd8a5715 thru 0xd8b5036 data_size 0x1a(0xf922 bytes) 2024-09-21T22:17:54.535 INFO:teuthology.orchestra.run.smithi134.stdout:5179 punch from 0xc737ac to 0xc7e6c8, (0xaf1c bytes) 2024-09-21T22:17:54.535 INFO:teuthology.orchestra.run.smithi134.stdout:5180 write 0xacd137f thru 0xacdb49b (0xa11d bytes) 2024-09-21T22:17:54.541 INFO:teuthology.orchestra.run.smithi134.stdout:5182 read 0x392a498 thru 0x3936a9b (0xc604 bytes) 2024-09-21T22:17:54.541 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:54.541 INFO:teuthology.orchestra.run.smithi134.stdout:5185 clone 33 order 25 su 4194304 sc 7 2024-09-21T22:17:54.566 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:54.565+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:54.615 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.615 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:54.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:54.665+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:54.727 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.727 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:54.767 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:54.766+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:54.838 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.838 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.846 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:54.891 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:54.889+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:54.952 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:54.952 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:54.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:55.002 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:55.000+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:55.069 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:55.068+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:55.087 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:17:55.103 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:17:55.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:17:55.107 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:55.107 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:55.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:55.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:55.186+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:55.221 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:55.221 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:55.230 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:55.273 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:55.272+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:55.334 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:55.334 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:55.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:55.371 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:55.370+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:55.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:55.420 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:17:55.432 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-09-21T22:17:55.198572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1310787012,"num_objects":1160,"num_object_clones":0,"num_object_copies":2320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1160,"num_whiteouts":0,"num_read":196143,"num_read_kb":1103925,"num_write":22504,"num_write_kb":791902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1301,"num_bytes_recovered":151696477,"num_keys_recovered":223,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16263,"ondisk_log_size":16263,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1170148,"kb_used_data":764084,"kb_used_omap":15,"kb_used_meta":405872,"kb_avail":753804572,"statfs":{"total":773094113280,"available":771895881728,"internally_reserved":0,"allocated":782422016,"data_stored":771725639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":415613724},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":67948158,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":10210,"num_read_kb":71967,"num_write":672,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000690"},"pg_stats":[{"pgid":"3.1f","version":"154'1139","reported_seq":27114,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093793+0000","last_change":"2024-09-21T22:17:54.093793+0000","last_active":"2024-09-21T22:17:54.093793+0000","last_peered":"2024-09-21T22:17:54.093793+0000","last_clean":"2024-09-21T22:17:54.093793+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:17:54.093793+0000","last_undegraded":"2024-09-21T22:17:54.093793+0000","last_fullsized":"2024-09-21T22:17:54.093793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1139,"log_dups_size":0,"ondisk_log_size":1139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:22:12.011562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056296700000000005,"stat_sum":{"num_bytes":63842296,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":29627,"num_read_kb":65995,"num_write":1993,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1e","version":"153'648","reported_seq":3931,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.096550+0000","last_change":"2024-09-21T22:17:50.070185+0000","last_active":"2024-09-21T22:17:53.096550+0000","last_peered":"2024-09-21T22:17:53.096550+0000","last_clean":"2024-09-21T22:17:53.096550+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:17:53.096550+0000","last_undegraded":"2024-09-21T22:17:53.096550+0000","last_fullsized":"2024-09-21T22:17:53.096550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:30:24.962104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077374599999999996,"stat_sum":{"num_bytes":33205150,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5023,"num_read_kb":32498,"num_write":829,"num_write_kb":20984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.1d","version":"154'341","reported_seq":8052,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.144100+0000","last_change":"2024-09-21T22:17:54.144100+0000","last_active":"2024-09-21T22:17:54.144100+0000","last_peered":"2024-09-21T22:17:54.144100+0000","last_clean":"2024-09-21T22:17:54.144100+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:17:54.144100+0000","last_undegraded":"2024-09-21T22:17:54.144100+0000","last_fullsized":"2024-09-21T22:17:54.144100+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:03:48.467744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059181200000000005,"stat_sum":{"num_bytes":64590570,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":7376,"num_read_kb":54616,"num_write":431,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1c","version":"154'676","reported_seq":2388,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.208993+0000","last_change":"2024-09-21T22:17:54.143951+0000","last_active":"2024-09-21T22:17:54.208993+0000","last_peered":"2024-09-21T22:17:54.208993+0000","last_clean":"2024-09-21T22:17:54.208993+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:17:54.208993+0000","last_undegraded":"2024-09-21T22:17:54.208993+0000","last_fullsized":"2024-09-21T22:17:54.208993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:59.155203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051584799999999996,"stat_sum":{"num_bytes":48978544,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2853,"num_read_kb":31771,"num_write":1109,"num_write_kb":32231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1b","version":"153'387","reported_seq":10434,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093807+0000","last_change":"2024-09-21T22:17:54.094011+0000","last_active":"2024-09-21T22:17:54.093807+0000","last_peered":"2024-09-21T22:17:54.093807+0000","last_clean":"2024-09-21T22:17:54.093807+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:17:54.093807+0000","last_undegraded":"2024-09-21T22:17:54.093807+0000","last_fullsized":"2024-09-21T22:17:54.093807+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:09:51.217024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065147999999999996,"stat_sum":{"num_bytes":32287869,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10334,"num_read_kb":32402,"num_write":431,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1a","version":"153'266","reported_seq":2391,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.153906+0000","last_change":"2024-09-21T22:17:54.144210+0000","last_active":"2024-09-21T22:17:54.153906+0000","last_peered":"2024-09-21T22:17:54.153906+0000","last_clean":"2024-09-21T22:17:54.153906+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:17:54.153906+0000","last_undegraded":"2024-09-21T22:17:54.153906+0000","last_fullsized":"2024-09-21T22:17:54.153906+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:55.385599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067927700000000005,"stat_sum":{"num_bytes":12711132,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1978,"num_read_kb":13766,"num_write":347,"num_write_kb":16861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.19","version":"144'632","reported_seq":3304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068602+0000","last_change":"2024-09-21T22:17:50.068780+0000","last_active":"2024-09-21T22:17:50.068602+0000","last_peered":"2024-09-21T22:17:50.068602+0000","last_clean":"2024-09-21T22:17:50.068602+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:17:50.068602+0000","last_undegraded":"2024-09-21T22:17:50.068602+0000","last_fullsized":"2024-09-21T22:17:50.068602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:19.739968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060667999999999996,"stat_sum":{"num_bytes":17932970,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4983,"num_read_kb":22221,"num_write":726,"num_write_kb":20214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.18","version":"144'659","reported_seq":1915,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:52.899257+0000","last_change":"2024-09-21T22:17:50.069616+0000","last_active":"2024-09-21T22:17:52.899257+0000","last_peered":"2024-09-21T22:17:52.899257+0000","last_clean":"2024-09-21T22:17:52.899257+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:17:52.899257+0000","last_undegraded":"2024-09-21T22:17:52.899257+0000","last_fullsized":"2024-09-21T22:17:52.899257+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:37:31.115181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062237800000000004,"stat_sum":{"num_bytes":22225923,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2837,"num_read_kb":21755,"num_write":863,"num_write_kb":26232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.17","version":"153'823","reported_seq":3265,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093914+0000","last_change":"2024-09-21T22:17:54.094158+0000","last_active":"2024-09-21T22:17:54.093914+0000","last_peered":"2024-09-21T22:17:54.093914+0000","last_clean":"2024-09-21T22:17:54.093914+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:17:54.093914+0000","last_undegraded":"2024-09-21T22:17:54.093914+0000","last_fullsized":"2024-09-21T22:17:54.093914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:28:04.134855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065797800000000004,"stat_sum":{"num_bytes":23977185,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4976,"num_read_kb":30259,"num_write":1437,"num_write_kb":23933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.16","version":"147'231","reported_seq":13992,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068665+0000","last_change":"2024-09-21T22:17:50.068860+0000","last_active":"2024-09-21T22:17:50.068665+0000","last_peered":"2024-09-21T22:17:50.068665+0000","last_clean":"2024-09-21T22:17:50.068665+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:17:50.068665+0000","last_undegraded":"2024-09-21T22:17:50.068665+0000","last_fullsized":"2024-09-21T22:17:50.068665+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:11:40.018246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061567200000000005,"stat_sum":{"num_bytes":69494207,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14149,"num_read_kb":47844,"num_write":319,"num_write_kb":23357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.15","version":"154'718","reported_seq":3186,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.409216+0000","last_change":"2024-09-21T22:17:54.088492+0000","last_active":"2024-09-21T22:17:54.409216+0000","last_peered":"2024-09-21T22:17:54.409216+0000","last_clean":"2024-09-21T22:17:54.409216+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:17:54.409216+0000","last_undegraded":"2024-09-21T22:17:54.409216+0000","last_fullsized":"2024-09-21T22:17:54.409216+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:29:23.312628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040651100000000003,"stat_sum":{"num_bytes":53362261,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":4154,"num_read_kb":35929,"num_write":1072,"num_write_kb":33804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.14","version":"154'878","reported_seq":4553,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.144499+0000","last_change":"2024-09-21T22:17:54.144499+0000","last_active":"2024-09-21T22:17:54.144499+0000","last_peered":"2024-09-21T22:17:54.144499+0000","last_clean":"2024-09-21T22:17:54.144499+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:17:54.144499+0000","last_undegraded":"2024-09-21T22:17:54.144499+0000","last_fullsized":"2024-09-21T22:17:54.144499+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":878,"log_dups_size":0,"ondisk_log_size":878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:52.196801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083965400000000001,"stat_sum":{"num_bytes":59753252,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":5742,"num_read_kb":39440,"num_write":1357,"num_write_kb":26527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":282,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.149309+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:17:54.149309+0000","last_peered":"2024-09-21T22:17:54.149309+0000","last_clean":"2024-09-21T22:17:54.149309+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:17:54.149309+0000","last_undegraded":"2024-09-21T22:17:54.149309+0000","last_fullsized":"2024-09-21T22:17:54.149309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"154'343","reported_seq":3583,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.409810+0000","last_change":"2024-09-21T22:17:54.094542+0000","last_active":"2024-09-21T22:17:54.409810+0000","last_peered":"2024-09-21T22:17:54.409810+0000","last_clean":"2024-09-21T22:17:54.409810+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:17:54.409810+0000","last_undegraded":"2024-09-21T22:17:54.409810+0000","last_fullsized":"2024-09-21T22:17:54.409810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:10:32.774396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062129500000000001,"stat_sum":{"num_bytes":42428516,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":3549,"num_read_kb":40098,"num_write":369,"num_write_kb":25418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068460+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:17:50.068460+0000","last_peered":"2024-09-21T22:17:50.068460+0000","last_clean":"2024-09-21T22:17:50.068460+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:17:50.068460+0000","last_undegraded":"2024-09-21T22:17:50.068460+0000","last_fullsized":"2024-09-21T22:17:50.068460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'392","reported_seq":10689,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.462260+0000","last_change":"2024-09-21T22:17:50.070554+0000","last_active":"2024-09-21T22:17:53.462260+0000","last_peered":"2024-09-21T22:17:53.462260+0000","last_clean":"2024-09-21T22:17:53.462260+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:17:53.462260+0000","last_undegraded":"2024-09-21T22:17:53.462260+0000","last_fullsized":"2024-09-21T22:17:53.462260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:35:10.215873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001045065,"stat_sum":{"num_bytes":40864753,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":10619,"num_read_kb":35216,"num_write":532,"num_write_kb":21891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.088047+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:17:54.088047+0000","last_peered":"2024-09-21T22:17:54.088047+0000","last_clean":"2024-09-21T22:17:54.088047+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:17:54.088047+0000","last_undegraded":"2024-09-21T22:17:54.088047+0000","last_fullsized":"2024-09-21T22:17:54.088047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"144'404","reported_seq":9465,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068878+0000","last_change":"2024-09-21T22:17:50.069068+0000","last_active":"2024-09-21T22:17:50.068878+0000","last_peered":"2024-09-21T22:17:50.068878+0000","last_clean":"2024-09-21T22:17:50.068878+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:17:50.068878+0000","last_undegraded":"2024-09-21T22:17:50.068878+0000","last_fullsized":"2024-09-21T22:17:50.068878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:57.244754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081586799999999998,"stat_sum":{"num_bytes":42365665,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":9169,"num_read_kb":53637,"num_write":469,"num_write_kb":26529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068376+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:17:50.068376+0000","last_peered":"2024-09-21T22:17:50.068376+0000","last_clean":"2024-09-21T22:17:50.068376+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:17:50.068376+0000","last_undegraded":"2024-09-21T22:17:50.068376+0000","last_fullsized":"2024-09-21T22:17:50.068376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'400","reported_seq":13922,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.553218+0000","last_change":"2024-09-21T22:17:50.069719+0000","last_active":"2024-09-21T22:17:53.553218+0000","last_peered":"2024-09-21T22:17:53.553218+0000","last_clean":"2024-09-21T22:17:53.553218+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:17:53.553218+0000","last_undegraded":"2024-09-21T22:17:53.553218+0000","last_fullsized":"2024-09-21T22:17:53.553218+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:34:53.420606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054951800000000003,"stat_sum":{"num_bytes":72593503,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":13751,"num_read_kb":54172,"num_write":483,"num_write_kb":24148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.3","version":"154'462","reported_seq":3393,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.406539+0000","last_change":"2024-09-21T22:17:54.144740+0000","last_active":"2024-09-21T22:17:54.406539+0000","last_peered":"2024-09-21T22:17:54.406539+0000","last_clean":"2024-09-21T22:17:54.406539+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:17:54.406539+0000","last_undegraded":"2024-09-21T22:17:54.406539+0000","last_fullsized":"2024-09-21T22:17:54.406539+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:28:51.658139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010554900000000001,"stat_sum":{"num_bytes":45911731,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3804,"num_read_kb":36491,"num_write":520,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068062+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:17:50.068062+0000","last_peered":"2024-09-21T22:17:50.068062+0000","last_clean":"2024-09-21T22:17:50.068062+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:17:50.068062+0000","last_undegraded":"2024-09-21T22:17:50.068062+0000","last_fullsized":"2024-09-21T22:17:50.068062+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"149'560","reported_seq":16848,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068331+0000","last_change":"2024-09-21T22:17:50.068547+0000","last_active":"2024-09-21T22:17:50.068331+0000","last_peered":"2024-09-21T22:17:50.068331+0000","last_clean":"2024-09-21T22:17:50.068331+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:17:50.068331+0000","last_undegraded":"2024-09-21T22:17:50.068331+0000","last_fullsized":"2024-09-21T22:17:50.068331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:17:35.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049006099999999997,"stat_sum":{"num_bytes":82107117,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":16868,"num_read_kb":57575,"num_write":727,"num_write_kb":29824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":279,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T22:17:49.058589+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:17:49.058589+0000","last_peered":"2024-09-21T22:17:49.058589+0000","last_clean":"2024-09-21T22:17:49.058589+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:17:49.058589+0000","last_undegraded":"2024-09-21T22:17:49.058589+0000","last_fullsized":"2024-09-21T22:17:49.058589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"153'369","reported_seq":2167,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093506+0000","last_change":"2024-09-21T22:17:54.093723+0000","last_active":"2024-09-21T22:17:54.093506+0000","last_peered":"2024-09-21T22:17:54.093506+0000","last_clean":"2024-09-21T22:17:54.093506+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:17:54.093506+0000","last_undegraded":"2024-09-21T22:17:54.093506+0000","last_fullsized":"2024-09-21T22:17:54.093506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:22:11.205371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036805099999999999,"stat_sum":{"num_bytes":38045118,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1413,"num_read_kb":26353,"num_write":526,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":284,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.087876+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:17:54.087876+0000","last_peered":"2024-09-21T22:17:54.087876+0000","last_clean":"2024-09-21T22:17:54.087876+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:17:54.087876+0000","last_undegraded":"2024-09-21T22:17:54.087876+0000","last_fullsized":"2024-09-21T22:17:54.087876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"153'338","reported_seq":1308,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.301892+0000","last_change":"2024-09-21T22:17:50.069919+0000","last_active":"2024-09-21T22:17:53.301892+0000","last_peered":"2024-09-21T22:17:53.301892+0000","last_clean":"2024-09-21T22:17:53.301892+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:17:53.301892+0000","last_undegraded":"2024-09-21T22:17:53.301892+0000","last_fullsized":"2024-09-21T22:17:53.301892+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:11:43.335543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074480300000000004,"stat_sum":{"num_bytes":26228965,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":1092,"num_read_kb":31312,"num_write":441,"num_write_kb":28317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":111,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T22:17:49.058472+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:17:49.058472+0000","last_peered":"2024-09-21T22:17:49.058472+0000","last_clean":"2024-09-21T22:17:49.058472+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:17:49.058472+0000","last_undegraded":"2024-09-21T22:17:49.058472+0000","last_fullsized":"2024-09-21T22:17:49.058472+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":436,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.087911+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:17:54.087911+0000","last_peered":"2024-09-21T22:17:54.087911+0000","last_clean":"2024-09-21T22:17:54.087911+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:17:54.087911+0000","last_undegraded":"2024-09-21T22:17:54.087911+0000","last_fullsized":"2024-09-21T22:17:54.087911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"153'583","reported_seq":1765,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.219829+0000","last_change":"2024-09-21T22:17:50.069958+0000","last_active":"2024-09-21T22:17:53.219829+0000","last_peered":"2024-09-21T22:17:53.219829+0000","last_clean":"2024-09-21T22:17:53.219829+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:17:53.219829+0000","last_undegraded":"2024-09-21T22:17:53.219829+0000","last_fullsized":"2024-09-21T22:17:53.219829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:45:23.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073035500000000002,"stat_sum":{"num_bytes":25084645,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2313,"num_read_kb":18357,"num_write":897,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.9","version":"153'373","reported_seq":3607,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.143859+0000","last_change":"2024-09-21T22:17:54.143859+0000","last_active":"2024-09-21T22:17:54.143859+0000","last_peered":"2024-09-21T22:17:54.143859+0000","last_clean":"2024-09-21T22:17:54.143859+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:17:54.143859+0000","last_undegraded":"2024-09-21T22:17:54.143859+0000","last_fullsized":"2024-09-21T22:17:54.143859+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:30.725755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050768299999999998,"stat_sum":{"num_bytes":78101738,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":3668,"num_read_kb":47267,"num_write":499,"num_write_kb":25542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.a","version":"154'401","reported_seq":2505,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.149996+0000","last_change":"2024-09-21T22:17:54.149996+0000","last_active":"2024-09-21T22:17:54.149996+0000","last_peered":"2024-09-21T22:17:54.149996+0000","last_clean":"2024-09-21T22:17:54.149996+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:17:54.149996+0000","last_undegraded":"2024-09-21T22:17:54.149996+0000","last_fullsized":"2024-09-21T22:17:54.149996+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:01.681304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068227299999999995,"stat_sum":{"num_bytes":41243959,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2616,"num_read_kb":26768,"num_write":432,"num_write_kb":19429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.b","version":"153'713","reported_seq":2250,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.537471+0000","last_change":"2024-09-21T22:17:50.070149+0000","last_active":"2024-09-21T22:17:53.537471+0000","last_peered":"2024-09-21T22:17:53.537471+0000","last_clean":"2024-09-21T22:17:53.537471+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:17:53.537471+0000","last_undegraded":"2024-09-21T22:17:53.537471+0000","last_fullsized":"2024-09-21T22:17:53.537471+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:59:19.449686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089382399999999999,"stat_sum":{"num_bytes":20930127,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4293,"num_read_kb":25948,"num_write":978,"num_write_kb":22445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.c","version":"153'325","reported_seq":1438,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.587395+0000","last_change":"2024-09-21T22:17:50.070465+0000","last_active":"2024-09-21T22:17:53.587395+0000","last_peered":"2024-09-21T22:17:53.587395+0000","last_clean":"2024-09-21T22:17:53.587395+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:17:53.587395+0000","last_undegraded":"2024-09-21T22:17:53.587395+0000","last_fullsized":"2024-09-21T22:17:53.587395+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:14.038565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010516569999999999,"stat_sum":{"num_bytes":50113436,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1335,"num_read_kb":30411,"num_write":459,"num_write_kb":22843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.d","version":"153'419","reported_seq":1510,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.149670+0000","last_change":"2024-09-21T22:17:54.149670+0000","last_active":"2024-09-21T22:17:54.149670+0000","last_peered":"2024-09-21T22:17:54.149670+0000","last_clean":"2024-09-21T22:17:54.149670+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:17:54.149670+0000","last_undegraded":"2024-09-21T22:17:54.149670+0000","last_fullsized":"2024-09-21T22:17:54.149670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:38:02.590131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038819000000000001,"stat_sum":{"num_bytes":15605836,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1611,"num_read_kb":21418,"num_write":615,"num_write_kb":19906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.e","version":"153'274","reported_seq":1287,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.088796+0000","last_change":"2024-09-21T22:17:54.088796+0000","last_active":"2024-09-21T22:17:54.088796+0000","last_peered":"2024-09-21T22:17:54.088796+0000","last_clean":"2024-09-21T22:17:54.088796+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:17:54.088796+0000","last_undegraded":"2024-09-21T22:17:54.088796+0000","last_fullsized":"2024-09-21T22:17:54.088796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:03:01.341977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061204300000000005,"stat_sum":{"num_bytes":14863940,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":565,"num_read_kb":18334,"num_write":338,"num_write_kb":22475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.f","version":"154'482","reported_seq":2138,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.414418+0000","last_change":"2024-09-21T22:17:54.089056+0000","last_active":"2024-09-21T22:17:54.414418+0000","last_peered":"2024-09-21T22:17:54.414418+0000","last_clean":"2024-09-21T22:17:54.414418+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:17:54.414418+0000","last_undegraded":"2024-09-21T22:17:54.414418+0000","last_fullsized":"2024-09-21T22:17:54.414418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:50:15.615727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000810368,"stat_sum":{"num_bytes":21494383,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2274,"num_read_kb":18251,"num_write":597,"num_write_kb":19718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.10","version":"154'273","reported_seq":2090,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.410520+0000","last_change":"2024-09-21T22:17:54.149930+0000","last_active":"2024-09-21T22:17:54.410520+0000","last_peered":"2024-09-21T22:17:54.410520+0000","last_clean":"2024-09-21T22:17:54.410520+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:17:54.410520+0000","last_undegraded":"2024-09-21T22:17:54.410520+0000","last_fullsized":"2024-09-21T22:17:54.410520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:20:25.814688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064085499999999996,"stat_sum":{"num_bytes":42732429,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1437,"num_read_kb":28569,"num_write":307,"num_write_kb":23951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.11","version":"144'598","reported_seq":1824,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068392+0000","last_change":"2024-09-21T22:17:50.068598+0000","last_active":"2024-09-21T22:17:50.068392+0000","last_peered":"2024-09-21T22:17:50.068392+0000","last_clean":"2024-09-21T22:17:50.068392+0000","last_became_active":"2024-09-21T22:17:14.901471+0000","last_became_peered":"2024-09-21T22:17:14.901471+0000","last_unstale":"2024-09-21T22:17:50.068392+0000","last_undegraded":"2024-09-21T22:17:50.068392+0000","last_fullsized":"2024-09-21T22:17:50.068392+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:38.832768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051992200000000003,"stat_sum":{"num_bytes":15820849,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2651,"num_read_kb":21132,"num_write":905,"num_write_kb":19512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":16112633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.12","version":"154'428","reported_seq":6484,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.401430+0000","last_change":"2024-09-21T22:17:54.088489+0000","last_active":"2024-09-21T22:17:54.401430+0000","last_peered":"2024-09-21T22:17:54.401430+0000","last_clean":"2024-09-21T22:17:54.401430+0000","last_became_active":"2024-09-21T22:17:37.898981+0000","last_became_peered":"2024-09-21T22:17:37.898981+0000","last_unstale":"2024-09-21T22:17:54.401430+0000","last_undegraded":"2024-09-21T22:17:54.401430+0000","last_fullsized":"2024-09-21T22:17:54.401430+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:08:46.195930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037367500000000002,"stat_sum":{"num_bytes":27003723,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":6593,"num_read_kb":24000,"num_write":545,"num_write_kb":18908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.13","version":"153'608","reported_seq":12110,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.088773+0000","last_change":"2024-09-21T22:17:54.088773+0000","last_active":"2024-09-21T22:17:54.088773+0000","last_peered":"2024-09-21T22:17:54.088773+0000","last_clean":"2024-09-21T22:17:54.088773+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:17:54.088773+0000","last_undegraded":"2024-09-21T22:17:54.088773+0000","last_fullsized":"2024-09-21T22:17:54.088773+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:44.687112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068547699999999998,"stat_sum":{"num_bytes":64294833,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":12374,"num_read_kb":60020,"num_write":790,"num_write_kb":28395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1310196625,"num_objects":1156,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":196027,"num_read_kb":1103825,"num_write":22343,"num_write_kb":789484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1301,"num_bytes_recovered":151696477,"num_keys_recovered":223,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":774144000,"data_stored":770969773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16143,"ondisk_log_size":16143,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139440,"kb_used_data":90200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94232400,"statfs":{"total":96636764160,"available":96493977600,"internally_reserved":0,"allocated":92364800,"data_stored":91053687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78492,"kb_used_data":43140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94293348,"statfs":{"total":96636764160,"available":96556388352,"internally_reserved":0,"allocated":44175360,"data_stored":43032689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162032,"kb_used_data":98912,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94209808,"statfs":{"total":96636764160,"available":96470843392,"internally_reserved":0,"allocated":101285888,"data_stored":99906681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195860,"kb_used_data":138300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94175980,"statfs":{"total":96636764160,"available":96436203520,"internally_reserved":0,"allocated":141619200,"data_stored":140098426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528344,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173024,"kb_used_data":122700,"kb_used_omap":4,"kb_used_meta":50299,"kb_avail":94198816,"statfs":{"total":96636764160,"available":96459587584,"internally_reserved":0,"allocated":125644800,"data_stored":124170393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":51506866},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84240,"kb_used_data":48888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287600,"statfs":{"total":96636764160,"available":96550502400,"internally_reserved":0,"allocated":50061312,"data_stored":48900664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138480,"kb_used_data":94804,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94233360,"statfs":{"total":96636764160,"available":96494960640,"internally_reserved":0,"allocated":97079296,"data_stored":95746903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198580,"kb_used_data":127140,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94173260,"statfs":{"total":96636764160,"available":96433418240,"internally_reserved":0,"allocated":130191360,"data_stored":128816196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":130306048,"data_stored":129874995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":95285248,"data_stored":94877700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48271360,"data_stored":48031480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":123805696,"data_stored":123276095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":139804672,"data_stored":139225379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":99823616,"data_stored":99397384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":42344448,"data_stored":42146583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94502912,"data_stored":94140157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:17:55.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:17:55.472 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:55.470+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:55.486 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:55.487 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:55.495 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:55.572 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:55.571+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:55.639 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:55.639 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:55.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:55.692 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:55.691+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:55.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:17:55.753 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:17:55.753 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:17:55.754 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:55.754 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:55.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:55.766 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-09-21T22:17:55.198572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1310787012,"num_objects":1160,"num_object_clones":0,"num_object_copies":2320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1160,"num_whiteouts":0,"num_read":196143,"num_read_kb":1103925,"num_write":22504,"num_write_kb":791902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1301,"num_bytes_recovered":151696477,"num_keys_recovered":223,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16263,"ondisk_log_size":16263,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1170148,"kb_used_data":764084,"kb_used_omap":15,"kb_used_meta":405872,"kb_avail":753804572,"statfs":{"total":773094113280,"available":771895881728,"internally_reserved":0,"allocated":782422016,"data_stored":771725639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":415613724},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":67948158,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":10210,"num_read_kb":71967,"num_write":672,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000690"},"pg_stats":[{"pgid":"3.1f","version":"154'1139","reported_seq":27114,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093793+0000","last_change":"2024-09-21T22:17:54.093793+0000","last_active":"2024-09-21T22:17:54.093793+0000","last_peered":"2024-09-21T22:17:54.093793+0000","last_clean":"2024-09-21T22:17:54.093793+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:17:54.093793+0000","last_undegraded":"2024-09-21T22:17:54.093793+0000","last_fullsized":"2024-09-21T22:17:54.093793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1139,"log_dups_size":0,"ondisk_log_size":1139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:22:12.011562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056296700000000005,"stat_sum":{"num_bytes":63842296,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":29627,"num_read_kb":65995,"num_write":1993,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1e","version":"153'648","reported_seq":3931,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.096550+0000","last_change":"2024-09-21T22:17:50.070185+0000","last_active":"2024-09-21T22:17:53.096550+0000","last_peered":"2024-09-21T22:17:53.096550+0000","last_clean":"2024-09-21T22:17:53.096550+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:17:53.096550+0000","last_undegraded":"2024-09-21T22:17:53.096550+0000","last_fullsized":"2024-09-21T22:17:53.096550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:30:24.962104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077374599999999996,"stat_sum":{"num_bytes":33205150,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5023,"num_read_kb":32498,"num_write":829,"num_write_kb":20984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.1d","version":"154'341","reported_seq":8052,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.144100+0000","last_change":"2024-09-21T22:17:54.144100+0000","last_active":"2024-09-21T22:17:54.144100+0000","last_peered":"2024-09-21T22:17:54.144100+0000","last_clean":"2024-09-21T22:17:54.144100+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:17:54.144100+0000","last_undegraded":"2024-09-21T22:17:54.144100+0000","last_fullsized":"2024-09-21T22:17:54.144100+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:03:48.467744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059181200000000005,"stat_sum":{"num_bytes":64590570,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":7376,"num_read_kb":54616,"num_write":431,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1c","version":"154'676","reported_seq":2388,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.208993+0000","last_change":"2024-09-21T22:17:54.143951+0000","last_active":"2024-09-21T22:17:54.208993+0000","last_peered":"2024-09-21T22:17:54.208993+0000","last_clean":"2024-09-21T22:17:54.208993+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:17:54.208993+0000","last_undegraded":"2024-09-21T22:17:54.208993+0000","last_fullsized":"2024-09-21T22:17:54.208993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:59.155203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051584799999999996,"stat_sum":{"num_bytes":48978544,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2853,"num_read_kb":31771,"num_write":1109,"num_write_kb":32231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1b","version":"153'387","reported_seq":10434,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093807+0000","last_change":"2024-09-21T22:17:54.094011+0000","last_active":"2024-09-21T22:17:54.093807+0000","last_peered":"2024-09-21T22:17:54.093807+0000","last_clean":"2024-09-21T22:17:54.093807+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:17:54.093807+0000","last_undegraded":"2024-09-21T22:17:54.093807+0000","last_fullsized":"2024-09-21T22:17:54.093807+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:09:51.217024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065147999999999996,"stat_sum":{"num_bytes":32287869,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10334,"num_read_kb":32402,"num_write":431,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.1a","version":"153'266","reported_seq":2391,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.153906+0000","last_change":"2024-09-21T22:17:54.144210+0000","last_active":"2024-09-21T22:17:54.153906+0000","last_peered":"2024-09-21T22:17:54.153906+0000","last_clean":"2024-09-21T22:17:54.153906+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:17:54.153906+0000","last_undegraded":"2024-09-21T22:17:54.153906+0000","last_fullsized":"2024-09-21T22:17:54.153906+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:55.385599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067927700000000005,"stat_sum":{"num_bytes":12711132,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1978,"num_read_kb":13766,"num_write":347,"num_write_kb":16861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.19","version":"144'632","reported_seq":3304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068602+0000","last_change":"2024-09-21T22:17:50.068780+0000","last_active":"2024-09-21T22:17:50.068602+0000","last_peered":"2024-09-21T22:17:50.068602+0000","last_clean":"2024-09-21T22:17:50.068602+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:17:50.068602+0000","last_undegraded":"2024-09-21T22:17:50.068602+0000","last_fullsized":"2024-09-21T22:17:50.068602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:19.739968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060667999999999996,"stat_sum":{"num_bytes":17932970,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4983,"num_read_kb":22221,"num_write":726,"num_write_kb":20214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.18","version":"144'659","reported_seq":1915,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:52.899257+0000","last_change":"2024-09-21T22:17:50.069616+0000","last_active":"2024-09-21T22:17:52.899257+0000","last_peered":"2024-09-21T22:17:52.899257+0000","last_clean":"2024-09-21T22:17:52.899257+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:17:52.899257+0000","last_undegraded":"2024-09-21T22:17:52.899257+0000","last_fullsized":"2024-09-21T22:17:52.899257+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:37:31.115181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062237800000000004,"stat_sum":{"num_bytes":22225923,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2837,"num_read_kb":21755,"num_write":863,"num_write_kb":26232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.17","version":"153'823","reported_seq":3265,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093914+0000","last_change":"2024-09-21T22:17:54.094158+0000","last_active":"2024-09-21T22:17:54.093914+0000","last_peered":"2024-09-21T22:17:54.093914+0000","last_clean":"2024-09-21T22:17:54.093914+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:17:54.093914+0000","last_undegraded":"2024-09-21T22:17:54.093914+0000","last_fullsized":"2024-09-21T22:17:54.093914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:28:04.134855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065797800000000004,"stat_sum":{"num_bytes":23977185,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4976,"num_read_kb":30259,"num_write":1437,"num_write_kb":23933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.16","version":"147'231","reported_seq":13992,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068665+0000","last_change":"2024-09-21T22:17:50.068860+0000","last_active":"2024-09-21T22:17:50.068665+0000","last_peered":"2024-09-21T22:17:50.068665+0000","last_clean":"2024-09-21T22:17:50.068665+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:17:50.068665+0000","last_undegraded":"2024-09-21T22:17:50.068665+0000","last_fullsized":"2024-09-21T22:17:50.068665+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:11:40.018246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061567200000000005,"stat_sum":{"num_bytes":69494207,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14149,"num_read_kb":47844,"num_write":319,"num_write_kb":23357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.15","version":"154'718","reported_seq":3186,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.409216+0000","last_change":"2024-09-21T22:17:54.088492+0000","last_active":"2024-09-21T22:17:54.409216+0000","last_peered":"2024-09-21T22:17:54.409216+0000","last_clean":"2024-09-21T22:17:54.409216+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:17:54.409216+0000","last_undegraded":"2024-09-21T22:17:54.409216+0000","last_fullsized":"2024-09-21T22:17:54.409216+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:29:23.312628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040651100000000003,"stat_sum":{"num_bytes":53362261,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":4154,"num_read_kb":35929,"num_write":1072,"num_write_kb":33804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.14","version":"154'878","reported_seq":4553,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.144499+0000","last_change":"2024-09-21T22:17:54.144499+0000","last_active":"2024-09-21T22:17:54.144499+0000","last_peered":"2024-09-21T22:17:54.144499+0000","last_clean":"2024-09-21T22:17:54.144499+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:17:54.144499+0000","last_undegraded":"2024-09-21T22:17:54.144499+0000","last_fullsized":"2024-09-21T22:17:54.144499+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":878,"log_dups_size":0,"ondisk_log_size":878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:52.196801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083965400000000001,"stat_sum":{"num_bytes":59753252,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":5742,"num_read_kb":39440,"num_write":1357,"num_write_kb":26527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":282,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.149309+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:17:54.149309+0000","last_peered":"2024-09-21T22:17:54.149309+0000","last_clean":"2024-09-21T22:17:54.149309+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:17:54.149309+0000","last_undegraded":"2024-09-21T22:17:54.149309+0000","last_fullsized":"2024-09-21T22:17:54.149309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"154'343","reported_seq":3583,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.409810+0000","last_change":"2024-09-21T22:17:54.094542+0000","last_active":"2024-09-21T22:17:54.409810+0000","last_peered":"2024-09-21T22:17:54.409810+0000","last_clean":"2024-09-21T22:17:54.409810+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:17:54.409810+0000","last_undegraded":"2024-09-21T22:17:54.409810+0000","last_fullsized":"2024-09-21T22:17:54.409810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:10:32.774396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062129500000000001,"stat_sum":{"num_bytes":42428516,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":3549,"num_read_kb":40098,"num_write":369,"num_write_kb":25418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068460+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:17:50.068460+0000","last_peered":"2024-09-21T22:17:50.068460+0000","last_clean":"2024-09-21T22:17:50.068460+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:17:50.068460+0000","last_undegraded":"2024-09-21T22:17:50.068460+0000","last_fullsized":"2024-09-21T22:17:50.068460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'392","reported_seq":10689,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.462260+0000","last_change":"2024-09-21T22:17:50.070554+0000","last_active":"2024-09-21T22:17:53.462260+0000","last_peered":"2024-09-21T22:17:53.462260+0000","last_clean":"2024-09-21T22:17:53.462260+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:17:53.462260+0000","last_undegraded":"2024-09-21T22:17:53.462260+0000","last_fullsized":"2024-09-21T22:17:53.462260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:35:10.215873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001045065,"stat_sum":{"num_bytes":40864753,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":10619,"num_read_kb":35216,"num_write":532,"num_write_kb":21891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.088047+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:17:54.088047+0000","last_peered":"2024-09-21T22:17:54.088047+0000","last_clean":"2024-09-21T22:17:54.088047+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:17:54.088047+0000","last_undegraded":"2024-09-21T22:17:54.088047+0000","last_fullsized":"2024-09-21T22:17:54.088047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"144'404","reported_seq":9465,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068878+0000","last_change":"2024-09-21T22:17:50.069068+0000","last_active":"2024-09-21T22:17:50.068878+0000","last_peered":"2024-09-21T22:17:50.068878+0000","last_clean":"2024-09-21T22:17:50.068878+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:17:50.068878+0000","last_undegraded":"2024-09-21T22:17:50.068878+0000","last_fullsized":"2024-09-21T22:17:50.068878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:57.244754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081586799999999998,"stat_sum":{"num_bytes":42365665,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":9169,"num_read_kb":53637,"num_write":469,"num_write_kb":26529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068376+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:17:50.068376+0000","last_peered":"2024-09-21T22:17:50.068376+0000","last_clean":"2024-09-21T22:17:50.068376+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:17:50.068376+0000","last_undegraded":"2024-09-21T22:17:50.068376+0000","last_fullsized":"2024-09-21T22:17:50.068376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'400","reported_seq":13922,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.553218+0000","last_change":"2024-09-21T22:17:50.069719+0000","last_active":"2024-09-21T22:17:53.553218+0000","last_peered":"2024-09-21T22:17:53.553218+0000","last_clean":"2024-09-21T22:17:53.553218+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:17:53.553218+0000","last_undegraded":"2024-09-21T22:17:53.553218+0000","last_fullsized":"2024-09-21T22:17:53.553218+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:34:53.420606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054951800000000003,"stat_sum":{"num_bytes":72593503,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":13751,"num_read_kb":54172,"num_write":483,"num_write_kb":24148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.3","version":"154'462","reported_seq":3393,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.406539+0000","last_change":"2024-09-21T22:17:54.144740+0000","last_active":"2024-09-21T22:17:54.406539+0000","last_peered":"2024-09-21T22:17:54.406539+0000","last_clean":"2024-09-21T22:17:54.406539+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:17:54.406539+0000","last_undegraded":"2024-09-21T22:17:54.406539+0000","last_fullsized":"2024-09-21T22:17:54.406539+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:28:51.658139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010554900000000001,"stat_sum":{"num_bytes":45911731,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":3804,"num_read_kb":36491,"num_write":520,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068062+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:17:50.068062+0000","last_peered":"2024-09-21T22:17:50.068062+0000","last_clean":"2024-09-21T22:17:50.068062+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:17:50.068062+0000","last_undegraded":"2024-09-21T22:17:50.068062+0000","last_fullsized":"2024-09-21T22:17:50.068062+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"149'560","reported_seq":16848,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068331+0000","last_change":"2024-09-21T22:17:50.068547+0000","last_active":"2024-09-21T22:17:50.068331+0000","last_peered":"2024-09-21T22:17:50.068331+0000","last_clean":"2024-09-21T22:17:50.068331+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:17:50.068331+0000","last_undegraded":"2024-09-21T22:17:50.068331+0000","last_fullsized":"2024-09-21T22:17:50.068331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:17:35.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049006099999999997,"stat_sum":{"num_bytes":82107117,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":16868,"num_read_kb":57575,"num_write":727,"num_write_kb":29824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":279,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T22:17:49.058589+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:17:49.058589+0000","last_peered":"2024-09-21T22:17:49.058589+0000","last_clean":"2024-09-21T22:17:49.058589+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:17:49.058589+0000","last_undegraded":"2024-09-21T22:17:49.058589+0000","last_fullsized":"2024-09-21T22:17:49.058589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"153'369","reported_seq":2167,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.093506+0000","last_change":"2024-09-21T22:17:54.093723+0000","last_active":"2024-09-21T22:17:54.093506+0000","last_peered":"2024-09-21T22:17:54.093506+0000","last_clean":"2024-09-21T22:17:54.093506+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:17:54.093506+0000","last_undegraded":"2024-09-21T22:17:54.093506+0000","last_fullsized":"2024-09-21T22:17:54.093506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:22:11.205371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036805099999999999,"stat_sum":{"num_bytes":38045118,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1413,"num_read_kb":26353,"num_write":526,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":284,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.087876+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:17:54.087876+0000","last_peered":"2024-09-21T22:17:54.087876+0000","last_clean":"2024-09-21T22:17:54.087876+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:17:54.087876+0000","last_undegraded":"2024-09-21T22:17:54.087876+0000","last_fullsized":"2024-09-21T22:17:54.087876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"153'338","reported_seq":1308,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.301892+0000","last_change":"2024-09-21T22:17:50.069919+0000","last_active":"2024-09-21T22:17:53.301892+0000","last_peered":"2024-09-21T22:17:53.301892+0000","last_clean":"2024-09-21T22:17:53.301892+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:17:53.301892+0000","last_undegraded":"2024-09-21T22:17:53.301892+0000","last_fullsized":"2024-09-21T22:17:53.301892+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:11:43.335543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074480300000000004,"stat_sum":{"num_bytes":26228965,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":1092,"num_read_kb":31312,"num_write":441,"num_write_kb":28317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":111,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T22:17:49.058472+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:17:49.058472+0000","last_peered":"2024-09-21T22:17:49.058472+0000","last_clean":"2024-09-21T22:17:49.058472+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:17:49.058472+0000","last_undegraded":"2024-09-21T22:17:49.058472+0000","last_fullsized":"2024-09-21T22:17:49.058472+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":436,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.087911+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:17:54.087911+0000","last_peered":"2024-09-21T22:17:54.087911+0000","last_clean":"2024-09-21T22:17:54.087911+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:17:54.087911+0000","last_undegraded":"2024-09-21T22:17:54.087911+0000","last_fullsized":"2024-09-21T22:17:54.087911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"153'583","reported_seq":1765,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.219829+0000","last_change":"2024-09-21T22:17:50.069958+0000","last_active":"2024-09-21T22:17:53.219829+0000","last_peered":"2024-09-21T22:17:53.219829+0000","last_clean":"2024-09-21T22:17:53.219829+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:17:53.219829+0000","last_undegraded":"2024-09-21T22:17:53.219829+0000","last_fullsized":"2024-09-21T22:17:53.219829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:45:23.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073035500000000002,"stat_sum":{"num_bytes":25084645,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2313,"num_read_kb":18357,"num_write":897,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.9","version":"153'373","reported_seq":3607,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.143859+0000","last_change":"2024-09-21T22:17:54.143859+0000","last_active":"2024-09-21T22:17:54.143859+0000","last_peered":"2024-09-21T22:17:54.143859+0000","last_clean":"2024-09-21T22:17:54.143859+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:17:54.143859+0000","last_undegraded":"2024-09-21T22:17:54.143859+0000","last_fullsized":"2024-09-21T22:17:54.143859+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:30.725755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050768299999999998,"stat_sum":{"num_bytes":78101738,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":3668,"num_read_kb":47267,"num_write":499,"num_write_kb":25542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.a","version":"154'401","reported_seq":2505,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.149996+0000","last_change":"2024-09-21T22:17:54.149996+0000","last_active":"2024-09-21T22:17:54.149996+0000","last_peered":"2024-09-21T22:17:54.149996+0000","last_clean":"2024-09-21T22:17:54.149996+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:17:54.149996+0000","last_undegraded":"2024-09-21T22:17:54.149996+0000","last_fullsized":"2024-09-21T22:17:54.149996+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:01.681304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068227299999999995,"stat_sum":{"num_bytes":41243959,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2616,"num_read_kb":26768,"num_write":432,"num_write_kb":19429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.b","version":"153'713","reported_seq":2250,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.537471+0000","last_change":"2024-09-21T22:17:50.070149+0000","last_active":"2024-09-21T22:17:53.537471+0000","last_peered":"2024-09-21T22:17:53.537471+0000","last_clean":"2024-09-21T22:17:53.537471+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:17:53.537471+0000","last_undegraded":"2024-09-21T22:17:53.537471+0000","last_fullsized":"2024-09-21T22:17:53.537471+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:59:19.449686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089382399999999999,"stat_sum":{"num_bytes":20930127,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4293,"num_read_kb":25948,"num_write":978,"num_write_kb":22445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.c","version":"153'325","reported_seq":1438,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T22:17:53.587395+0000","last_change":"2024-09-21T22:17:50.070465+0000","last_active":"2024-09-21T22:17:53.587395+0000","last_peered":"2024-09-21T22:17:53.587395+0000","last_clean":"2024-09-21T22:17:53.587395+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:17:53.587395+0000","last_undegraded":"2024-09-21T22:17:53.587395+0000","last_fullsized":"2024-09-21T22:17:53.587395+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:14.038565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010516569999999999,"stat_sum":{"num_bytes":50113436,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1335,"num_read_kb":30411,"num_write":459,"num_write_kb":22843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.d","version":"153'419","reported_seq":1510,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.149670+0000","last_change":"2024-09-21T22:17:54.149670+0000","last_active":"2024-09-21T22:17:54.149670+0000","last_peered":"2024-09-21T22:17:54.149670+0000","last_clean":"2024-09-21T22:17:54.149670+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:17:54.149670+0000","last_undegraded":"2024-09-21T22:17:54.149670+0000","last_fullsized":"2024-09-21T22:17:54.149670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:38:02.590131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038819000000000001,"stat_sum":{"num_bytes":15605836,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1611,"num_read_kb":21418,"num_write":615,"num_write_kb":19906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.e","version":"153'274","reported_seq":1287,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.088796+0000","last_change":"2024-09-21T22:17:54.088796+0000","last_active":"2024-09-21T22:17:54.088796+0000","last_peered":"2024-09-21T22:17:54.088796+0000","last_clean":"2024-09-21T22:17:54.088796+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:17:54.088796+0000","last_undegraded":"2024-09-21T22:17:54.088796+0000","last_fullsized":"2024-09-21T22:17:54.088796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:03:01.341977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061204300000000005,"stat_sum":{"num_bytes":14863940,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":565,"num_read_kb":18334,"num_write":338,"num_write_kb":22475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.f","version":"154'482","reported_seq":2138,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.414418+0000","last_change":"2024-09-21T22:17:54.089056+0000","last_active":"2024-09-21T22:17:54.414418+0000","last_peered":"2024-09-21T22:17:54.414418+0000","last_clean":"2024-09-21T22:17:54.414418+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:17:54.414418+0000","last_undegraded":"2024-09-21T22:17:54.414418+0000","last_fullsized":"2024-09-21T22:17:54.414418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:50:15.615727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000810368,"stat_sum":{"num_bytes":21494383,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2274,"num_read_kb":18251,"num_write":597,"num_write_kb":19718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.10","version":"154'273","reported_seq":2090,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.410520+0000","last_change":"2024-09-21T22:17:54.149930+0000","last_active":"2024-09-21T22:17:54.410520+0000","last_peered":"2024-09-21T22:17:54.410520+0000","last_clean":"2024-09-21T22:17:54.410520+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:17:54.410520+0000","last_undegraded":"2024-09-21T22:17:54.410520+0000","last_fullsized":"2024-09-21T22:17:54.410520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:20:25.814688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064085499999999996,"stat_sum":{"num_bytes":42732429,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1437,"num_read_kb":28569,"num_write":307,"num_write_kb":23951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.11","version":"144'598","reported_seq":1824,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-21T22:17:50.068392+0000","last_change":"2024-09-21T22:17:50.068598+0000","last_active":"2024-09-21T22:17:50.068392+0000","last_peered":"2024-09-21T22:17:50.068392+0000","last_clean":"2024-09-21T22:17:50.068392+0000","last_became_active":"2024-09-21T22:17:14.901471+0000","last_became_peered":"2024-09-21T22:17:14.901471+0000","last_unstale":"2024-09-21T22:17:50.068392+0000","last_undegraded":"2024-09-21T22:17:50.068392+0000","last_fullsized":"2024-09-21T22:17:50.068392+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:38.832768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051992200000000003,"stat_sum":{"num_bytes":15820849,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2651,"num_read_kb":21132,"num_write":905,"num_write_kb":19512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":16112633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3a","length":"1"},{"start":"3c","length":"1"},{"start":"3e","length":"1"},{"start":"40","length":"1"}]},{"pgid":"3.12","version":"154'428","reported_seq":6484,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.401430+0000","last_change":"2024-09-21T22:17:54.088489+0000","last_active":"2024-09-21T22:17:54.401430+0000","last_peered":"2024-09-21T22:17:54.401430+0000","last_clean":"2024-09-21T22:17:54.401430+0000","last_became_active":"2024-09-21T22:17:37.898981+0000","last_became_peered":"2024-09-21T22:17:37.898981+0000","last_unstale":"2024-09-21T22:17:54.401430+0000","last_undegraded":"2024-09-21T22:17:54.401430+0000","last_fullsized":"2024-09-21T22:17:54.401430+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:08:46.195930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037367500000000002,"stat_sum":{"num_bytes":27003723,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":6593,"num_read_kb":24000,"num_write":545,"num_write_kb":18908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]},{"pgid":"3.13","version":"153'608","reported_seq":12110,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-21T22:17:54.088773+0000","last_change":"2024-09-21T22:17:54.088773+0000","last_active":"2024-09-21T22:17:54.088773+0000","last_peered":"2024-09-21T22:17:54.088773+0000","last_clean":"2024-09-21T22:17:54.088773+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:17:54.088773+0000","last_undegraded":"2024-09-21T22:17:54.088773+0000","last_fullsized":"2024-09-21T22:17:54.088773+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:44.687112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068547699999999998,"stat_sum":{"num_bytes":64294833,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":12374,"num_read_kb":60020,"num_write":790,"num_write_kb":28395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3e","length":"1"},{"start":"40","length":"1"},{"start":"42","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1310196625,"num_objects":1156,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":196027,"num_read_kb":1103825,"num_write":22343,"num_write_kb":789484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1301,"num_bytes_recovered":151696477,"num_keys_recovered":223,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":774144000,"data_stored":770969773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16143,"ondisk_log_size":16143,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139440,"kb_used_data":90200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94232400,"statfs":{"total":96636764160,"available":96493977600,"internally_reserved":0,"allocated":92364800,"data_stored":91053687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78492,"kb_used_data":43140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94293348,"statfs":{"total":96636764160,"available":96556388352,"internally_reserved":0,"allocated":44175360,"data_stored":43032689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162032,"kb_used_data":98912,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94209808,"statfs":{"total":96636764160,"available":96470843392,"internally_reserved":0,"allocated":101285888,"data_stored":99906681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195860,"kb_used_data":138300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94175980,"statfs":{"total":96636764160,"available":96436203520,"internally_reserved":0,"allocated":141619200,"data_stored":140098426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528344,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173024,"kb_used_data":122700,"kb_used_omap":4,"kb_used_meta":50299,"kb_avail":94198816,"statfs":{"total":96636764160,"available":96459587584,"internally_reserved":0,"allocated":125644800,"data_stored":124170393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":51506866},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84240,"kb_used_data":48888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287600,"statfs":{"total":96636764160,"available":96550502400,"internally_reserved":0,"allocated":50061312,"data_stored":48900664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138480,"kb_used_data":94804,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94233360,"statfs":{"total":96636764160,"available":96494960640,"internally_reserved":0,"allocated":97079296,"data_stored":95746903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198580,"kb_used_data":127140,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94173260,"statfs":{"total":96636764160,"available":96433418240,"internally_reserved":0,"allocated":130191360,"data_stored":128816196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":130306048,"data_stored":129874995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":95285248,"data_stored":94877700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48271360,"data_stored":48031480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":123805696,"data_stored":123276095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":139804672,"data_stored":139225379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":99823616,"data_stored":99397384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":42344448,"data_stored":42146583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94502912,"data_stored":94140157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:17:55.768 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:17:55.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:17:55.769 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-21T22:17:55.769 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T22:17:55.769 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T22:17:55.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-21T22:17:55.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:55.808+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:55.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:55.846 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:55.862 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:55.863 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:55.872 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:55.872 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "" 2024-09-21T22:17:55.872 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:55.875 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:55.874+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:55.879 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:55.879 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:55.895 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:55.895 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:55.912 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:55.912 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:55.912 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:55.913 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:55.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:55.929 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:55.946 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:55.946 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:55.963 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:55.963 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:56.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:56.017+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:56.035 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:56.035 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:56.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:56.035 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:56.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:56.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.123607792, 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:17:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:17:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:17:56.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.120985719, 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:17:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:17:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:17:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:17:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.138280520999999, 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.048 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:17:56.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:17:56.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:17:56.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.088994670000002, 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.055 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:17:56.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160324 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5640192~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.086782004, 2024-09-21T22:17:56.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057423746999999997, 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160324 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947010+0000", 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947027+0000", 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6820000000000002e-05 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947029+0000", 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3489999999999999e-06 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947035+0000", 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947041+0000", 2024-09-21T22:17:56.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3750000000000002e-06 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004283+0000", 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057242800000000003 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:17:56.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9294000000000004e-05 2024-09-21T22:17:56.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004433+0000", 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0737999999999998e-05 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:56.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.086743980000001, 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:17:56.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:17:56.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:17:56.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.086641829000001, 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.073 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:17:56.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.082821552999999, 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.078 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.082801414999999, 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:17:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:17:56.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.082780896999999, 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.088 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:17:56.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.054854353, 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:17:56.093 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:56.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:17:56.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.054834783, 2024-09-21T22:17:56.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:56.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:17:56.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.054816192000001, 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:17:56.103 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:56.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:17:56.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.054796511999999, 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:17:56.108 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:56.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:17:56.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.054768152000001, 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:17:56.113 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:17:56.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.054746609999999, 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:17:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190908 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 303104~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1048506910000002, 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057426265999999997, 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190908 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928944+0000", 2024-09-21T22:17:56.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2010000000000002e-06 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928951+0000", 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928956+0000", 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1030000000000001e-06 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986168+0000", 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212363000000002 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986213+0000", 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5142999999999998e-05 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986367+0000", 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-21T22:17:56.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190909 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 385024~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1048295829999999, 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057618427999999999, 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190909 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928963+0000", 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928965+0000", 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928972+0000", 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5610000000000001e-06 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928977+0000", 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986391+0000", 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057413929000000002 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986434+0000", 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2582e-05 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986581+0000", 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014685300000000001 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190910 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 450560~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1048077570000001, 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057841218, 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190910 2024-09-21T22:17:56.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928987+0000", 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6740000000000001e-06 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928993+0000", 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:17:56.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929000+0000", 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6159999999999998e-06 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986611+0000", 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057611258999999998 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986651+0000", 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0303999999999999e-05 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986825+0000", 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173847 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190911 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 598016~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.1047865030000001, 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058186806000000001, 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190911 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.138 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:17:56.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929007+0000", 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929012+0000", 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929015+0000", 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986859+0000", 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057844049000000002 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986940+0000", 2024-09-21T22:17:56.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1265000000000002e-05 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.987192+0000", 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175700000000002 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.142 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:56.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:56.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:17:56.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:56.144+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:56.245 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:56.243+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:56.284 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:56.284 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:56.284 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:56.284 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:56.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:17:56.346 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:56.345+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:56.398 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:56.398 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:56.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:17:56.451 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:56.450+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:56.513 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:56.513 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:56.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.584842687999998, 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:17:56.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:17:56.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.584824171000001, 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:17:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:17:56.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:17:56.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.584651585, 2024-09-21T22:17:56.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:56.526 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.584629743000001, 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.584609206, 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:56.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:17:56.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:17:56.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.534 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.584584676999999, 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:17:56.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:17:56.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.538 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.583734819, 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.583708432000002, 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:17:56.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:17:56.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:17:56.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:17:56.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.583685866, 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:17:56.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:56.551 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.583664156000001, 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.583643016, 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.559 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.583621140999998, 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.560 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:17:56.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.582005852999998, 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.564 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.581986075, 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:17:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:17:56.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.581966596000001, 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:17:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.581948194999999, 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:17:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.581915796000001, 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:17:56.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.581895657, 2024-09-21T22:17:56.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:17:56.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:17:56.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160176 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.577829892, 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074083248000000004, 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160176 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.590 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933867+0000", 2024-09-21T22:17:56.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933869+0000", 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1210000000000001e-06 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933874+0000", 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933879+0000", 2024-09-21T22:17:56.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4830000000000001e-06 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007941+0000", 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074061907999999996 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007950+0000", 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7329999999999992e-06 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160177 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.577811875999998, 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074112131999999997, 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160177 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:56.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933885+0000", 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:17:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933887+0000", 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933892+0000", 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933896+0000", 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4209999999999997e-06 2024-09-21T22:17:56.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007986+0000", 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074089981999999999 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007996+0000", 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:56.597 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:56.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:17:56.599 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:56.597+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:56.700 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:56.699+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:56.742 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:56.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:56.743 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:56.743 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:56.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:17:56.835 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:56.834+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:56.894 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:56.894 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:56.894 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:56.901 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:56.899+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:56.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:17:56.905 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:17:57.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:57.004+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:57.050 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-21T22:17:57.076 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.160105988, 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:17:57.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:17:57.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:57.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037364370999995, 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:57.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:17:57.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037354832000005, 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:17:57.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037345991999999, 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:17:57.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037336785999997, 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037327812000001, 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:17:57.099 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:57.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037318907, 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:57.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:17:57.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:17:57.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.107 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037297167000006, 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037287742999993, 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.112 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037278843999999, 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:17:57.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:17:57.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.119 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.037269890999994, 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.035765030999997, 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:17:57.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:17:57.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:17:57.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.035755526000003, 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.128 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.035741787000006, 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.035732476999996, 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.136 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:17:57.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.175721478, 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:17:57.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:17:57.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:17:57.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.172100056999994, 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.146 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:17:57.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:17:57.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:17:57.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.589629522999999, 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.153 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:17:57.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.870966582999998, 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:17:57.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:17:57.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:17:57.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200487 3.4 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.903650815, 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070564014999999994, 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200487 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170963+0000", 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5590000000000001e-06 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178398+0000", 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074350709999999997 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178437+0000", 2024-09-21T22:17:57.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026000000000002e-05 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178452+0000", 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5128e-05 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178600+0000", 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014802700000000001 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178942+0000", 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034162 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179139+0000", 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196672 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237616+0000", 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058477256999999998 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241380+0000", 2024-09-21T22:17:57.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003763654 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241460+0000", 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0438999999999993e-05 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241524+0000", 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3561999999999999e-05 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.168 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.169 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:57.170 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:17:57.170 INFO:teuthology.orchestra.run.smithi134.stdout:5186 read 0x1ca5dc4 thru 0x1cb1c3c (0xbe79 bytes) 2024-09-21T22:17:57.171 INFO:teuthology.orchestra.run.smithi134.stdout:5187 punch from 0x9e71b82 to 0x9e7f4f9, (0xd977 bytes) 2024-09-21T22:17:57.171 INFO:teuthology.orchestra.run.smithi134.stdout:5188 trunc from 0xd8b5037 to 0xc26086 2024-09-21T22:17:57.171 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.171 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:57.169+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:57.178 INFO:teuthology.orchestra.run.smithi134.stdout:5190 writesame 0x9b5cae1 thru 0x9b6ae0c data_size 0x43(0xe32c bytes) 2024-09-21T22:17:57.180 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.191 INFO:teuthology.orchestra.run.smithi134.stdout:5193 write 0xedbdef4 thru 0xedc9a19 (0xbb26 bytes) 2024-09-21T22:17:57.195 INFO:teuthology.orchestra.run.smithi134.stdout:5194 read 0xc5abf72 thru 0xc5ba321 (0xe3b0 bytes) 2024-09-21T22:17:57.195 INFO:teuthology.orchestra.run.smithi134.stdout:5195 write 0x33e4f03 thru 0x33f2101 (0xd1ff bytes) 2024-09-21T22:17:57.199 INFO:teuthology.orchestra.run.smithi134.stdout:5196 read 0x3737895 thru 0x3737992 (0xfe bytes) 2024-09-21T22:17:57.199 INFO:teuthology.orchestra.run.smithi134.stdout:5197 write 0x1774de0 thru 0x1777bc1 (0x2de2 bytes) 2024-09-21T22:17:57.200 INFO:teuthology.orchestra.run.smithi134.stdout:5198 writesame 0xa3042cb thru 0xa304b28 data_size 0x2a(0x85e bytes) 2024-09-21T22:17:57.202 INFO:teuthology.orchestra.run.smithi134.stdout:5199 write 0xdb8855d thru 0xdb90afd (0x85a1 bytes) 2024-09-21T22:17:57.203 INFO:teuthology.orchestra.run.smithi134.stdout:5200 read 0xad5a731 thru 0xad62d5b (0x862b bytes) 2024-09-21T22:17:57.216 INFO:teuthology.orchestra.run.smithi134.stdout:5201 trunc from 0xedc9a1a to 0x440c499 2024-09-21T22:17:57.229 INFO:teuthology.orchestra.run.smithi134.stdout:5203 read 0x3e7fd8f thru 0x3e8b469 (0xb6db bytes) 2024-09-21T22:17:57.229 INFO:teuthology.orchestra.run.smithi134.stdout:5204 punch from 0x20e1f63 to 0x20e4591, (0x262e bytes) 2024-09-21T22:17:57.230 INFO:teuthology.orchestra.run.smithi134.stdout:5205 punch from 0x24563de to 0x245e61e, (0x8240 bytes) 2024-09-21T22:17:57.230 INFO:teuthology.orchestra.run.smithi134.stdout:5206 trunc from 0x440c499 to 0x4420eec 2024-09-21T22:17:57.235 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.235 INFO:teuthology.orchestra.run.smithi134.stdout:5208 read 0x2474a36 thru 0x2481fb8 (0xd583 bytes) 2024-09-21T22:17:57.246 INFO:teuthology.orchestra.run.smithi134.stdout:5210 trunc from 0x4420eec to 0xcd3604c 2024-09-21T22:17:57.252 INFO:teuthology.orchestra.run.smithi134.stdout:5211 write 0x151023b thru 0x1515582 (0x5348 bytes) 2024-09-21T22:17:57.254 INFO:teuthology.orchestra.run.smithi134.stdout:5212 punch from 0x904bbc6 to 0x9057a8f, (0xbec9 bytes) 2024-09-21T22:17:57.254 INFO:teuthology.orchestra.run.smithi134.stdout:5213 write 0xa9474dd thru 0xa95534e (0xde72 bytes) 2024-09-21T22:17:57.269 INFO:teuthology.orchestra.run.smithi134.stdout:5214 trunc from 0xcd3604c to 0x196bf79 2024-09-21T22:17:57.270 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:57.268+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:57.276 INFO:teuthology.orchestra.run.smithi134.stdout:5215 read 0x74ec1e thru 0x758713 (0x9af6 bytes) 2024-09-21T22:17:57.277 INFO:teuthology.orchestra.run.smithi134.stdout:5216 write 0xf7a318 thru 0xf809f8 (0x66e1 bytes) 2024-09-21T22:17:57.278 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.299 INFO:teuthology.orchestra.run.smithi134.stdout:5218 write 0xd783487 thru 0xd7884ec (0x5066 bytes) 2024-09-21T22:17:57.301 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:17:57.301 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:57.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:17:57.316 INFO:teuthology.orchestra.run.smithi134.stdout:5219 trunc from 0xd7884ed to 0x21fef2d 2024-09-21T22:17:57.323 INFO:teuthology.orchestra.run.smithi134.stdout:5220 read 0x44d50b thru 0x45847d (0xaf73 bytes) 2024-09-21T22:17:57.341 INFO:teuthology.orchestra.run.smithi134.stdout:5221 writesame 0xb1b2c81 thru 0xb1bcb9b data_size 0x1(0x9f1b bytes) 2024-09-21T22:17:57.342 INFO:teuthology.orchestra.run.smithi134.stdout:5222 read 0x8ceb6d0 thru 0x8cf5562 (0x9e93 bytes) 2024-09-21T22:17:57.343 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.344 INFO:teuthology.orchestra.run.smithi134.stdout:5224 trunc from 0xb1bcb9c to 0xa47c358 2024-09-21T22:17:57.361 INFO:teuthology.orchestra.run.smithi134.stdout:5225 write 0xe13d8e1 thru 0xe13ebaf (0x12cf bytes) 2024-09-21T22:17:57.366 INFO:teuthology.orchestra.run.smithi134.stdout:5226 read 0x92ea thru 0xa3cb (0x10e2 bytes) 2024-09-21T22:17:57.366 INFO:teuthology.orchestra.run.smithi134.stdout:5227 punch from 0x6e1f822 to 0x6e2dce6, (0xe4c4 bytes) 2024-09-21T22:17:57.366 INFO:teuthology.orchestra.run.smithi134.stdout:5228 read 0xafe9155 thru 0xafed170 (0x401c bytes) 2024-09-21T22:17:57.367 INFO:teuthology.orchestra.run.smithi134.stdout:5229 punch from 0x181a1d7 to 0x1823288, (0x90b1 bytes) 2024-09-21T22:17:57.367 INFO:teuthology.orchestra.run.smithi134.stdout:5230 writesame 0xb75fb thru 0xc1075 data_size 0x1(0x9a7b bytes) 2024-09-21T22:17:57.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:57.370+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:57.384 INFO:teuthology.orchestra.run.smithi134.stdout:5231 write 0xa914a28 thru 0xa922d8f (0xe368 bytes) 2024-09-21T22:17:57.386 INFO:teuthology.orchestra.run.smithi134.stdout:5232 trunc from 0xe13ebb0 to 0xde101ba 2024-09-21T22:17:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:5234 read 0x8765fab thru 0x8772e77 (0xcecd bytes) 2024-09-21T22:17:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:5235 punch from 0x26cf1e2 to 0x26d3e8a, (0x4ca8 bytes) 2024-09-21T22:17:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.401 INFO:teuthology.orchestra.run.smithi134.stdout:5238 trunc from 0xde101ba to 0xabc9134 2024-09-21T22:17:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:5239 punch from 0x123b43b to 0x123e258, (0x2e1d bytes) 2024-09-21T22:17:57.408 INFO:teuthology.orchestra.run.smithi134.stdout:5240 read 0xa48419e thru 0xa491932 (0xd795 bytes) 2024-09-21T22:17:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:5241 punch from 0x5bb433 to 0x5c15b0, (0x617d bytes) 2024-09-21T22:17:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:5242 punch from 0x78249be to 0x782a203, (0x5845 bytes) 2024-09-21T22:17:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:5243 punch from 0x9294db9 to 0x9297943, (0x2b8a bytes) 2024-09-21T22:17:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.409 INFO:teuthology.orchestra.run.smithi134.stdout:5245 trunc from 0xabc9134 to 0xb424c1d 2024-09-21T22:17:57.415 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.415 INFO:teuthology.orchestra.run.smithi134.stdout:5247 writesame 0x7c6263d thru 0x7c6e965 data_size 0x1(0xc329 bytes) 2024-09-21T22:17:57.430 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:17:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:17:57.430 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:17:57.430 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:57.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:17:57.440 INFO:teuthology.orchestra.run.smithi134.stdout:5250 write 0x426c0c9 thru 0x427afb4 (0xeeec bytes) 2024-09-21T22:17:57.442 INFO:teuthology.orchestra.run.smithi134.stdout:5251 read 0xe4edb thru 0xf3be8 (0xed0e bytes) 2024-09-21T22:17:57.442 INFO:teuthology.orchestra.run.smithi134.stdout:5253 read 0x5a62690 thru 0x5a715a0 (0xef11 bytes) 2024-09-21T22:17:57.443 INFO:teuthology.orchestra.run.smithi134.stdout:5254 punch from 0xa5c1d9e to 0xa5cc71b, (0xa97d bytes) 2024-09-21T22:17:57.443 INFO:teuthology.orchestra.run.smithi134.stdout:5255 writesame 0x101333 thru 0x10add7 data_size 0x3b(0x9aa5 bytes) 2024-09-21T22:17:57.445 INFO:teuthology.orchestra.run.smithi134.stdout:5256 write 0x78f82d thru 0x79ea61 (0xf235 bytes) 2024-09-21T22:17:57.450 INFO:teuthology.orchestra.run.smithi134.stdout:5257 trunc from 0xb424c1d to 0x94f3f61 2024-09-21T22:17:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:5258 write 0x32b3d0d thru 0x32b65f7 (0x28eb bytes) 2024-09-21T22:17:57.461 INFO:teuthology.orchestra.run.smithi134.stdout:5261 trunc from 0x94f3f61 to 0x743e218 2024-09-21T22:17:57.472 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:57.470+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:57.478 INFO:teuthology.orchestra.run.smithi134.stdout:5262 trunc from 0x743e218 to 0x2e1ca82 2024-09-21T22:17:57.485 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.485 INFO:teuthology.orchestra.run.smithi134.stdout:5264 punch from 0xbbcb73 to 0xbc0a1b, (0x3ea8 bytes) 2024-09-21T22:17:57.504 INFO:teuthology.orchestra.run.smithi134.stdout:5265 writesame 0xcbf8383 thru 0xcbfbab0 data_size 0x7(0x372e bytes) 2024-09-21T22:17:57.505 INFO:teuthology.orchestra.run.smithi134.stdout:5267 read 0xb0c551a thru 0xb0c910e (0x3bf5 bytes) 2024-09-21T22:17:57.506 INFO:teuthology.orchestra.run.smithi134.stdout:5269 write 0x9f9b068 thru 0x9f9c37d (0x1316 bytes) 2024-09-21T22:17:57.507 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:17:57.507 INFO:teuthology.orchestra.run.smithi134.stdout:5271 clone 34 order 18 su 131072 sc 7 2024-09-21T22:17:57.556 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:17:57.556 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 131.03836204300001, 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:57.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:17:57.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:17:57.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:17:57.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 131.026915605, 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.476828377, 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 112.421740614, 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:17:57.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:17:57.573 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 111.150647925, 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.577 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 111.145741351, 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:17:57.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 111.137509055, 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:17:57.582 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:17:57.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 111.135521723, 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:17:57.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:17:57.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.611668132000005, 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:17:57.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:17:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.568506521000003, 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:17:57.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.567005780000002, 2024-09-21T22:17:57.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:17:57.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.587318792000005, 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:17:57.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:17:57.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:17:57.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.582434715999995, 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:17:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:17:57.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:17:57.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.581647019000002, 2024-09-21T22:17:57.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:17:57.617 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.574639576999999, 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:17:57.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.621 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.598714913000002, 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.481167615, 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:192338 3.9 e153/90 3:91686995:::rbd_data.1185cbdbd00.0000000000000019:head v 153'371, mlcod=144'369)", 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.473052794, 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071372069999999996, 2024-09-21T22:17:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081784+0000", 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082349+0000", 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056494 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082362+0000", 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082371+0000", 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082435+0000", 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000007e-05 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082461+0000", 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5678e-05 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088868+0000", 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064072590000000002 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088921+0000", 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2417000000000003e-05 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200481 3.9 e156/90 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head v 156'377, mlcod=155'375)", 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3823437489999999, 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069452704000000004, 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172493+0000", 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197250+0000", 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024756805999999999 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197272+0000", 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2025999999999999e-05 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197285+0000", 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197371+0000", 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5525999999999994e-05 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197397+0000", 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6491000000000001e-05 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241890+0000", 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044492459999999998 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241945+0000", 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5557999999999999e-05 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200487 3.4 e156/23 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head v 156'412, mlcod=154'410)", 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3753540310000001, 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057925425000000003, 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:17:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179483+0000", 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186401+0000", 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006918502 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186438+0000", 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7036000000000003e-05 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186459+0000", 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0738e-05 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186576+0000", 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011731900000000001 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186615+0000", 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8571000000000001e-05 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237335+0000", 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050720316000000001 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:17:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237408+0000", 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2503999999999996e-05 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:17:57.643 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:17:57.645 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:17:57.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:57.643+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:57.745 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:57.744+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:57.750 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:57.750 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:57.750 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:17:57.750 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:57.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:17:57.846 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:57.844+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:57.902 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:57.903 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:17:57.903 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:17:57.903 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:17:57.903 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:57.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:17:57.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:57.946+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:57.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:17:58.048 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:58.046+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.856754522, 2024-09-21T22:17:58.057 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.058 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:17:58.059 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.060 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.061 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.062 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.063 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 102.854878641, 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.064 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.065 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.066 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:17:58.067 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 70.091553293999993, 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.068 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.069 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:17:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.071 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:17:58.072 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:17:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 56.239227501999999, 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.074 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.075 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.076 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.077 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:17:58.078 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.079 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.963690886999998, 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.080 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.081 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:17:58.082 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.083 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:17:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:17:58.085 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 10.632035244000001, 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.086 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:17:58.088 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:17:58.089 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:17:58.090 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.091 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.1271324619999996, 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.092 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.093 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:17:58.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.095 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.1271071419999998, 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.096 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.097 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.098 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.099 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.100 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.1270726130000002, 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.101 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.102 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.103 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.104 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.1270290540000003, 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.105 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.106 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.107 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:17:58.108 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.1270035920000003, 2024-09-21T22:17:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.110 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.111 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:17:58.112 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.113 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.1269863850000004, 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.115 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.116 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.117 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.0569183019999997, 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:17:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.121 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.0568949200000004, 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.125 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:17:58.126 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.0568751499999998, 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.127 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:17:58.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:17:58.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:17:58.130 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.0568562139999997, 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:17:58.131 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.133 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.134 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.0568362709999999, 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.135 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.136 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:17:58.137 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.138 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.911496713, 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.139 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.140 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.141 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.142 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.143 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.884290177, 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.144 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:17:58.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:17:58.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:17:58.149 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 1.867923341, 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:17:58.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:17:58.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:17:58.152 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:17:58.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:17:58.154 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.154 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.154 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.154 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:17:58.154 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:17:58.154 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:17:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:17:58.155 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:17:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:17:58.156 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:17:58.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:17:58.157 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:17:58.157 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:17:58.157 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:17:58.157 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:17:58.158 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:58.154+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:58.169 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:17:58.169 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:17:58.185 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:17:58.186 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:17:58.202 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:17:58.202 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:17:58.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:17:58.219 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:17:58.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:58.270+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:58.301 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:58.301 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:58.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:17:58.356 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:58.355+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:58.413 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:58.413 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:58.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:17:58.465 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:58.464+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:58.526 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:58.526 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:58.535 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:17:58.576 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:58.574+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:58.659 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:17:58.658+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:17:58.679 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:58.679 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:58.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:17:58.759 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:58.757+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:58.791 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:58.791 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:58.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:17:58.884 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:58.883+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:58.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:17:58.944 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:58.944 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:58.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:17:58.994 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:58.992+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:59.061 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:17:59.059+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:17:59.097 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:59.098 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:59.106 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:17:59.191 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:59.189+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:59.262 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:17:59.261+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:17:59.276 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:59.276 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:59.288 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:17:59.372 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:17:59.370+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:17:59.452 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:59.452 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:59.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:17:59.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:59.463+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:59.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:59.564+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:59.565 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:59.565 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:59.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:17:59.665 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:17:59.664+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:17:59.718 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:59.718 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:59.727 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:17:59.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:17:59.767+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:17:59.867 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:17:59.865+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:17:59.870 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:59.870 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:59.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:17:59.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:17:59.967+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:17:59.981 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:17:59.981 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:17:59.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:00.070 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:00.068+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:00.118 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:18:00.140 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:00.141 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:00.150 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:00.171 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:00.169+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:00.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:00.259 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-21T22:18:00.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:00.270+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:00.306 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:00.306 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:00.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:00.373 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:00.371+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:00.389 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:00.390 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:00.407 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:00.408 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:00.424 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:00.424 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:00.442 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:00.442 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:00.459 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:00.459 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:00.473 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:00.472+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:00.476 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:00.476 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:00.479 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:00.479 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:00.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:00.493 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:00.493 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:00.511 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:00.552 INFO:teuthology.orchestra.run.smithi134.stdout:5272 read 0x4fafd63 thru 0x4fba81a (0xaab8 bytes) 2024-09-21T22:18:00.566 INFO:teuthology.orchestra.run.smithi134.stdout:5273 trunc from 0xcbfbab1 to 0x2238e2b 2024-09-21T22:18:00.574 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:00.573+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:00.612 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:00.612 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:00.613 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:00.613 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:00.613 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:00.615 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:00.631 INFO:teuthology.orchestra.run.smithi134.stdout:5275 write 0xad882d9 thru 0xad8d319 (0x5041 bytes) 2024-09-21T22:18:00.634 INFO:teuthology.orchestra.run.smithi134.stdout:5276 write 0x6657833 thru 0x6663cac (0xc47a bytes) 2024-09-21T22:18:00.638 INFO:teuthology.orchestra.run.smithi134.stdout:5279 punch from 0x21f2c9b to 0x220222e, (0xf593 bytes) 2024-09-21T22:18:00.638 INFO:teuthology.orchestra.run.smithi134.stdout:5280 write 0x79d7993 thru 0x79e25d1 (0xac3f bytes) 2024-09-21T22:18:00.647 INFO:teuthology.orchestra.run.smithi134.stdout:5281 write 0xb6b9c37 thru 0xb6c8984 (0xed4e bytes) 2024-09-21T22:18:00.651 INFO:teuthology.orchestra.run.smithi134.stdout:5282 punch from 0x6b0b05e to 0x6b12736, (0x76d8 bytes) 2024-09-21T22:18:00.651 INFO:teuthology.orchestra.run.smithi134.stdout:5283 punch from 0x1d50f51 to 0x1d58676, (0x7725 bytes) 2024-09-21T22:18:00.651 INFO:teuthology.orchestra.run.smithi134.stdout:5285 read 0x66e6a48 thru 0x66efccf (0x9288 bytes) 2024-09-21T22:18:00.652 INFO:teuthology.orchestra.run.smithi134.stdout:5286 trunc from 0xb6c8985 to 0xc38e927 2024-09-21T22:18:00.657 INFO:teuthology.orchestra.run.smithi134.stdout:5290 write 0x831870b thru 0x8328362 (0xfc58 bytes) 2024-09-21T22:18:00.660 INFO:teuthology.orchestra.run.smithi134.stdout:5291 write 0xa00d477 thru 0xa00dafd (0x687 bytes) 2024-09-21T22:18:00.663 INFO:teuthology.orchestra.run.smithi134.stdout:5292 writesame 0x14ed2e2 thru 0x14f55b9 data_size 0x8(0x82d8 bytes) 2024-09-21T22:18:00.667 INFO:teuthology.orchestra.run.smithi134.stdout:5294 write 0xb7ba87b thru 0xb7be57d (0x3d03 bytes) 2024-09-21T22:18:00.669 INFO:teuthology.orchestra.run.smithi134.stdout:5295 read 0xc33edf6 thru 0xc3445af (0x57ba bytes) 2024-09-21T22:18:00.669 INFO:teuthology.orchestra.run.smithi134.stdout:5297 read 0xb4212aa thru 0xb42e092 (0xcde9 bytes) 2024-09-21T22:18:00.669 INFO:teuthology.orchestra.run.smithi134.stdout:5299 punch from 0xa102902 to 0xa1102a5, (0xd9a3 bytes) 2024-09-21T22:18:00.669 INFO:teuthology.orchestra.run.smithi134.stdout:5301 write 0x1ee05b7 thru 0x1eee44d (0xde97 bytes) 2024-09-21T22:18:00.671 INFO:teuthology.orchestra.run.smithi134.stdout:5304 punch from 0x3281132 to 0x3290746, (0xf614 bytes) 2024-09-21T22:18:00.674 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:00.674+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:00.676 INFO:teuthology.orchestra.run.smithi134.stdout:5305 trunc from 0xc38e927 to 0x86c6846 2024-09-21T22:18:00.692 INFO:teuthology.orchestra.run.smithi134.stdout:5306 trunc from 0x86c6846 to 0x27a575b 2024-09-21T22:18:00.708 INFO:teuthology.orchestra.run.smithi134.stdout:5308 trunc from 0x27a575b to 0x6b4cec5 2024-09-21T22:18:00.713 INFO:teuthology.orchestra.run.smithi134.stdout:5309 writesame 0x58bb300 thru 0x58c246d data_size 0x1(0x716e bytes) 2024-09-21T22:18:00.736 INFO:teuthology.orchestra.run.smithi134.stdout:5310 trunc from 0x6b4cec5 to 0xf7e6d9 2024-09-21T22:18:00.752 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 119.83531886199999, 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:18:00.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712577245000006, 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.762 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712567706000002, 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:00.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712558865999995, 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:18:00.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:18:00.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:18:00.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712549659999993, 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712540685999997, 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:00.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:18:00.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712531780999996, 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712510041000002, 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:18:00.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:18:00.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712500617000003, 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:18:00.787 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:00.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712491717999995, 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:18:00.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:18:00.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.712482765000004, 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:18:00.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.710977904999993, 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:18:00.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.710968399999999, 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:18:00.804 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:18:00.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.710954661000002, 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:18:00.808 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:18:00.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:18:00.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.710945351000007, 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.850934351999996, 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:18:00.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.847312931000005, 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:18:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:18:00.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.264842396999995, 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:18:00.830 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:18:00.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:18:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:18:00.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:18:00.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.836 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.546179457000001, 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200487 3.4 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.5788636890000003, 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070564014999999994, 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200487 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170963+0000", 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5590000000000001e-06 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178398+0000", 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074350709999999997 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178437+0000", 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026000000000002e-05 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178452+0000", 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5128e-05 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178600+0000", 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014802700000000001 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178942+0000", 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034162 2024-09-21T22:18:00.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179139+0000", 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196672 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237616+0000", 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058477256999999998 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241380+0000", 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003763654 2024-09-21T22:18:00.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241460+0000", 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0438999999999993e-05 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241524+0000", 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3561999999999999e-05 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:00.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:00.847 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:00.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5311 write 0x8fb2ad5 thru 0x8fb7e2a (0x5356 bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5312 punch from 0x8ac0493 to 0x8ac48b9, (0x4426 bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5314 read 0x5093e9f thru 0x509a9cc (0x6b2e bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5316 write 0x4803d6c thru 0x48124cf (0xe764 bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5317 write 0x9ac344f thru 0x9acf812 (0xc3c4 bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5318 read 0x7e7e2f thru 0x7f31d9 (0xb3ab bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5320 writesame 0xa6a29a5 thru 0xa6aab8d data_size 0x1(0x81e9 bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5323 read 0x531d3a3 thru 0x53216a8 (0x4306 bytes) 2024-09-21T22:18:00.850 INFO:teuthology.orchestra.run.smithi134.stdout:5324 read 0x83ce523 thru 0x83ce92c (0x40a bytes) 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:5325 trunc from 0xa6aab8e to 0x28754c4 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:5326 punch from 0xc80402 to 0xc8e34d, (0xdf4b bytes) 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:5328 trunc from 0x28754c4 to 0xad51c17 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:5330 write 0x28ce86f thru 0x28dcc03 (0xe395 bytes) 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:5332 writesame 0x60288fd thru 0x602954a data_size 0x2d(0xc4e bytes) 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:5334 read 0x5727c75 thru 0x572838f (0x71b bytes) 2024-09-21T22:18:00.851 INFO:teuthology.orchestra.run.smithi134.stdout:5335 read 0x79e1542 thru 0x79e16c1 (0x180 bytes) 2024-09-21T22:18:00.852 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:00.846+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:00.852 INFO:teuthology.orchestra.run.smithi134.stdout:5338 write 0xc12a5b5 thru 0xc12c08a (0x1ad6 bytes) 2024-09-21T22:18:00.855 INFO:teuthology.orchestra.run.smithi134.stdout:5339 trunc from 0xc12c08b to 0xd23508d 2024-09-21T22:18:00.860 INFO:teuthology.orchestra.run.smithi134.stdout:5340 read 0xc2e25b7 thru 0xc2e8867 (0x62b1 bytes) 2024-09-21T22:18:00.860 INFO:teuthology.orchestra.run.smithi134.stdout:5341 read 0x74a31f5 thru 0x74a6001 (0x2e0d bytes) 2024-09-21T22:18:00.867 INFO:teuthology.orchestra.run.smithi134.stdout:5344 writesame 0xe741868 thru 0xe74547b data_size 0xa(0x3c14 bytes) 2024-09-21T22:18:00.867 INFO:teuthology.orchestra.run.smithi134.stdout:5345 write 0x45e23f3 thru 0x45e50ce (0x2cdc bytes) 2024-09-21T22:18:00.878 INFO:teuthology.orchestra.run.smithi134.stdout:5347 trunc from 0xe74547c to 0x77f1549 2024-09-21T22:18:00.882 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:18:00.882 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:18:00.882 INFO:tasks.thrashosds.thrasher:Reweighting osd 2 to 0.8884601997468936 2024-09-21T22:18:00.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 0.8884601997468936 2024-09-21T22:18:00.887 INFO:teuthology.orchestra.run.smithi134.stdout:5348 read 0x1536a5c thru 0x1539348 (0x28ed bytes) 2024-09-21T22:18:00.888 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.888 INFO:teuthology.orchestra.run.smithi134.stdout:5350 write 0x291d3d1 thru 0x29211a3 (0x3dd3 bytes) 2024-09-21T22:18:00.895 INFO:teuthology.orchestra.run.smithi134.stdout:5352 trunc from 0x77f1549 to 0xa660bb9 2024-09-21T22:18:00.906 INFO:teuthology.orchestra.run.smithi134.stdout:5353 trunc from 0xa660bb9 to 0x68075be 2024-09-21T22:18:00.913 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.913 INFO:teuthology.orchestra.run.smithi134.stdout:5357 read 0x47cb278 thru 0x47d05dc (0x5365 bytes) 2024-09-21T22:18:00.913 INFO:teuthology.orchestra.run.smithi134.stdout:5358 punch from 0x35cfe4e to 0x35dc449, (0xc5fb bytes) 2024-09-21T22:18:00.913 INFO:teuthology.orchestra.run.smithi134.stdout:5359 read 0x663c868 thru 0x6643c12 (0x73ab bytes) 2024-09-21T22:18:00.913 INFO:teuthology.orchestra.run.smithi134.stdout:5361 punch from 0x37c6276 to 0x37d6154, (0xfede bytes) 2024-09-21T22:18:00.913 INFO:teuthology.orchestra.run.smithi134.stdout:5362 writesame 0x2d71d9b thru 0x2d74b87 data_size 0x1(0x2ded bytes) 2024-09-21T22:18:00.920 INFO:teuthology.orchestra.run.smithi134.stdout:5364 read 0x2ba84d7 thru 0x2bb50bf (0xcbe9 bytes) 2024-09-21T22:18:00.920 INFO:teuthology.orchestra.run.smithi134.stdout:5365 writesame 0xc33fae thru 0xc3d1d2 data_size 0x3(0x9225 bytes) 2024-09-21T22:18:00.940 INFO:teuthology.orchestra.run.smithi134.stdout:5366 writesame 0xc515478 thru 0xc5198ee data_size 0x1(0x4477 bytes) 2024-09-21T22:18:00.941 INFO:teuthology.orchestra.run.smithi134.stdout:5367 punch from 0x7429c4d to 0x7433ec9, (0xa27c bytes) 2024-09-21T22:18:00.941 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.941 INFO:teuthology.orchestra.run.smithi134.stdout:5369 write 0x1332040 thru 0x133e461 (0xc422 bytes) 2024-09-21T22:18:00.944 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.944 INFO:teuthology.orchestra.run.smithi134.stdout:5371 writesame 0x36253e0 thru 0x362895d data_size 0x2(0x357e bytes) 2024-09-21T22:18:00.948 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:00.946+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:00.949 INFO:teuthology.orchestra.run.smithi134.stdout:5372 read 0x56b2859 thru 0x56bc2c6 (0x9a6e bytes) 2024-09-21T22:18:00.956 INFO:teuthology.orchestra.run.smithi134.stdout:5374 writesame 0xd0085b3 thru 0xd00b6b1 data_size 0x25(0x30ff bytes) 2024-09-21T22:18:00.956 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.956 INFO:teuthology.orchestra.run.smithi134.stdout:5376 punch from 0x3afce01 to 0x3afee63, (0x2062 bytes) 2024-09-21T22:18:00.956 INFO:teuthology.orchestra.run.smithi134.stdout:5378 write 0x7bebc1 thru 0x7ce461 (0xf8a1 bytes) 2024-09-21T22:18:00.959 INFO:teuthology.orchestra.run.smithi134.stdout:5379 punch from 0x37cb312 to 0x37d4a06, (0x96f4 bytes) 2024-09-21T22:18:00.959 INFO:teuthology.orchestra.run.smithi134.stdout:5380 punch from 0x482ac3b to 0x4830fde, (0x63a3 bytes) 2024-09-21T22:18:00.969 INFO:teuthology.orchestra.run.smithi134.stdout:5381 trunc from 0xd00b6b2 to 0x40973ab 2024-09-21T22:18:00.981 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:00.981 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:00.981 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:00.988 INFO:teuthology.orchestra.run.smithi134.stdout:5383 write 0x70b8b99 thru 0x70bf9f3 (0x6e5b bytes) 2024-09-21T22:18:00.992 INFO:teuthology.orchestra.run.smithi134.stdout:5384 punch from 0x3e5fc89 to 0x3e63c09, (0x3f80 bytes) 2024-09-21T22:18:00.992 INFO:teuthology.orchestra.run.smithi134.stdout:5386 read 0x12a30cb thru 0x12a442d (0x1363 bytes) 2024-09-21T22:18:00.992 INFO:teuthology.orchestra.run.smithi134.stdout:5387 read 0x2d95e98 thru 0x2d9c8b9 (0x6a22 bytes) 2024-09-21T22:18:00.992 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:00.992 INFO:teuthology.orchestra.run.smithi134.stdout:5389 write 0x1bef77a thru 0x1bfd886 (0xe10d bytes) 2024-09-21T22:18:00.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:00.995 INFO:teuthology.orchestra.run.smithi134.stdout:5390 read 0x394f971 thru 0x395abf1 (0xb281 bytes) 2024-09-21T22:18:00.995 INFO:teuthology.orchestra.run.smithi134.stdout:5391 punch from 0x5a3aae0 to 0x5a41e07, (0x7327 bytes) 2024-09-21T22:18:00.995 INFO:teuthology.orchestra.run.smithi134.stdout:5392 writesame 0x4152a51 thru 0x416197a data_size 0x1(0xef2a bytes) 2024-09-21T22:18:01.024 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.024 INFO:teuthology.orchestra.run.smithi134.stdout:5394 read 0x3e23d88 thru 0x3e2b7dc (0x7a55 bytes) 2024-09-21T22:18:01.024 INFO:teuthology.orchestra.run.smithi134.stdout:5395 read 0x1f2322b thru 0x1f2cce8 (0x9abe bytes) 2024-09-21T22:18:01.024 INFO:teuthology.orchestra.run.smithi134.stdout:5398 write 0x7019920 thru 0x7027b92 (0xe273 bytes) 2024-09-21T22:18:01.028 INFO:teuthology.orchestra.run.smithi134.stdout:5400 write 0x3b7c1a1 thru 0x3b7fff4 (0x3e54 bytes) 2024-09-21T22:18:01.046 INFO:teuthology.orchestra.run.smithi134.stdout:5401 writesame 0xee579c7 thru 0xee63b09 data_size 0x5(0xc143 bytes) 2024-09-21T22:18:01.046 INFO:teuthology.orchestra.run.smithi134.stdout:5402 read 0xbd37699 thru 0xbd40f48 (0x98b0 bytes) 2024-09-21T22:18:01.047 INFO:teuthology.orchestra.run.smithi134.stdout:5404 read 0x62b02b7 thru 0x62ba94b (0xa695 bytes) 2024-09-21T22:18:01.047 INFO:teuthology.orchestra.run.smithi134.stdout:5405 read 0x5e6586e thru 0x5e74be6 (0xf379 bytes) 2024-09-21T22:18:01.047 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.049 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:01.047+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:01.060 INFO:teuthology.orchestra.run.smithi134.stdout:5407 trunc from 0xee63b0a to 0x5f52011 2024-09-21T22:18:01.089 INFO:teuthology.orchestra.run.smithi134.stdout:5412 writesame 0xe8cb4b3 thru 0xe8cccb0 data_size 0x2(0x17fe bytes) 2024-09-21T22:18:01.225 INFO:teuthology.orchestra.run.smithi134.stdout:5413 read 0x2231bfb thru 0x2240e25 (0xf22b bytes) 2024-09-21T22:18:01.225 INFO:teuthology.orchestra.run.smithi134.stdout:5414 punch from 0xe6e37d0 to 0xe6e9b28, (0x6358 bytes) 2024-09-21T22:18:01.226 INFO:teuthology.orchestra.run.smithi134.stdout:5415 read 0x679cbb thru 0x6842c8 (0xa60e bytes) 2024-09-21T22:18:01.227 INFO:teuthology.orchestra.run.smithi134.stdout:5416 read 0xbfe712f thru 0xbfede7c (0x6d4e bytes) 2024-09-21T22:18:01.227 INFO:teuthology.orchestra.run.smithi134.stdout:5417 trunc from 0xe8cccb1 to 0x16e6970 2024-09-21T22:18:01.227 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:01.227 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:01.228 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:01.228 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:01.228 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:01.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:01.230 INFO:teuthology.orchestra.run.smithi134.stdout:5418 write 0xdced43d thru 0xdcf644b (0x900f bytes) 2024-09-21T22:18:01.230 INFO:teuthology.orchestra.run.smithi134.stdout:5419 read 0x3907642 thru 0x3916e6e (0xf82d bytes) 2024-09-21T22:18:01.230 INFO:teuthology.orchestra.run.smithi134.stdout:5422 read 0x37c9d38 thru 0x37d39f5 (0x9cbe bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5425 writesame 0x6479f59 thru 0x647a27d data_size 0x7(0x325 bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5426 punch from 0x3c4295e to 0x3c4c7fe, (0x9ea0 bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5427 punch from 0x6fd48d2 to 0x6fe15db, (0xcd09 bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5428 read 0x12ca7d0 thru 0x12cc8ab (0x20dc bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5429 write 0x63c99c2 thru 0x63cccfd (0x333c bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5430 read 0x3ecac56 thru 0x3ecaf2f (0x2da bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5432 trunc from 0xdcf644c to 0x7ceffe1 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5434 trunc from 0x7ceffe1 to 0xcf636c9 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5436 read 0x5159793 thru 0x51638fe (0xa16c bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5437 write 0xb2ba076 thru 0xb2c72a2 (0xd22d bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5439 read 0x23d398e thru 0x23dddc7 (0xa43a bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5440 trunc from 0xcf636c9 to 0xbf7bfe5 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5441 writesame 0x95edce2 thru 0x95f775f data_size 0x19(0x9a7e bytes) 2024-09-21T22:18:01.231 INFO:teuthology.orchestra.run.smithi134.stdout:5442 punch from 0x35f742b to 0x3604c0b, (0xd7e0 bytes) 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:5444 write 0x3d90ef8 thru 0x3d91450 (0x559 bytes) 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:5445 writesame 0x3ab1d4d thru 0x3abebdf data_size 0x1(0xce93 bytes) 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:5446 read 0x9fe39b4 thru 0x9fe6d57 (0x33a4 bytes) 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:5447 punch from 0x7649c83 to 0x764f52d, (0x58aa bytes) 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:5449 punch from 0x20ea235 to 0x20f301c, (0x8de7 bytes) 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.232 INFO:teuthology.orchestra.run.smithi134.stdout:5451 write 0x871f758 thru 0x8721ccb (0x2574 bytes) 2024-09-21T22:18:01.232 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:01.225+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:01.234 INFO:teuthology.orchestra.run.smithi134.stdout:5452 write 0xc6a032f thru 0xc6ac927 (0xc5f9 bytes) 2024-09-21T22:18:01.237 INFO:teuthology.orchestra.run.smithi134.stdout:5453 write 0x1f3ea01 thru 0x1f487ec (0x9dec bytes) 2024-09-21T22:18:01.241 INFO:teuthology.orchestra.run.smithi134.stdout:5456 punch from 0x21b8120 to 0x21c5cac, (0xdb8c bytes) 2024-09-21T22:18:01.244 INFO:teuthology.orchestra.run.smithi134.stdout:5458 trunc from 0xc6ac928 to 0xa199568 2024-09-21T22:18:01.254 INFO:teuthology.orchestra.run.smithi134.stdout:5459 writesame 0x1fd62f7 thru 0x1fe5852 data_size 0x52(0xf55c bytes) 2024-09-21T22:18:01.259 INFO:teuthology.orchestra.run.smithi134.stdout:5460 trunc from 0xa199568 to 0x8bf9d7d 2024-09-21T22:18:01.270 INFO:teuthology.orchestra.run.smithi134.stdout:5461 writesame 0x7703d47 thru 0x771270d data_size 0x1(0xe9c7 bytes) 2024-09-21T22:18:01.296 INFO:teuthology.orchestra.run.smithi134.stdout:5462 read 0x27b515e thru 0x27c4a5b (0xf8fe bytes) 2024-09-21T22:18:01.296 INFO:teuthology.orchestra.run.smithi134.stdout:5464 read 0x3e24276 thru 0x3e26294 (0x201f bytes) 2024-09-21T22:18:01.308 INFO:teuthology.orchestra.run.smithi134.stdout:5465 write 0xd7484b8 thru 0xd749288 (0xdd1 bytes) 2024-09-21T22:18:01.311 INFO:teuthology.orchestra.run.smithi134.stdout:5466 read 0x1f0c6d8 thru 0x1f19376 (0xcc9f bytes) 2024-09-21T22:18:01.311 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.311 INFO:teuthology.orchestra.run.smithi134.stdout:5469 writesame 0xa3d6dea thru 0xa3d8950 data_size 0x17(0x1b67 bytes) 2024-09-21T22:18:01.314 INFO:teuthology.orchestra.run.smithi134.stdout:5470 writesame 0x2ffa19 thru 0x300e8b data_size 0x3(0x1473 bytes) 2024-09-21T22:18:01.316 INFO:teuthology.orchestra.run.smithi134.stdout:5471 read 0x6a0dd66 thru 0x6a1bc89 (0xdf24 bytes) 2024-09-21T22:18:01.317 INFO:teuthology.orchestra.run.smithi134.stdout:5472 read 0x26ecb51 thru 0x26f4e9a (0x834a bytes) 2024-09-21T22:18:01.317 INFO:teuthology.orchestra.run.smithi134.stdout:5473 write 0x9269734 thru 0x926f91e (0x61eb bytes) 2024-09-21T22:18:01.326 INFO:teuthology.orchestra.run.smithi134.stdout:5474 write 0xe37cb5b thru 0xe389061 (0xc507 bytes) 2024-09-21T22:18:01.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:01.326+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:01.347 INFO:teuthology.orchestra.run.smithi134.stdout:5477 trunc from 0xe389062 to 0x139a22 2024-09-21T22:18:01.348 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:01.348 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:01.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:01.348 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.82998880400001, 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:18:01.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.818542366, 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:18:01.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 124.26845513799999, 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:18:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.213367375, 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:18:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:18:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:18:01.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 114.942274686, 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 114.937368112, 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.370 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:18:01.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:18:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 114.929135816, 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:18:01.374 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:18:01.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:18:01.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 114.927148484, 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:18:01.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:18:01.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 97.403294892999995, 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.360133282000007, 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:18:01.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:18:01.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.358632541000006, 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:18:01.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:18:01.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.378945552999994, 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:18:01.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:18:01.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.374061476999998, 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:18:01.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.373273780000005, 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:18:01.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:18:01.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:18:01.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.366266338000003, 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:18:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.390341673999998, 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.272794376, 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:18:01.416 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:01.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:18:01.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:18:01.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:192338 3.9 e153/90 3:91686995:::rbd_data.1185cbdbd00.0000000000000019:head v 153'371, mlcod=144'369)", 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.2646795550000007, 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071372069999999996, 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081784+0000", 2024-09-21T22:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082349+0000", 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056494 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082362+0000", 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082371+0000", 2024-09-21T22:18:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082435+0000", 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000007e-05 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082461+0000", 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5678e-05 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088868+0000", 2024-09-21T22:18:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064072590000000002 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088921+0000", 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2417000000000003e-05 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200481 3.9 e156/90 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head v 156'377, mlcod=155'375)", 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1739705100000002, 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069452704000000004, 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172493+0000", 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:18:01.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197250+0000", 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024756805999999999 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197272+0000", 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2025999999999999e-05 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197285+0000", 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-21T22:18:01.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197371+0000", 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5525999999999994e-05 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197397+0000", 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6491000000000001e-05 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241890+0000", 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044492459999999998 2024-09-21T22:18:01.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241945+0000", 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5557999999999999e-05 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200487 3.4 e156/23 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head v 156'412, mlcod=154'410)", 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1669807920000004, 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057925425000000003, 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179483+0000", 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186401+0000", 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006918502 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186438+0000", 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7036000000000003e-05 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186459+0000", 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0738e-05 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186576+0000", 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011731900000000001 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186615+0000", 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8571000000000001e-05 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237335+0000", 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050720316000000001 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:01.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237408+0000", 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2503999999999996e-05 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:01.432 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:01.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:5478 read 0x3642b thru 0x442e3 (0xdeb9 bytes) 2024-09-21T22:18:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:5479 trunc from 0x139a22 to 0x560cca9 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5481 write 0xdfca40a thru 0xdfd82bf (0xdeb6 bytes) 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5483 read 0x41492db thru 0x414e008 (0x4d2e bytes) 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5484 writesame 0x450fe40 thru 0x4511d40 data_size 0x1(0x1f01 bytes) 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5486 write 0x51889e4 thru 0x5190266 (0x7883 bytes) 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5487 trunc from 0xdfd82c0 to 0xa8f83c7 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5491 read 0x853438c thru 0x8544027 (0xfc9c bytes) 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5492 read 0x722f906 thru 0x7238120 (0x881b bytes) 2024-09-21T22:18:01.435 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:01.432+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:01.435 INFO:teuthology.orchestra.run.smithi134.stdout:5494 writesame 0x6db5f85 thru 0x6dbc591 data_size 0xb(0x660d bytes) 2024-09-21T22:18:01.437 INFO:teuthology.orchestra.run.smithi134.stdout:5495 write 0x229ead3 thru 0x229ed64 (0x292 bytes) 2024-09-21T22:18:01.440 INFO:teuthology.orchestra.run.smithi134.stdout:5496 write 0x5b3d717 thru 0x5b42b7d (0x5467 bytes) 2024-09-21T22:18:01.455 INFO:teuthology.orchestra.run.smithi134.stdout:5497 write 0xd2b15b1 thru 0xd2b5197 (0x3be7 bytes) 2024-09-21T22:18:01.459 INFO:teuthology.orchestra.run.smithi134.stdout:5498 read 0x5106f29 thru 0x5112916 (0xb9ee bytes) 2024-09-21T22:18:01.459 INFO:teuthology.orchestra.run.smithi134.stdout:5501 write 0x12018dc thru 0x120cb29 (0xb24e bytes) 2024-09-21T22:18:01.464 INFO:teuthology.orchestra.run.smithi134.stdout:5502 write 0xc2793b2 thru 0xc2822e4 (0x8f33 bytes) 2024-09-21T22:18:01.470 INFO:teuthology.orchestra.run.smithi134.stdout:5503 write 0x64cfc12 thru 0x64dd2b0 (0xd69f bytes) 2024-09-21T22:18:01.473 INFO:teuthology.orchestra.run.smithi134.stdout:5504 write 0x73f388 thru 0x7421aa (0x2e23 bytes) 2024-09-21T22:18:01.476 INFO:teuthology.orchestra.run.smithi134.stdout:5505 writesame 0xa85901d thru 0xa862013 data_size 0x87(0x8ff7 bytes) 2024-09-21T22:18:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:5510 read 0xc32250d thru 0xc32a8ee (0x83e2 bytes) 2024-09-21T22:18:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:5511 punch from 0x423abaa to 0x423ad23, (0x179 bytes) 2024-09-21T22:18:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:5512 writesame 0x2148883 thru 0x2154fe3 data_size 0x1(0xc761 bytes) 2024-09-21T22:18:01.507 INFO:teuthology.orchestra.run.smithi134.stdout:5513 write 0xc77b31 thru 0xc7eaa0 (0x6f70 bytes) 2024-09-21T22:18:01.511 INFO:teuthology.orchestra.run.smithi134.stdout:5514 write 0xcec778a thru 0xced4c2b (0xd4a2 bytes) 2024-09-21T22:18:01.521 INFO:teuthology.orchestra.run.smithi134.stdout:5515 trunc from 0xd2b5198 to 0x72696fd 2024-09-21T22:18:01.532 INFO:teuthology.orchestra.run.smithi134.stdout:5516 read 0x3abfe49 thru 0x3ac610c (0x62c4 bytes) 2024-09-21T22:18:01.532 INFO:teuthology.orchestra.run.smithi134.stdout:5517 read 0x372d89f thru 0x3736952 (0x90b4 bytes) 2024-09-21T22:18:01.532 INFO:teuthology.orchestra.run.smithi134.stdout:5518 read 0xe4737f thru 0xe52e60 (0xbae2 bytes) 2024-09-21T22:18:01.534 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:01.533+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:01.539 INFO:teuthology.orchestra.run.smithi134.stdout:5519 write 0x821659a thru 0x8219935 (0x339c bytes) 2024-09-21T22:18:01.549 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:01.549 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:01.549 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:01.550 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:01.550 INFO:teuthology.orchestra.run.smithi134.stdout:5521 writesame 0x9efc898 thru 0x9f0bbd5 data_size 0x41(0xf33e bytes) 2024-09-21T22:18:01.550 INFO:teuthology.orchestra.run.smithi134.stdout:5522 punch from 0x2727d1f to 0x27310dc, (0x93bd bytes) 2024-09-21T22:18:01.557 INFO:teuthology.orchestra.run.smithi134.stdout:5523 write 0xa256252 thru 0xa25aaf2 (0x48a1 bytes) 2024-09-21T22:18:01.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:01.560 INFO:teuthology.orchestra.run.smithi134.stdout:5525 writesame 0x67b2e5c thru 0x67bc4cb data_size 0x3a(0x9670 bytes) 2024-09-21T22:18:01.563 INFO:teuthology.orchestra.run.smithi134.stdout:5528 writesame 0xa081e1a thru 0xa08e26d data_size 0x23(0xc454 bytes) 2024-09-21T22:18:01.567 INFO:teuthology.orchestra.run.smithi134.stdout:5529 write 0x9603a9d thru 0x9603f38 (0x49c bytes) 2024-09-21T22:18:01.570 INFO:teuthology.orchestra.run.smithi134.stdout:5530 read 0x8b71ed6 thru 0x8b813e0 (0xf50b bytes) 2024-09-21T22:18:01.577 INFO:teuthology.orchestra.run.smithi134.stdout:5531 write 0xb27e214 thru 0xb28b9a3 (0xd790 bytes) 2024-09-21T22:18:01.582 INFO:teuthology.orchestra.run.smithi134.stdout:5532 read 0x2e7291d thru 0x2e730ef (0x7d3 bytes) 2024-09-21T22:18:01.582 INFO:teuthology.orchestra.run.smithi134.stdout:5533 read 0x796fcde thru 0x797941a (0x973d bytes) 2024-09-21T22:18:01.582 INFO:teuthology.orchestra.run.smithi134.stdout:5534 punch from 0x3c852f to 0x3cc2da, (0x3dab bytes) 2024-09-21T22:18:01.594 INFO:teuthology.orchestra.run.smithi134.stdout:5536 trunc from 0xb28b9a4 to 0x9fd18d 2024-09-21T22:18:01.607 INFO:teuthology.orchestra.run.smithi134.stdout:5538 read 0x394980 thru 0x397a17 (0x3098 bytes) 2024-09-21T22:18:01.612 INFO:teuthology.orchestra.run.smithi134.stdout:5539 trunc from 0x9fd18d to 0x50e7acf 2024-09-21T22:18:01.634 INFO:teuthology.orchestra.run.smithi134.stdout:5540 write 0xaae56d1 thru 0xaaf5050 (0xf980 bytes) 2024-09-21T22:18:01.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:01.633+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:01.645 INFO:teuthology.orchestra.run.smithi134.stdout:5542 write 0xc48100b thru 0xc48e5ba (0xd5b0 bytes) 2024-09-21T22:18:01.655 INFO:teuthology.orchestra.run.smithi134.stdout:5543 writesame 0xcfa693e thru 0xcfb398a data_size 0x87(0xd04d bytes) 2024-09-21T22:18:01.655 INFO:teuthology.orchestra.run.smithi134.stdout:5545 read 0x6fb60fc thru 0x6fbcc81 (0x6b86 bytes) 2024-09-21T22:18:01.655 INFO:teuthology.orchestra.run.smithi134.stdout:5546 read 0xa3fe652 thru 0xa402824 (0x41d3 bytes) 2024-09-21T22:18:01.655 INFO:teuthology.orchestra.run.smithi134.stdout:5547 write 0x993bb3 thru 0x997ec1 (0x430f bytes) 2024-09-21T22:18:01.658 INFO:teuthology.orchestra.run.smithi134.stdout:5548 read 0x5b71af8 thru 0x5b7648b (0x4994 bytes) 2024-09-21T22:18:01.659 INFO:teuthology.orchestra.run.smithi134.stdout:5549 read 0x6103d1 thru 0x614097 (0x3cc7 bytes) 2024-09-21T22:18:01.659 INFO:teuthology.orchestra.run.smithi134.stdout:5552 read 0x89f324d thru 0x89f35de (0x392 bytes) 2024-09-21T22:18:01.659 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.659 INFO:teuthology.orchestra.run.smithi134.stdout:5554 write 0x1b4c216 thru 0x1b4c254 (0x3f bytes) 2024-09-21T22:18:01.661 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.661 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.666 INFO:teuthology.orchestra.run.smithi134.stdout:5558 writesame 0xd019768 thru 0xd019e33 data_size 0x6(0x6cc bytes) 2024-09-21T22:18:01.666 INFO:teuthology.orchestra.run.smithi134.stdout:5559 writesame 0x4a0ab44 thru 0x4a0d8ff data_size 0x2(0x2dbc bytes) 2024-09-21T22:18:01.669 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:01.669 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:01.670 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:01.670 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:01.670 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:01.671 INFO:teuthology.orchestra.run.smithi134.stdout:5560 write 0xe7ddda thru 0xe88efc (0xb123 bytes) 2024-09-21T22:18:01.675 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.676 INFO:teuthology.orchestra.run.smithi134.stdout:5562 read 0x8cddea2 thru 0x8ceb815 (0xd974 bytes) 2024-09-21T22:18:01.676 INFO:teuthology.orchestra.run.smithi134.stdout:5563 punch from 0xb3e5031 to 0xb3f4763, (0xf732 bytes) 2024-09-21T22:18:01.676 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.676 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.679 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:01.686 INFO:teuthology.orchestra.run.smithi134.stdout:5566 trunc from 0xd019e34 to 0x45633e8 2024-09-21T22:18:01.696 INFO:teuthology.orchestra.run.smithi134.stdout:5567 read 0xd9dd44 thru 0xda4627 (0x68e4 bytes) 2024-09-21T22:18:01.714 INFO:teuthology.orchestra.run.smithi134.stdout:5569 write 0xe1d7e93 thru 0xe1e727f (0xf3ed bytes) 2024-09-21T22:18:01.719 INFO:teuthology.orchestra.run.smithi134.stdout:5570 write 0xa593b1a thru 0xa5a3354 (0xf83b bytes) 2024-09-21T22:18:01.725 INFO:teuthology.orchestra.run.smithi134.stdout:5571 read 0x5919e10 thru 0x591db1d (0x3d0e bytes) 2024-09-21T22:18:01.725 INFO:teuthology.orchestra.run.smithi134.stdout:5572 write 0x7a4e792 thru 0x7a56cb4 (0x8523 bytes) 2024-09-21T22:18:01.735 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:01.733+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:01.740 INFO:teuthology.orchestra.run.smithi134.stdout:5573 trunc from 0xe1e7280 to 0x3fd5d88 2024-09-21T22:18:01.751 INFO:teuthology.orchestra.run.smithi134.stdout:5574 read 0x23e367d thru 0x23f246f (0xedf3 bytes) 2024-09-21T22:18:01.760 INFO:teuthology.orchestra.run.smithi134.stdout:5575 trunc from 0x3fd5d88 to 0xb261fcd 2024-09-21T22:18:01.767 INFO:teuthology.orchestra.run.smithi134.stdout:5576 read 0x9cff781 thru 0x9d0f51e (0xfd9e bytes) 2024-09-21T22:18:01.767 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.767 INFO:teuthology.orchestra.run.smithi134.stdout:5578 punch from 0x19c7d09 to 0x19d3c1d, (0xbf14 bytes) 2024-09-21T22:18:01.767 INFO:teuthology.orchestra.run.smithi134.stdout:5580 punch from 0x5100015 to 0x51078b0, (0x789b bytes) 2024-09-21T22:18:01.767 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.774 INFO:teuthology.orchestra.run.smithi134.stdout:5584 write 0xcdea09d thru 0xcdefbf1 (0x5b55 bytes) 2024-09-21T22:18:01.779 INFO:teuthology.orchestra.run.smithi134.stdout:5585 trunc from 0xcdefbf2 to 0xc6af29a 2024-09-21T22:18:01.789 INFO:teuthology.orchestra.run.smithi134.stdout:5586 punch from 0x45acdb0 to 0x45b055e, (0x37ae bytes) 2024-09-21T22:18:01.790 INFO:teuthology.orchestra.run.smithi134.stdout:5590 read 0x71cba6d thru 0x71cd88f (0x1e23 bytes) 2024-09-21T22:18:01.792 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:01.792 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:01.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:01.792 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:01.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.792 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:01.792 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.59156511, 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.589689229, 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.798 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:01.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:01.802 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 73.826363881999995, 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.803 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:01.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:01.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:01.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:01.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:01.809 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.974038090000001, 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:01.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.813 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.814 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.698501475, 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.816 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.817 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.818 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:01.819 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:01.820 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.821 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.366845831999999, 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.822 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:01.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:01.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.8619430500000007, 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.828 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.832 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.86191773, 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:01.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.8618832009999995, 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:01.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:01.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.8618396419999996, 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.841 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:01.845 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.8618141799999997, 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:01.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:01.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:01.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.849 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.8617969730000006, 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.850 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:01.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.7917288899999999, 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.854 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.858 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.7917055079999997, 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:01.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:01.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.863 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.791685738, 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:01.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.868 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.7916668019999999, 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:01.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:01.872 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 8.7916468590000001, 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.873 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:01.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:01.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.6463073010000002, 2024-09-21T22:18:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:01.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.6191007649999998, 2024-09-21T22:18:01.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:01.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:01.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:01.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.6027339290000002, 2024-09-21T22:18:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:01.894 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:01.896 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:01.896 INFO:teuthology.orchestra.run.smithi134.stdout:5591 trunc from 0xc6af29a to 0x77a8f2e 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5592 write 0x84c3386 thru 0x84d2c60 (0xf8db bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5593 writesame 0xcaf0d36 thru 0xcaf9b6f data_size 0x16(0x8e3a bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5595 read 0x2b6cff7 thru 0x2b769aa (0x99b4 bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5596 write 0xe5119ad thru 0xe5121a4 (0x7f8 bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5597 trunc from 0xe5121a5 to 0x425f031 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5598 punch from 0x2fcaebd to 0x2fd8a3a, (0xdb7d bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5601 trunc from 0x425f031 to 0x3e63532 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5602 write 0x76ed8bf thru 0x76fa301 (0xca43 bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5603 read 0x30d46ed thru 0x30d521a (0xb2e bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5606 writesame 0xcf64ec2 thru 0xcf65cc2 data_size 0x5(0xe01 bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5607 read 0x20fbdda thru 0x210a5c3 (0xe7ea bytes) 2024-09-21T22:18:01.897 INFO:teuthology.orchestra.run.smithi134.stdout:5608 trunc from 0xcf65cc3 to 0x7ea7e04 2024-09-21T22:18:01.898 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:01.894+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:01.900 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 0.88846 (e372) 2024-09-21T22:18:01.902 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:01.902 INFO:teuthology.orchestra.run.smithi134.stdout:5611 read 0x54a7438 thru 0x54b52cc (0xde95 bytes) 2024-09-21T22:18:01.907 INFO:teuthology.orchestra.run.smithi134.stdout:5613 trunc from 0x7ea7e04 to 0x40a8666 2024-09-21T22:18:01.930 INFO:teuthology.orchestra.run.smithi134.stdout:5614 trunc from 0x40a8666 to 0xec9d3a8 2024-09-21T22:18:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:5615 write 0x72dc00c thru 0x72e85f5 (0xc5ea bytes) 2024-09-21T22:18:01.940 INFO:teuthology.orchestra.run.smithi134.stdout:5616 read 0x46237fd thru 0x462a2bb (0x6abf bytes) 2024-09-21T22:18:01.941 INFO:teuthology.orchestra.run.smithi134.stdout:5619 read 0xd9e5b9b thru 0xd9f4158 (0xe5be bytes) 2024-09-21T22:18:01.941 INFO:teuthology.orchestra.run.smithi134.stdout:5620 read 0x4eb0ddd thru 0x4eb8156 (0x737a bytes) 2024-09-21T22:18:01.941 INFO:teuthology.orchestra.run.smithi134.stdout:5622 read 0xabbe35c thru 0xabc15d4 (0x3279 bytes) 2024-09-21T22:18:01.948 INFO:teuthology.orchestra.run.smithi134.stdout:5623 trunc from 0xec9d3a8 to 0x83670d9 2024-09-21T22:18:01.954 INFO:teuthology.orchestra.run.smithi134.stdout:5624 punch from 0x31f641e to 0x31f6732, (0x314 bytes) 2024-09-21T22:18:01.961 INFO:teuthology.orchestra.run.smithi134.stdout:5625 trunc from 0x83670d9 to 0x27f5957 2024-09-21T22:18:01.971 INFO:teuthology.orchestra.run.smithi134.stdout:5627 punch from 0x1ea55d8 to 0x1eb180b, (0xc233 bytes) 2024-09-21T22:18:01.971 INFO:teuthology.orchestra.run.smithi134.stdout:5629 read 0x17111cc thru 0x1718645 (0x747a bytes) 2024-09-21T22:18:01.989 INFO:teuthology.orchestra.run.smithi134.stdout:5630 writesame 0xc6158ee thru 0xc620e3d data_size 0x18(0xb550 bytes) 2024-09-21T22:18:01.989 INFO:teuthology.orchestra.run.smithi134.stdout:5631 read 0x282d8ca thru 0x2835629 (0x7d60 bytes) 2024-09-21T22:18:01.989 INFO:teuthology.orchestra.run.smithi134.stdout:5632 writesame 0xa6e33bc thru 0xa6ec44e data_size 0x49(0x9093 bytes) 2024-09-21T22:18:01.995 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:01.994+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:01.998 INFO:teuthology.orchestra.run.smithi134.stdout:5633 write 0xc77d3a8 thru 0xc7872e8 (0x9f41 bytes) 2024-09-21T22:18:02.004 INFO:teuthology.orchestra.run.smithi134.stdout:5634 write 0xb775d23 thru 0xb7807a3 (0xaa81 bytes) 2024-09-21T22:18:02.008 INFO:teuthology.orchestra.run.smithi134.stdout:5635 read 0x6a3d09c thru 0x6a45be3 (0x8b48 bytes) 2024-09-21T22:18:02.008 INFO:teuthology.orchestra.run.smithi134.stdout:5636 write 0x87904d thru 0x8869c6 (0xd97a bytes) 2024-09-21T22:18:02.016 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:02.023 INFO:teuthology.orchestra.run.smithi134.stdout:5639 write 0xd35d513 thru 0xd366c8c (0x977a bytes) 2024-09-21T22:18:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:5640 read 0x37fc83e thru 0x37ff7ab (0x2f6e bytes) 2024-09-21T22:18:02.032 INFO:teuthology.orchestra.run.smithi134.stdout:5641 trunc from 0xd366c8d to 0x9398a9d 2024-09-21T22:18:02.045 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:02.045 INFO:teuthology.orchestra.run.smithi134.stdout:5643 read 0xe2de5c thru 0xe31f62 (0x4107 bytes) 2024-09-21T22:18:02.045 INFO:teuthology.orchestra.run.smithi134.stdout:5644 read 0x46923e3 thru 0x4692df6 (0xa14 bytes) 2024-09-21T22:18:02.050 INFO:teuthology.orchestra.run.smithi134.stdout:5645 trunc from 0x9398a9d to 0xd7f8b80 2024-09-21T22:18:02.053 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:02.053 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:02.053 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:02.053 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:02.062 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:02.067 INFO:teuthology.orchestra.run.smithi134.stdout:5646 trunc from 0xd7f8b80 to 0x51ea657 2024-09-21T22:18:02.074 INFO:teuthology.orchestra.run.smithi134.stdout:5647 writesame 0x16df455 thru 0x16e494d data_size 0x3(0x54f9 bytes) 2024-09-21T22:18:02.081 INFO:teuthology.orchestra.run.smithi134.stdout:5648 writesame 0x2680058 thru 0x268d524 data_size 0x3(0xd4cd bytes) 2024-09-21T22:18:02.093 INFO:teuthology.orchestra.run.smithi134.stdout:5649 punch from 0x2d4b491 to 0x2d5500c, (0x9b7b bytes) 2024-09-21T22:18:02.093 INFO:teuthology.orchestra.run.smithi134.stdout:5650 read 0x4f4651 thru 0x4fc71f (0x80cf bytes) 2024-09-21T22:18:02.093 INFO:teuthology.orchestra.run.smithi134.stdout:5652 write 0x29ca546 thru 0x29d34b7 (0x8f72 bytes) 2024-09-21T22:18:02.096 INFO:teuthology.orchestra.run.smithi134.stdout:5654 clone 35 order 21 su 16384 sc 7 2024-09-21T22:18:02.104 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:02.102+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:02.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:18:02.197 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:02.195+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:02.207 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:02.207 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:02.208 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:02.208 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:02.208 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:02.217 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:02.297 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:02.296+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:02.361 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412393693, 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.362 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.41237433000001, 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:02.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412341682, 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:02.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:02.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:02.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412290515, 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.41226384300001, 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:02.383 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412239044, 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:02.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412208096, 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.41218387799999, 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:02.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412159526, 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.396 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:02.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:02.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412135283, 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.400 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:02.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.404 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412105548, 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:02.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:02.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 117.412070078, 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.409 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:02.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:02.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.374538873000006, 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.413 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.181671214000005, 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:02.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:02.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:02.422 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.176304681999994, 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.158739889000003, 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.427 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:02.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.126358895999999, 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.432 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:02.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:02.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.078555449999996, 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:02.436 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.442 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.1717381290000004, 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:02.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:02.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:02.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 6.164655497, 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:02.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:02.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:02.451 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:02.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:02.453 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:02.451+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:02.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:02.553 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:02.551+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:02.557 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:02.558 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:02.558 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:02.567 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:02.644 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:02.645 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:02.654 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:02.653+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:02.661 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:02.661 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:02.677 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:02.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:02.693 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:02.710 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:02.710 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:02.710 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:02.710 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:02.710 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:02.710 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:02.711 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:02.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:02.727 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:02.727 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:02.743 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:02.743 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:02.754 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:02.753+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:02.759 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:02.759 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:02.822 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:02.822 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:02.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:02.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:02.854+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:02.898 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:18:02.938 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:02.938 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:02.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:02.992 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:02.990+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:03.051 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:03.051 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:03.057 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:03.055+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:03.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:03.157 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:03.156+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:03.204 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:03.204 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:03.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:03.259 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:03.257+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:03.328 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:03.328 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:03.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:03.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:03.380+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:03.441 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:03.441 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:03.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:03.460 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:03.459+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:03.562 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:03.561+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:03.594 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:03.594 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:03.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:03.688 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:03.687+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:03.748 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:03.748 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:03.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:03.763 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:03.762+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:03.864 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:03.863+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:03.902 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:03.902 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:03.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:03.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:03.997+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:04.065 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:04.063+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:04.067 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.067 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:04.166 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:04.165+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:04.219 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.219 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:04.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:04.271+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:04.331 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.331 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:04.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:04.380+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:04.469 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:04.467+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:04.483 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.483 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:04.569 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:04.568+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:04.595 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.595 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:04.671 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:04.670+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:04.706 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.706 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.714 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:04.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:04.772 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:04.771+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:04.819 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.819 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:04.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:04.872+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:04.892 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:04.892 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:04.911 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:04.911 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:04.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:18:04.930 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:04.930 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:04.948 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:04.949 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:04.952 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:04.952 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:04.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:04.965 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:04.983 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:04.983 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:04.990 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-21T22:18:05.005 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:05.004+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:05.014 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:05.015 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:05.033 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:05.034 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:05.071 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:05.071 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:05.075 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:05.074+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:05.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:05.176 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:05.175+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:05.225 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 110.02520111, 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.226 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:05.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 110.02332522899999, 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.236 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.259999882000002, 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:05.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:05.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.241 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 63.40767409, 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.242 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:05.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:05.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 63.132137475, 2024-09-21T22:18:05.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 17.800481831999999, 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.253 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:05.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:05.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.258 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.295579050000001, 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:05.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:05.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.29555373, 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.263 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.295519200999999, 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.267 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:05.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.271 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.295475642, 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.29545018, 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.295432973, 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.280 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:05.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:05.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.22536489, 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.225341508, 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.288 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.225321738, 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.292 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.225302802, 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:05.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:05.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:05.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 12.225282859, 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:05.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.0799433010000001, 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.306 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:05.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:05.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.0527367650000006, 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.312 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.0363699289999992, 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.317 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:05.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.321 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:05.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5656 punch from 0x4b89987 to 0x4b9136c, (0x79e5 bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5657 write 0x656bbfc thru 0x657b1a2 (0xf5a7 bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5658 read 0x50bf69 thru 0x5133e5 (0x747d bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5659 read 0x531928b thru 0x5321503 (0x8279 bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5660 write 0x48cb57 thru 0x499f7c (0xd426 bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5661 read 0x21c7c0e thru 0x21cd181 (0x5574 bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5664 read 0x75d47a thru 0x764562 (0x70e9 bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5665 read 0x33ee98c thru 0x33f84dd (0x9b52 bytes) 2024-09-21T22:18:05.326 INFO:teuthology.orchestra.run.smithi134.stdout:5669 punch from 0x263c897 to 0x2645ace, (0x9237 bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5670 read 0x454bf4a thru 0x4557793 (0xb84a bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5673 read 0x623a085 thru 0x6241c52 (0x7bce bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5675 read 0x15576b1 thru 0x1561cd3 (0xa623 bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5681 trunc from 0x657b1a3 to 0x775964c 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5683 write 0x92e4781 thru 0x92e5bdc (0x145c bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5684 read 0x1385cb8 thru 0x1390233 (0xa57c bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5685 read 0x8144490 thru 0x814467f (0x1f0 bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5687 read 0x16425fe thru 0x1647ed2 (0x58d5 bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5688 read 0x5cb73af thru 0x5cbd06e (0x5cc0 bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5689 trunc from 0x92e5bdd to 0x57818a3 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5691 punch from 0x1188ad9 to 0x118f78c, (0x6cb3 bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5693 writesame 0xb256305 thru 0xb25bc8e data_size 0x49(0x598a bytes) 2024-09-21T22:18:05.327 INFO:teuthology.orchestra.run.smithi134.stdout:5694 read 0x99d1a40 thru 0x99d6cbc (0x527d bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5695 read 0xa4cc87d thru 0xa4cd904 (0x1088 bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5696 writesame 0xb322c77 thru 0xb329ef7 data_size 0x3(0x7281 bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5697 punch from 0x94cde6e to 0x94d0e6d, (0x2fff bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5698 punch from 0xa15d686 to 0xa161cf4, (0x466e bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5699 write 0x699b0e7 thru 0x69a0193 (0x50ad bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5701 punch from 0x3a6e122 to 0x3a70339, (0x2217 bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5702 punch from 0x4eabb78 to 0x4eb45c5, (0x8a4d bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5704 write 0x1b363a5 thru 0x1b3e867 (0x84c3 bytes) 2024-09-21T22:18:05.328 INFO:teuthology.orchestra.run.smithi134.stdout:5705 trunc from 0xb329ef8 to 0x5201559 2024-09-21T22:18:05.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:05.322+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:05.332 INFO:teuthology.orchestra.run.smithi134.stdout:5706 writesame 0x285131d thru 0x285a59b data_size 0x1b(0x927f bytes) 2024-09-21T22:18:05.344 INFO:teuthology.orchestra.run.smithi134.stdout:5707 write 0x91b13d9 thru 0x91b5924 (0x454c bytes) 2024-09-21T22:18:05.348 INFO:teuthology.orchestra.run.smithi134.stdout:5708 writesame 0x40cc4d4 thru 0x40d5c35 data_size 0x9(0x9762 bytes) 2024-09-21T22:18:05.354 INFO:teuthology.orchestra.run.smithi134.stdout:5709 write 0x49e31e7 thru 0x49e8334 (0x514e bytes) 2024-09-21T22:18:05.358 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.364 INFO:teuthology.orchestra.run.smithi134.stdout:5715 trunc from 0x91b5925 to 0xe24000e 2024-09-21T22:18:05.370 INFO:teuthology.orchestra.run.smithi134.stdout:5716 punch from 0xc025693 to 0xc02f0b0, (0x9a1d bytes) 2024-09-21T22:18:05.370 INFO:teuthology.orchestra.run.smithi134.stdout:5717 write 0x68a8720 thru 0x68af2c5 (0x6ba6 bytes) 2024-09-21T22:18:05.374 INFO:teuthology.orchestra.run.smithi134.stdout:5718 punch from 0x44df9a7 to 0x44e8104, (0x875d bytes) 2024-09-21T22:18:05.374 INFO:teuthology.orchestra.run.smithi134.stdout:5719 read 0x1acedf5 thru 0x1adc3bd (0xd5c9 bytes) 2024-09-21T22:18:05.384 INFO:teuthology.orchestra.run.smithi134.stdout:5720 trunc from 0xe24000e to 0x6866157 2024-09-21T22:18:05.395 INFO:teuthology.orchestra.run.smithi134.stdout:5722 read 0x5e8931e thru 0x5e8cc2a (0x390d bytes) 2024-09-21T22:18:05.395 INFO:teuthology.orchestra.run.smithi134.stdout:5723 read 0x55c3001 thru 0x55cd1da (0xa1da bytes) 2024-09-21T22:18:05.396 INFO:teuthology.orchestra.run.smithi134.stdout:5724 read 0x52abc3a thru 0x52bacf7 (0xf0be bytes) 2024-09-21T22:18:05.396 INFO:teuthology.orchestra.run.smithi134.stdout:5725 write 0x30a851c thru 0x30aa1cd (0x1cb2 bytes) 2024-09-21T22:18:05.407 INFO:teuthology.orchestra.run.smithi134.stdout:5726 write 0x7d9d332 thru 0x7da6e15 (0x9ae4 bytes) 2024-09-21T22:18:05.412 INFO:teuthology.orchestra.run.smithi134.stdout:5727 write 0x66ffbd thru 0x6708d0 (0x914 bytes) 2024-09-21T22:18:05.414 INFO:teuthology.orchestra.run.smithi134.stdout:5729 punch from 0x371db8b to 0x372b35c, (0xd7d1 bytes) 2024-09-21T22:18:05.423 INFO:teuthology.orchestra.run.smithi134.stdout:5730 write 0x9958c46 thru 0x9961990 (0x8d4b bytes) 2024-09-21T22:18:05.424 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:05.422+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:05.428 INFO:teuthology.orchestra.run.smithi134.stdout:5731 write 0x19b5125 thru 0x19c11e3 (0xc0bf bytes) 2024-09-21T22:18:05.430 INFO:teuthology.orchestra.run.smithi134.stdout:5732 punch from 0x3404d6d to 0x340b59c, (0x682f bytes) 2024-09-21T22:18:05.430 INFO:teuthology.orchestra.run.smithi134.stdout:5734 read 0x241858b thru 0x24192bc (0xd32 bytes) 2024-09-21T22:18:05.439 INFO:teuthology.orchestra.run.smithi134.stdout:5736 write 0xc859991 thru 0xc863754 (0x9dc4 bytes) 2024-09-21T22:18:05.448 INFO:teuthology.orchestra.run.smithi134.stdout:5737 write 0xc9c9747 thru 0xc9d0a77 (0x7331 bytes) 2024-09-21T22:18:05.451 INFO:teuthology.orchestra.run.smithi134.stdout:5739 read 0x96033bb thru 0x9603bf5 (0x83b bytes) 2024-09-21T22:18:05.451 INFO:teuthology.orchestra.run.smithi134.stdout:5741 read 0x6f79ca7 thru 0x6f7dbb9 (0x3f13 bytes) 2024-09-21T22:18:05.456 INFO:teuthology.orchestra.run.smithi134.stdout:5743 write 0xd0a4a49 thru 0xd0ae7a2 (0x9d5a bytes) 2024-09-21T22:18:05.459 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.459 INFO:teuthology.orchestra.run.smithi134.stdout:5745 read 0x611abcf thru 0x6126ac8 (0xbefa bytes) 2024-09-21T22:18:05.459 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.459 INFO:teuthology.orchestra.run.smithi134.stdout:5747 read 0xcc62bfd thru 0xcc6bdc8 (0x91cc bytes) 2024-09-21T22:18:05.460 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.464 INFO:teuthology.orchestra.run.smithi134.stdout:5749 trunc from 0xd0ae7a3 to 0x915f844 2024-09-21T22:18:05.477 INFO:teuthology.orchestra.run.smithi134.stdout:5750 read 0x7911b43 thru 0x791d1d5 (0xb693 bytes) 2024-09-21T22:18:05.477 INFO:teuthology.orchestra.run.smithi134.stdout:5751 writesame 0x6802525 thru 0x680dbb6 data_size 0x1(0xb692 bytes) 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:206676 3.c e164/101 3:33e96702:::rbd_data.1185de112617.0000000000000031:head v 164'416, mlcod=164'414)", 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:05.481175+0000", 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 0.0011508060000000001, 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001168898, 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481175+0000", 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481175+0000", 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481176+0000", 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481569+0000", 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039271599999999999 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481581+0000", 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1939999999999999e-05 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481587+0000", 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.815e-06 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481645+0000", 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7083999999999998e-05 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:05.481669+0000", 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4933999999999999e-05 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: ], 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 1 2024-09-21T22:18:05.486 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:05.490 INFO:teuthology.orchestra.run.smithi134.stdout:5752 read 0x9addc4 thru 0x9b1448 (0x3685 bytes) 2024-09-21T22:18:05.492 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:05.497 INFO:teuthology.orchestra.run.smithi134.stdout:5753 writesame 0x969d2a5 thru 0x96ab452 data_size 0x3(0xe1ae bytes) 2024-09-21T22:18:05.498 INFO:teuthology.orchestra.run.smithi134.stdout:5755 write 0x66646a1 thru 0x6664d4f (0x6af bytes) 2024-09-21T22:18:05.503 INFO:teuthology.orchestra.run.smithi134.stdout:5756 trunc from 0x96ab453 to 0x61b7584 2024-09-21T22:18:05.516 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.516 INFO:teuthology.orchestra.run.smithi134.stdout:5759 read 0x1d42089 thru 0x1d4d4fb (0xb473 bytes) 2024-09-21T22:18:05.516 INFO:teuthology.orchestra.run.smithi134.stdout:5760 read 0x1651fa0 thru 0x1656f06 (0x4f67 bytes) 2024-09-21T22:18:05.516 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.524 INFO:teuthology.orchestra.run.smithi134.stdout:5762 trunc from 0x61b7584 to 0x26aa34 2024-09-21T22:18:05.534 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:05.532+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:05.539 INFO:teuthology.orchestra.run.smithi134.stdout:5764 read 0x2015ba thru 0x202cbd (0x1704 bytes) 2024-09-21T22:18:05.551 INFO:teuthology.orchestra.run.smithi134.stdout:5767 write 0x3f00a67 thru 0x3f058b8 (0x4e52 bytes) 2024-09-21T22:18:05.555 INFO:teuthology.orchestra.run.smithi134.stdout:5768 read 0x27fce91 thru 0x2805fe0 (0x9150 bytes) 2024-09-21T22:18:05.555 INFO:teuthology.orchestra.run.smithi134.stdout:5771 write 0x22c8f76 thru 0x22cc644 (0x36cf bytes) 2024-09-21T22:18:05.565 INFO:teuthology.orchestra.run.smithi134.stdout:5772 trunc from 0x3f058b9 to 0x9066412 2024-09-21T22:18:05.570 INFO:teuthology.orchestra.run.smithi134.stdout:5773 write 0x8a1406b thru 0x8a1d012 (0x8fa8 bytes) 2024-09-21T22:18:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:5774 punch from 0x59207ac to 0x592cdf8, (0xc64c bytes) 2024-09-21T22:18:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:5777 write 0x1929256 thru 0x1932afc (0x98a7 bytes) 2024-09-21T22:18:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:5778 punch from 0x56b0d5c to 0x56b5885, (0x4b29 bytes) 2024-09-21T22:18:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:5781 punch from 0x2daafe3 to 0x2dba5d4, (0xf5f1 bytes) 2024-09-21T22:18:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:5783 write 0x1f7c6c1 thru 0x1f88bf8 (0xc538 bytes) 2024-09-21T22:18:05.584 INFO:teuthology.orchestra.run.smithi134.stdout:5784 write 0x295ea14 thru 0x296cc08 (0xe1f5 bytes) 2024-09-21T22:18:05.589 INFO:teuthology.orchestra.run.smithi134.stdout:5785 read 0x62c3023 thru 0x62c9248 (0x6226 bytes) 2024-09-21T22:18:05.589 INFO:teuthology.orchestra.run.smithi134.stdout:5788 read 0x7d902ce thru 0x7d92f5e (0x2c91 bytes) 2024-09-21T22:18:05.589 INFO:teuthology.orchestra.run.smithi134.stdout:5789 punch from 0x8276803 to 0x8278ff0, (0x27ed bytes) 2024-09-21T22:18:05.589 INFO:teuthology.orchestra.run.smithi134.stdout:5791 write 0x7f279e8 thru 0x7f2b506 (0x3b1f bytes) 2024-09-21T22:18:05.591 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.591 INFO:teuthology.orchestra.run.smithi134.stdout:5793 writesame 0x385c573 thru 0x3860240 data_size 0x2(0x3cce bytes) 2024-09-21T22:18:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:5794 punch from 0x11fd51 to 0x12cae4, (0xcd93 bytes) 2024-09-21T22:18:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:5795 punch from 0x1b362da to 0x1b43753, (0xd479 bytes) 2024-09-21T22:18:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:5796 writesame 0x34a71b6 thru 0x34a9135 data_size 0x40(0x1f80 bytes) 2024-09-21T22:18:05.600 INFO:teuthology.orchestra.run.smithi134.stdout:5801 write 0x4a9dfec thru 0x4a9ed5f (0xd74 bytes) 2024-09-21T22:18:05.604 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.604 INFO:teuthology.orchestra.run.smithi134.stdout:5804 read 0x23c2f99 thru 0x23cd321 (0xa389 bytes) 2024-09-21T22:18:05.605 INFO:teuthology.orchestra.run.smithi134.stdout:5805 punch from 0x24cc4f9 to 0x24ce8de, (0x23e5 bytes) 2024-09-21T22:18:05.605 INFO:teuthology.orchestra.run.smithi134.stdout:5806 read 0x38089aa thru 0x3813acf (0xb126 bytes) 2024-09-21T22:18:05.605 INFO:teuthology.orchestra.run.smithi134.stdout:5808 punch from 0x5bba848 to 0x5bc8b90, (0xe348 bytes) 2024-09-21T22:18:05.610 INFO:teuthology.orchestra.run.smithi134.stdout:5809 trunc from 0x9066412 to 0x4db371f 2024-09-21T22:18:05.625 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:05.624+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:05.640 INFO:teuthology.orchestra.run.smithi134.stdout:5812 write 0xe62a100 thru 0xe62cea6 (0x2da7 bytes) 2024-09-21T22:18:05.643 INFO:teuthology.orchestra.run.smithi134.stdout:5813 write 0x994eb5d thru 0x995bdb4 (0xd258 bytes) 2024-09-21T22:18:05.649 INFO:teuthology.orchestra.run.smithi134.stdout:5814 write 0xc50a417 thru 0xc5107fc (0x63e6 bytes) 2024-09-21T22:18:05.651 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:05.651 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:05.651 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:05.651 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:05.651 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:05.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:05.664 INFO:teuthology.orchestra.run.smithi134.stdout:5816 trunc from 0xe62cea7 to 0x59765e9 2024-09-21T22:18:05.675 INFO:teuthology.orchestra.run.smithi134.stdout:5817 read 0x7c9bba thru 0x7d3e35 (0xa27c bytes) 2024-09-21T22:18:05.676 INFO:teuthology.orchestra.run.smithi134.stdout:5818 write 0x95e3 thru 0xafc9 (0x19e7 bytes) 2024-09-21T22:18:05.677 INFO:teuthology.orchestra.run.smithi134.stdout:5819 read 0x516d8fd thru 0x51780ec (0xa7f0 bytes) 2024-09-21T22:18:05.686 INFO:teuthology.orchestra.run.smithi134.stdout:5820 write 0x845d111 thru 0x846c5fa (0xf4ea bytes) 2024-09-21T22:18:05.691 INFO:teuthology.orchestra.run.smithi134.stdout:5822 write 0x10bbc4e thru 0x10c74b9 (0xb86c bytes) 2024-09-21T22:18:05.704 INFO:teuthology.orchestra.run.smithi134.stdout:5823 trunc from 0x846c5fb to 0xc4ea21 2024-09-21T22:18:05.730 INFO:teuthology.orchestra.run.smithi134.stdout:5824 write 0x32509b0 thru 0x325316e (0x27bf bytes) 2024-09-21T22:18:05.734 INFO:teuthology.orchestra.run.smithi134.stdout:5825 punch from 0x15b51be to 0x15bb695, (0x64d7 bytes) 2024-09-21T22:18:05.742 INFO:teuthology.orchestra.run.smithi134.stdout:5829 writesame 0x4c485ca thru 0x4c48cd2 data_size 0x1(0x709 bytes) 2024-09-21T22:18:05.742 INFO:teuthology.orchestra.run.smithi134.stdout:5832 read 0x390d719 thru 0x3917682 (0x9f6a bytes) 2024-09-21T22:18:05.742 INFO:teuthology.orchestra.run.smithi134.stdout:5833 write 0x3afbd15 thru 0x3b0352b (0x7817 bytes) 2024-09-21T22:18:05.745 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:05.744+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:05.746 INFO:teuthology.orchestra.run.smithi134.stdout:5834 writesame 0x356c7fc thru 0x3579fb7 data_size 0x2(0xd7bc bytes) 2024-09-21T22:18:05.764 INFO:teuthology.orchestra.run.smithi134.stdout:5835 trunc from 0x4c48cd3 to 0xc25def1 2024-09-21T22:18:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:5836 punch from 0xa9c798c to 0xa9cad7c, (0x33f0 bytes) 2024-09-21T22:18:05.779 INFO:teuthology.orchestra.run.smithi134.stdout:5837 trunc from 0xc25def1 to 0x50eb9b6 2024-09-21T22:18:05.800 INFO:teuthology.orchestra.run.smithi134.stdout:5838 write 0xbea27cb thru 0xbea6d38 (0x456e bytes) 2024-09-21T22:18:05.804 INFO:teuthology.orchestra.run.smithi134.stdout:5839 writesame 0x15dd01d thru 0x15dd0e6 data_size 0x2(0xca bytes) 2024-09-21T22:18:05.807 INFO:teuthology.orchestra.run.smithi134.stdout:5840 writesame 0x7979b02 thru 0x797acaf data_size 0x2(0x11ae bytes) 2024-09-21T22:18:05.811 INFO:teuthology.orchestra.run.smithi134.stdout:5841 write 0x92550af thru 0x92601f5 (0xb147 bytes) 2024-09-21T22:18:05.818 INFO:teuthology.orchestra.run.smithi134.stdout:5844 trunc from 0xbea6d39 to 0xa518e75 2024-09-21T22:18:05.821 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872505162, 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872485799, 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872453151, 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.87240198400001, 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:05.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872375312, 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:05.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:05.842 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872350513, 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.843 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872319565, 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.847 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:05.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:05.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872295347, 2024-09-21T22:18:05.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:05.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:05.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.87227099499999, 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:05.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872246752, 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.860 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:05.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:05.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872217017, 2024-09-21T22:18:05.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:05.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.872181547, 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.869 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:05.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.834650342000003, 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:05.873 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:05.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:05.877 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.641782683000002, 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:05.882 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.636416151000006, 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:05.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:05.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.618851358000001, 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:05.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.586470364999997, 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:05.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.538666918999994, 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.896 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.902 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.6318495980000005, 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:05.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:05.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:05.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.6247669659999993, 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:05.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:05.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:05.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:05.911 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:05.915 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:05.915 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:05.910+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:05.916 INFO:teuthology.orchestra.run.smithi134.stdout:5846 punch from 0x7e1e639 to 0x7e29bc7, (0xb58e bytes) 2024-09-21T22:18:05.916 INFO:teuthology.orchestra.run.smithi134.stdout:5847 read 0x54de5bb thru 0x54e5808 (0x724e bytes) 2024-09-21T22:18:05.916 INFO:teuthology.orchestra.run.smithi134.stdout:5848 write 0x283e2a2 thru 0x284d48b (0xf1ea bytes) 2024-09-21T22:18:05.916 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.916 INFO:teuthology.orchestra.run.smithi134.stdout:5851 read 0x136fdca thru 0x1375741 (0x5978 bytes) 2024-09-21T22:18:05.916 INFO:teuthology.orchestra.run.smithi134.stdout:5852 write 0x88ebd07 thru 0x88f2694 (0x698e bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5854 read 0x6dc914e thru 0x6dcc53a (0x33ed bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5855 write 0xd35c44 thru 0xd3a691 (0x4a4e bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5857 punch from 0x16493e2 to 0x164d09b, (0x3cb9 bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5858 trunc from 0xa518e75 to 0x4268da2 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5859 write 0x296080f thru 0x29673f9 (0x6beb bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5860 write 0xe39ba08 thru 0xe3a7379 (0xb972 bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5861 writesame 0x5211ba8 thru 0x522064c data_size 0x1(0xeaa5 bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5864 punch from 0x8c293cd to 0x8c2e6cc, (0x52ff bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5867 punch from 0xdd204da to 0xdd29db5, (0x98db bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5868 read 0x2d291aa thru 0x2d33067 (0x9ebe bytes) 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:5870 trunc from 0xe3a737a to 0x524ba63 2024-09-21T22:18:05.917 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:18:05.926 INFO:teuthology.orchestra.run.smithi134.stdout:5872 trunc from 0x524ba63 to 0x50bef91 2024-09-21T22:18:05.934 INFO:teuthology.orchestra.run.smithi134.stdout:5873 write 0x2c6eadf thru 0x2c756e0 (0x6c02 bytes) 2024-09-21T22:18:05.937 INFO:teuthology.orchestra.run.smithi134.stdout:5874 punch from 0x234c40e to 0x23521a6, (0x5d98 bytes) 2024-09-21T22:18:05.937 INFO:teuthology.orchestra.run.smithi134.stdout:5875 write 0x3979617 thru 0x397fa78 (0x6462 bytes) 2024-09-21T22:18:05.940 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.952 INFO:teuthology.orchestra.run.smithi134.stdout:5878 writesame 0xa9338c1 thru 0xa935850 data_size 0x10(0x1f90 bytes) 2024-09-21T22:18:05.953 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:05.959 INFO:teuthology.orchestra.run.smithi134.stdout:5880 write 0xb7c8fc4 thru 0xb7ccc7e (0x3cbb bytes) 2024-09-21T22:18:05.967 INFO:teuthology.orchestra.run.smithi134.stdout:5882 trunc from 0xb7ccc7f to 0x7bfa9ce 2024-09-21T22:18:05.978 INFO:teuthology.orchestra.run.smithi134.stdout:5883 write 0x6f8c3cd thru 0x6f94ea4 (0x8ad8 bytes) 2024-09-21T22:18:05.983 INFO:teuthology.orchestra.run.smithi134.stdout:5884 read 0x755ebab thru 0x7569ea2 (0xb2f8 bytes) 2024-09-21T22:18:05.983 INFO:teuthology.orchestra.run.smithi134.stdout:5885 writesame 0xda93fa thru 0xdafc03 data_size 0x17(0x680a bytes) 2024-09-21T22:18:05.986 INFO:teuthology.orchestra.run.smithi134.stdout:5887 write 0x3161685 thru 0x316c32e (0xacaa bytes) 2024-09-21T22:18:05.988 INFO:teuthology.orchestra.run.smithi134.stdout:5888 write 0x4be190b thru 0x4be7fda (0x66d0 bytes) 2024-09-21T22:18:06.000 INFO:teuthology.orchestra.run.smithi134.stdout:5889 writesame 0xab2add4 thru 0xab3ab58 data_size 0x1(0xfd85 bytes) 2024-09-21T22:18:06.001 INFO:teuthology.orchestra.run.smithi134.stdout:5890 write 0x8b73c1a thru 0x8b78f6a (0x5351 bytes) 2024-09-21T22:18:06.005 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.005 INFO:teuthology.orchestra.run.smithi134.stdout:5892 writesame 0x6a73532 thru 0x6a803e0 data_size 0x3(0xceaf bytes) 2024-09-21T22:18:06.013 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:06.011+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:06.016 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.016 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.023 INFO:teuthology.orchestra.run.smithi134.stdout:5895 write 0xb7a5433 thru 0xb7a6462 (0x1030 bytes) 2024-09-21T22:18:06.027 INFO:teuthology.orchestra.run.smithi134.stdout:5896 punch from 0x7849d86 to 0x7852c2a, (0x8ea4 bytes) 2024-09-21T22:18:06.037 INFO:teuthology.orchestra.run.smithi134.stdout:5899 writesame 0xe8f6dbd thru 0xe8fe3cb data_size 0x1(0x760f bytes) 2024-09-21T22:18:06.037 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.037 INFO:teuthology.orchestra.run.smithi134.stdout:5901 punch from 0x8cafd5e to 0x8cb97ce, (0x9a70 bytes) 2024-09-21T22:18:06.037 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.037 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.053 INFO:teuthology.orchestra.run.smithi134.stdout:5904 trunc from 0xe8fe3cc to 0xc39581 2024-09-21T22:18:06.071 INFO:teuthology.orchestra.run.smithi134.stdout:5905 punch from 0x6ba677 to 0x6c0526, (0x5eaf bytes) 2024-09-21T22:18:06.072 INFO:teuthology.orchestra.run.smithi134.stdout:5906 read 0x19dc37 thru 0x1ab64a (0xda14 bytes) 2024-09-21T22:18:06.072 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.072 INFO:teuthology.orchestra.run.smithi134.stdout:5910 read 0x7fec99 thru 0x803a52 (0x4dba bytes) 2024-09-21T22:18:06.073 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.073 INFO:teuthology.orchestra.run.smithi134.stdout:5913 read 0x12d20e thru 0x12d772 (0x565 bytes) 2024-09-21T22:18:06.074 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:06.074 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:06.074 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:06.074 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:06.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:06.085 INFO:teuthology.orchestra.run.smithi134.stdout:5915 writesame 0x46d225f thru 0x46d945c data_size 0x1(0x71fe bytes) 2024-09-21T22:18:06.085 INFO:teuthology.orchestra.run.smithi134.stdout:5917 punch from 0x3c5bd09 to 0x3c66c47, (0xaf3e bytes) 2024-09-21T22:18:06.085 INFO:teuthology.orchestra.run.smithi134.stdout:5918 read 0x2b1f08a thru 0x2b27c62 (0x8bd9 bytes) 2024-09-21T22:18:06.085 INFO:teuthology.orchestra.run.smithi134.stdout:5921 read 0x20510fc thru 0x205bc19 (0xab1e bytes) 2024-09-21T22:18:06.086 INFO:teuthology.orchestra.run.smithi134.stdout:5922 read 0x1599914 thru 0x15a012e (0x681b bytes) 2024-09-21T22:18:06.098 INFO:teuthology.orchestra.run.smithi134.stdout:5923 write 0xa9eefa6 thru 0xa9f213d (0x3198 bytes) 2024-09-21T22:18:06.102 INFO:teuthology.orchestra.run.smithi134.stdout:5925 read 0x3b47bf4 thru 0x3b55b99 (0xdfa6 bytes) 2024-09-21T22:18:06.112 INFO:teuthology.orchestra.run.smithi134.stdout:5927 trunc from 0xa9f213e to 0x277022a 2024-09-21T22:18:06.123 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.123 INFO:teuthology.orchestra.run.smithi134.stdout:5929 punch from 0x910512 to 0x91935f, (0x8e4d bytes) 2024-09-21T22:18:06.125 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:06.123+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:06.133 INFO:teuthology.orchestra.run.smithi134.stdout:5930 trunc from 0x277022a to 0xb81b2b9 2024-09-21T22:18:06.140 INFO:teuthology.orchestra.run.smithi134.stdout:5934 punch from 0x6a5993e to 0x6a650cd, (0xb78f bytes) 2024-09-21T22:18:06.140 INFO:teuthology.orchestra.run.smithi134.stdout:5935 write 0x6915d6d thru 0x69181f8 (0x248c bytes) 2024-09-21T22:18:06.144 INFO:teuthology.orchestra.run.smithi134.stdout:5936 write 0x7fb51fc thru 0x7fbedec (0x9bf1 bytes) 2024-09-21T22:18:06.148 INFO:teuthology.orchestra.run.smithi134.stdout:5937 read 0x46e5bae thru 0x46efa51 (0x9ea4 bytes) 2024-09-21T22:18:06.148 INFO:teuthology.orchestra.run.smithi134.stdout:5939 write 0x1441666 thru 0x1444a17 (0x33b2 bytes) 2024-09-21T22:18:06.152 INFO:teuthology.orchestra.run.smithi134.stdout:5940 write 0x107f168 thru 0x108a902 (0xb79b bytes) 2024-09-21T22:18:06.157 INFO:teuthology.orchestra.run.smithi134.stdout:5941 write 0xafd745a thru 0xafdd430 (0x5fd7 bytes) 2024-09-21T22:18:06.162 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.162 INFO:teuthology.orchestra.run.smithi134.stdout:5946 punch from 0xb731355 to 0xb73c7f8, (0xb4a3 bytes) 2024-09-21T22:18:06.162 INFO:teuthology.orchestra.run.smithi134.stdout:5947 read 0xb0f8da4 thru 0xb106aaf (0xdd0c bytes) 2024-09-21T22:18:06.162 INFO:teuthology.orchestra.run.smithi134.stdout:5948 read 0x10ca074 thru 0x10d5299 (0xb226 bytes) 2024-09-21T22:18:06.169 INFO:teuthology.orchestra.run.smithi134.stdout:5949 write 0xcd8b679 thru 0xcd900d3 (0x4a5b bytes) 2024-09-21T22:18:06.173 INFO:teuthology.orchestra.run.smithi134.stdout:5950 writesame 0xc5e7595 thru 0xc5f4329 data_size 0x3(0xcd95 bytes) 2024-09-21T22:18:06.184 INFO:teuthology.orchestra.run.smithi134.stdout:5953 read 0xbc2a1a2 thru 0xbc2d6df (0x353e bytes) 2024-09-21T22:18:06.184 INFO:teuthology.orchestra.run.smithi134.stdout:5954 read 0x33a795f thru 0x33ab5ca (0x3c6c bytes) 2024-09-21T22:18:06.185 INFO:teuthology.orchestra.run.smithi134.stdout:5955 punch from 0xd481c to 0xdcedf, (0x86c3 bytes) 2024-09-21T22:18:06.185 INFO:teuthology.orchestra.run.smithi134.stdout:5956 read 0x3a2fc36 thru 0x3a3e728 (0xeaf3 bytes) 2024-09-21T22:18:06.185 INFO:teuthology.orchestra.run.smithi134.stdout:5957 write 0x9c2e323 thru 0x9c3cf88 (0xec66 bytes) 2024-09-21T22:18:06.191 INFO:teuthology.orchestra.run.smithi134.stdout:5958 write 0xbf0143b thru 0xbf0a4f4 (0x90ba bytes) 2024-09-21T22:18:06.195 INFO:teuthology.orchestra.run.smithi134.stdout:5960 write 0x4a4a30e thru 0x4a587ef (0xe4e2 bytes) 2024-09-21T22:18:06.204 INFO:teuthology.orchestra.run.smithi134.stdout:5962 trunc from 0xcd900d4 to 0xae9cbb1 2024-09-21T22:18:06.216 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:06.214+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:5963 read 0x860b809 thru 0x8615c83 (0xa47b bytes) 2024-09-21T22:18:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:5964 read 0xa2c986c thru 0xa2d299a (0x912f bytes) 2024-09-21T22:18:06.218 INFO:teuthology.orchestra.run.smithi134.stdout:5965 write 0x456905d thru 0x4575484 (0xc428 bytes) 2024-09-21T22:18:06.230 INFO:teuthology.orchestra.run.smithi134.stdout:5966 write 0xc08a6c1 thru 0xc0969d7 (0xc317 bytes) 2024-09-21T22:18:06.236 INFO:teuthology.orchestra.run.smithi134.stdout:5968 write 0x7133821 thru 0x713cfe6 (0x97c6 bytes) 2024-09-21T22:18:06.246 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:06.246 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:06.246 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:06.247 INFO:teuthology.orchestra.run.smithi134.stdout:5969 trunc from 0xc0969d8 to 0x8312468 2024-09-21T22:18:06.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:06.270 INFO:teuthology.orchestra.run.smithi134.stdout:5970 write 0xb81f56a thru 0xb82b6d5 (0xc16c bytes) 2024-09-21T22:18:06.283 INFO:teuthology.orchestra.run.smithi134.stdout:5971 trunc from 0xb82b6d6 to 0x5c59ec2 2024-09-21T22:18:06.294 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.308 INFO:teuthology.orchestra.run.smithi134.stdout:5973 write 0xce057fb thru 0xce0b0f0 (0x58f6 bytes) 2024-09-21T22:18:06.312 INFO:teuthology.orchestra.run.smithi134.stdout:5974 punch from 0x10e22a9 to 0x10e90ae, (0x6e05 bytes) 2024-09-21T22:18:06.319 INFO:teuthology.orchestra.run.smithi134.stdout:5975 writesame 0xd5c21a6 thru 0xd5cb664 data_size 0x3(0x94bf bytes) 2024-09-21T22:18:06.319 INFO:teuthology.orchestra.run.smithi134.stdout:5977 write 0x5cc0301 thru 0x5cc0a6a (0x76a bytes) 2024-09-21T22:18:06.322 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.323 INFO:teuthology.orchestra.run.smithi134.stdout:5979 punch from 0xcce5eb0 to 0xccf0fc1, (0xb111 bytes) 2024-09-21T22:18:06.329 INFO:teuthology.orchestra.run.smithi134.stdout:5980 write 0xdc92f9c thru 0xdca2f86 (0xffeb bytes) 2024-09-21T22:18:06.335 INFO:teuthology.orchestra.run.smithi134.stdout:5982 write 0x8047c4d thru 0x804fc2d (0x7fe1 bytes) 2024-09-21T22:18:06.340 INFO:teuthology.orchestra.run.smithi134.stdout:5984 read 0x14b4653 thru 0x14b966e (0x501c bytes) 2024-09-21T22:18:06.340 INFO:teuthology.orchestra.run.smithi134.stdout:compare and write disabled 2024-09-21T22:18:06.340 INFO:teuthology.orchestra.run.smithi134.stdout:5986 punch from 0x8b3e739 to 0x8b4591a, (0x71e1 bytes) 2024-09-21T22:18:06.340 INFO:teuthology.orchestra.run.smithi134.stdout:5987 write 0x32c3b0d thru 0x32ceaac (0xafa0 bytes) 2024-09-21T22:18:06.341 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:06.339+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:06.346 INFO:teuthology.orchestra.run.smithi134.stdout:5988 read 0xa911e8e thru 0xa91de7d (0xbff0 bytes) 2024-09-21T22:18:06.346 INFO:teuthology.orchestra.run.smithi134.stdout:5990 read 0xb37134b thru 0xb375714 (0x43ca bytes) 2024-09-21T22:18:06.346 INFO:teuthology.orchestra.run.smithi134.stdout:5992 write 0xb5985de thru 0xb5a4999 (0xc3bc bytes) 2024-09-21T22:18:06.352 INFO:teuthology.orchestra.run.smithi134.stdout:5996 read 0x4cac78d thru 0x4cad213 (0xa87 bytes) 2024-09-21T22:18:06.352 INFO:teuthology.orchestra.run.smithi134.stdout:5998 writesame 0x56539a3 thru 0x5661d5e data_size 0x6e(0xe3bc bytes) 2024-09-21T22:18:06.358 INFO:teuthology.orchestra.run.smithi134.stdout:5999 writesame 0x510c85f thru 0x51147cd data_size 0x13(0x7f6f bytes) 2024-09-21T22:18:06.362 INFO:teuthology.orchestra.run.smithi134.stdout:6000 trunc from 0xdca2f87 to 0xd5be96b 2024-09-21T22:18:06.384 INFO:teuthology.orchestra.run.smithi134.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 129.90570553399999, 2024-09-21T22:18:06.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:18:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.420 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:18:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:18:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:18:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:18:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:18:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:18:06.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:18:06.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 125.502763231, 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:06.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:06.435 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 125.50270037600001, 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:06.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:18:06.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:18:06.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:18:06.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375937536999999, 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:06.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:18:06.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.446 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375902446000001, 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:18:06.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375888007, 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.451 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:18:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:18:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:18:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:18:06.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:06.456 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375873347999999, 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:18:06.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.459 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.460 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375860305, 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.461 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:18:06.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375836816, 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:18:06.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:18:06.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:06.469 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375823678, 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:18:06.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:18:06.473 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375813543, 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.478 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:06.416+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:06.479 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375713020999999, 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375695228000001, 2024-09-21T22:18:06.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.487 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375674707999998, 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:06.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:18:06.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:18:06.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.375652707, 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.495 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.367678778999998, 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:18:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178642 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3735552~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.350471199000001, 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015880737999999998, 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.500 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178642 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066650+0000", 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5300000000000003e-07 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066654+0000", 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5709999999999999e-06 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066665+0000", 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0209e-05 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066671+0000", 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7120000000000003e-06 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080727+0000", 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014055896 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080811+0000", 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3710999999999999e-05 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082530+0000", 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017187859999999999 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:06.504 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.350276469000001, 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.350134371999999, 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:06.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:18:06.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:18:06.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.349738487, 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:18:06.513 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.517 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:06.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:06.520 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:06.518+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:06.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:06.619+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:06.632 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:06.633 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:06.633 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:06.633 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:06.641 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:06.721 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:06.720+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:06.746 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:06.746 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:06.746 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:06.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:06.822 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:06.822+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:06.901 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498855203000005, 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.902 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:06.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498808326000002, 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:06.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:06.912 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498743586000003, 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:06.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.917 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498707357000001, 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:06.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:06.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.922 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498613430000006, 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:06.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:06.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498589662000001, 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.928 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:06.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.932 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498524790999994, 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:06.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498487167999997, 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.937 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:06.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:06.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498446375, 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.942 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:06.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498370914000006, 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:06.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498300541000006, 2024-09-21T22:18:06.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:06.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:06.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498266865999994, 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:06.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:06.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.960 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498198114000004, 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.961 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.965 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498153717999998, 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:06.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498062770000004, 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:06.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498034246000003, 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.975 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:06.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:06.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.498001951999996, 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.980 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:06.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:06.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:06.985 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.497963819000006, 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.986 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:06.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:06.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:06.990 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 10.728236718, 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.991 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:06.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:06.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:06.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:06.997 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 5.9022562430000001, 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:06.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:07.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:07.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:07.003 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:07.004 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:07.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:07.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:07.004 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:07.004 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:07.004 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:18:07.004 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:18:07.004 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:18:07.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:18:07.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:07.004+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:07.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:07.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:07.107 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:07.105+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:07.112 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:07.113 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:07.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:07.194 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:07.195 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:07.208 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:07.206+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:07.227 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:07.227 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:07.232 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:07.232 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:07.232 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:07.232 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:07.232 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:07.241 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:07.261 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:07.261 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:07.278 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:07.278 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:07.294 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:07.295 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:07.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:07.308+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:07.311 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:07.311 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:07.328 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:07.328 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:07.345 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:07.345 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:07.346 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:07.346 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:07.352 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:18:07.352 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:07.352 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 166, 2024-09-21T22:18:07.352 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:18:07.352 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:18:07.352 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:18:06.896513+0000", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:59.900683+0000", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:16:44.923178+0000", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5804032, 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "nodeep-scrub", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 5, 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:18:07.353 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 3, 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "luminous", 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:18:07.354 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:18:07.355 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:18:07.356 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:18:07.357 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:18:07.358 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:18:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 6.9000000953674316, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 6.9000000953674316, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.28999999165534973, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.82696914672851562, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.360 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:18:07.361 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.362 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:18:07.363 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:18:07.364 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:18:07.365 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 2.630000114440918, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 2.630000114440918, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.82696914672851562, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:18:07.366 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "pool_client.0", 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:34.502611+0000", 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:18:07.367 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 32, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 32, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 32, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 32, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 32, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.368 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "166", 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 72, 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 166, 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:18:07.369 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:18:07.370 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:18:07.371 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.75, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.75, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1.1399999856948853, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.82696914672851562, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:18:07.372 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 0.615753173828125, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 129, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:18:07.377 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:07.378 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 116, 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.382 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.383 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 0.888458251953125, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:18:07.386 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:07.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:18:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 13, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 26, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 45, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 27, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:18:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:18:07.390 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/704257458", 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/704257458", 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/704257458", 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/704257458", 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 115, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.397 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:18:07.398 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 0, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:18:07.399 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.400 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.401 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.402 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.403 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:07.404 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.408 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.409 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 137, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.410 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.411 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.413 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.416 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.417 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 27 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.419 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:18:07.420 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:07.421 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [ 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.1", 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: 0, 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: 1 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.d", 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: 6, 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: 0 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.11", 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: 7 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.16", 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: 2 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:18:07.424 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [ 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 70, 2024-09-21T22:18:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 3 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [ 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 71, 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.426 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [ 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 68, 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:18:07.427 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:18:07.428 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:18:07.428 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:18:07.428 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:18:07.428 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:18:07.428 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:18:07.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:07.428 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:07.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:07.431 INFO:tasks.thrashosds.thrasher:j is {'epoch': 166, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:18:06.896513+0000', 'last_up_change': '2024-09-21T22:15:59.900683+0000', 'last_in_change': '2024-09-21T22:16:44.923178+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8269691467285156, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.8269691467285156, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:15:34.502611+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 72, 'snap_epoch': 166, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8269691467285156, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.8299999833106995}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.615753173828125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 0.888458251953125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 26, 'up_from': 45, 'up_thru': 101, 'down_at': 27, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 704257458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 704257458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 704257458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 704257458}]}, 'public_addr': '172.21.15.134:6809/704257458', 'cluster_addr': '172.21.15.134:6811/704257458', 'heartbeat_back_addr': '172.21.15.134:6815/704257458', 'heartbeat_front_addr': '172.21.15.134:6813/704257458', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 137, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 27}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.1', 'osds': [0, 1]}, {'pgid': '3.d', 'osds': [6, 0]}, {'pgid': '3.11', 'osds': [1, 7]}, {'pgid': '3.16', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 70, 'length': 3}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 71, 'length': 1}]}], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 68, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:18:07.432 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.11 2024-09-21T22:18:07.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.11 2024-09-21T22:18:07.432 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:07.428+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:07.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:07.529+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:07.576 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:07.577 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:07.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:07.631 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:07.629+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:07.731 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:07.730+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:07.732 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:07.733 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:07.741 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:07.832 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:07.830+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:07.843 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:07.844 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:07.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:07.917 INFO:teuthology.orchestra.run.smithi134.stderr:clear 3.11 pg_upmap mapping 2024-09-21T22:18:07.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:18:07.932 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:07.930+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:07.969 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:07.969 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:07.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:08.063 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:08.062+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:08.126 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:08.126 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:08.134 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:08.133+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:08.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:08.235 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:08.234+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:08.277 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:08.277 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:08.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:08.337 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:08.335+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:08.388 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:08.388 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:08.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:08.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:08.440+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:08.499 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:08.499 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:08.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:08.538 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:08.537+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:08.639 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:08.638+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:08.651 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:08.651 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:08.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:08.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:08.740+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:08.774 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:08.774 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:08.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:08.842 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:08.840+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:08.890 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:08.890 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:08.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:08.915 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:18:08.942 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:08.941+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:09.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:09.042+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:09.059 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:09.059 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:09.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:09.144 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:09.143+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:09.170 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:09.171 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:09.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:09.245 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:09.244+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:09.282 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:09.282 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:09.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:09.375 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:09.374+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:09.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:09.436 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:09.436 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:09.445 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:09.475 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:09.474+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:09.547 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:09.546+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:09.550 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:09.550 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:09.567 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:09.567 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:09.590 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:09.590 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:09.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:09.648 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:09.647+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:09.702 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:09.702 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:09.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:09.749 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:09.748+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:09.784 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:09.784 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:09.800 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:09.814 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:09.814 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:09.817 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:09.817 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:09.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:09.833 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:09.833 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:09.849 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:09.849 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:09.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:09.848+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:09.865 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:09.865 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:09.931 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:09.931 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:09.931 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:09.931 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:09.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:09.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:09.949+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:10.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:10.050+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:10.067 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:10.068 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:10.068 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:10.068 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:10.068 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:10.077 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:10.151 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:10.150+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780829073999996, 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:10.183 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:10.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780782196999994, 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:10.187 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:10.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780717456999994, 2024-09-21T22:18:10.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:10.195 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780681228000006, 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.199 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780587300999997, 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:10.203 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780563533000006, 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780498661999999, 2024-09-21T22:18:10.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:10.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780461039000002, 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:10.211 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:10.215 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780420246000006, 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:10.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:10.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780344784999997, 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:10.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:10.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780274411999997, 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.224 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:10.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:10.228 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780240737, 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:10.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:10.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:10.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.232 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780171984999996, 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.236 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780127589000003, 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:10.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:10.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:10.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780036640999995, 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:10.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:10.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.780008116999994, 2024-09-21T22:18:10.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.249 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.779975823000001, 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 94.779937689999997, 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:10.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:10.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:10.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 14.010210589, 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:10.258 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.263 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.184230114, 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:10.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:10.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:10.269 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:10.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:10.271 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:10.269+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:10.371 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:10.369+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:10.375 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:10.375 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:10.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:10.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:10.471+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:10.487 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:10.487 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:10.487 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:10.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:10.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:10.579+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 130.72911005500001, 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 130.72648798200001, 2024-09-21T22:18:10.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:10.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.743782783999997, 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:10.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:18:10.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.694496933000003, 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.656 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.692246243, 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:18:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:18:10.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.663 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.692144091999999, 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.688323816, 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:18:10.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:18:10.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.688303677999997, 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:18:10.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:18:10.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:18:10.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:18:10.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.688283159999997, 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.660356616000001, 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:18:10.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.660337046000002, 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:10.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:18:10.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:18:10.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.660318455000002, 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:18:10.688 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.692 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.660298775000001, 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:10.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:18:10.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:18:10.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.696 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.660270414999999, 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.660248873, 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:18:10.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190908 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 303104~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.710352954000001, 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057426265999999997, 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190908 2024-09-21T22:18:10.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928944+0000", 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2010000000000002e-06 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928951+0000", 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928956+0000", 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1030000000000001e-06 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986168+0000", 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212363000000002 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986213+0000", 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5142999999999998e-05 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986367+0000", 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190909 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 385024~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.710331845999999, 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057618427999999999, 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190909 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:10.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928963+0000", 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928965+0000", 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928972+0000", 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5610000000000001e-06 2024-09-21T22:18:10.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928977+0000", 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986391+0000", 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057413929000000002 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986434+0000", 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2582e-05 2024-09-21T22:18:10.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986581+0000", 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014685300000000001 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190910 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 450560~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.710310020000001, 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057841218, 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190910 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:10.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928987+0000", 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6740000000000001e-06 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928993+0000", 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:18:10.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929000+0000", 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6159999999999998e-06 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986611+0000", 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057611258999999998 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986651+0000", 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0303999999999999e-05 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986825+0000", 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173847 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190911 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 598016~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.710288766000001, 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058186806000000001, 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.717 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190911 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929007+0000", 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929012+0000", 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929015+0000", 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986859+0000", 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057844049000000002 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986940+0000", 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1265000000000002e-05 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.987192+0000", 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175700000000002 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200490 3.b 3:d36e58d9:::rbd_data.1185b457050c.0000000000000005:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.464871437999999, 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067382992000000003, 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:10.721 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200490 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174426+0000", 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3400000000000002e-06 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183430+0000", 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090044610000000001 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183473+0000", 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2531000000000003e-05 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183494+0000", 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0939999999999999e-05 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183619+0000", 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125334 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183864+0000", 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000244536 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.184078+0000", 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021405400000000001 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237365+0000", 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053287147999999999 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:10.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241686+0000", 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043208910000000003 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241753+0000", 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7396000000000003e-05 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241806+0000", 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2361000000000002e-05 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:10.727 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:10.728 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:10.727+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:10.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:10.828 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:10.827+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:10.872 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:10.872 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:10.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:10.930 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:10.928+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:10.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:18:11.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:11.029+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:11.038 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:11.038 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:11.039 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:11.039 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:11.039 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:11.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:11.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:11.132+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:11.196 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:11.196 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:11.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:11.196 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:11.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.196 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.267835067, 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:18:11.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:18:11.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.267816549999999, 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:18:11.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:18:11.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.204 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.267643964000001, 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.267622121999999, 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.267601585000001, 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:18:11.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.267577056, 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.220 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.266727197999998, 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:18:11.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:18:11.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.224 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.266700811, 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.266678245000001, 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.229 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:18:11.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.266656535000003, 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.266635395000002, 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.237 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:18:11.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.26661352, 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:18:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:18:11.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:18:11.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:18:11.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:18:11.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.246 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.264998232000003, 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:11.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:18:11.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.264978454000001, 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:18:11.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:18:11.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.254 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.264958974999999, 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:11.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:18:11.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:18:11.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.264940574000001, 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:18:11.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:11.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.264908175000002, 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:18:11.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.264888036000002, 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:18:11.266 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:18:11.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160176 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.260822271000002, 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074083248000000004, 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.270 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160176 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933867+0000", 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933869+0000", 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1210000000000001e-06 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933874+0000", 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933879+0000", 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4830000000000001e-06 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007941+0000", 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074061907999999996 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007950+0000", 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7329999999999992e-06 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160177 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.260804254999996, 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074112131999999997, 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160177 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933885+0000", 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933887+0000", 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933892+0000", 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933896+0000", 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4209999999999997e-06 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007986+0000", 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074089981999999999 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007996+0000", 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.277 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:11.279 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:11.279 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:11.278+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:11.379 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:11.378+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:11.422 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:11.422 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:11.422 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:11.423 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:11.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:11.480 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:11.479+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:11.534 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:11.534 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:11.534 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:11.535 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:11.535 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:11.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:11.582 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:11.581+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:11.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:11.682+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:11.687 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 130.771387852, 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648646235000001, 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:18:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648636695999997, 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648627856000004, 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648618650000003, 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:18:11.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:18:11.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.708 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648609676000007, 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:18:11.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648600771000005, 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648579030999997, 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:18:11.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:18:11.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.720 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648569606999999, 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648560708000005, 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:18:11.724 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:18:11.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.648551755, 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:11.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:18:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.647046895000003, 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:18:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.647037389999994, 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:18:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:18:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:18:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.647023650999998, 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:18:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.647014341000002, 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:18:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 92.787003342000006, 2024-09-21T22:18:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:18:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 92.783381921, 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:18:11.753 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 92.200911387000005, 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:18:11.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:18:11.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.482248447000003, 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:18:11.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:18:11.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200487 3.4 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.514932678999999, 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070564014999999994, 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:11.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200487 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:11.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170963+0000", 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5590000000000001e-06 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178398+0000", 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074350709999999997 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178437+0000", 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026000000000002e-05 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178452+0000", 2024-09-21T22:18:11.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5128e-05 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178600+0000", 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014802700000000001 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178942+0000", 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034162 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179139+0000", 2024-09-21T22:18:11.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196672 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237616+0000", 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058477256999999998 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241380+0000", 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003763654 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241460+0000", 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0438999999999993e-05 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:11.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241524+0000", 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3561999999999999e-05 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:11.775 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:11.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:11.817 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:11.816+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:11.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:11.884 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:11.883+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:18:11.931 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:11.931 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:11.931 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:11.931 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:11.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:12.014 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:12.014 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:12.014 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:12.013+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:12.031 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:12.031 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:12.048 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:12.064 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:12.064 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:12.081 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:12.081 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:12.086 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:12.085+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:12.090 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.090 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.098 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:12.098 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:12.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:12.114 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:12.114 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:12.131 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:12.131 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:12.187 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:12.185+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:12.218 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.218 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:12.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:12.287+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:12.335 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.335 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:12.388 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:12.386+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:12.448 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.448 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:12.499 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:12.497+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:12.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:12.588+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:12.601 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.601 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:12.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:12.689+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:12.714 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.714 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:12.790 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:12.789+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:12.826 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.826 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:12.892 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:12.890+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:12.937 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:18:12.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:18:12.940 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:12.940 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:12.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:12.992 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:12.991+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:13.093 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:13.092+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:13.119 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:13.119 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:13.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:13.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:13.194+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:13.274 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:13.274 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:13.283 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:13.326 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:13.325+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:13.386 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:13.387 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:13.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:13.437 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:13.435+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:13.497 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:13.495+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:13.540 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:13.540 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:13.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:13.632 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:13.631+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:13.692 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:13.692 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:13.699 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:13.697+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:13.700 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:13.800 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:13.799+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:13.844 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:13.844 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:13.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:13.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:13.900+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:13.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:18:13.969 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:18:13.976 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:13.977 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:13.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:13.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:18:14.002 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:14.000+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:14.103 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:14.102+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:14.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:14.147 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:14.147 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:14.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:14.204 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:14.202+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:14.286 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:14.286 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:14.304 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:14.304 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:14.304 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:14.303+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:14.320 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:14.321 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:14.322 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:14.322 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:14.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:14.337 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:14.337 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:14.354 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:14.354 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:14.370 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:14.387 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:14.387 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:14.405 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:14.404+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:14.417 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:14.418 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:14.453 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:14.453 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:14.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:14.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:14.545+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:14.604 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:14.605 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:14.605 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:14.605 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:14.605 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:14.607 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:14.606+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:14.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:14.708 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:14.707+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.830198762000002, 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:18:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.830180245000001, 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:18:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.830007659000003, 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:18:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.829985817000001, 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.829965280000003, 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:18:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.829940751000002, 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.829090893, 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:18:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:18:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.829064506000002, 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.829041940000003, 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.829020229999998, 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.828999090000003, 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.828977215000002, 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:18:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.827361926999998, 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:18:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.827342149000003, 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:18:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:18:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.827322670000001, 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:18:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.827304269000003, 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:18:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.827271869999997, 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:18:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.827251730999997, 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160176 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.823185965999997, 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074083248000000004, 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160176 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933867+0000", 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933869+0000", 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1210000000000001e-06 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933874+0000", 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933879+0000", 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4830000000000001e-06 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007941+0000", 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074061907999999996 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007950+0000", 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7329999999999992e-06 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160177 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.823167949999998, 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074112131999999997, 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160177 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933885+0000", 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933887+0000", 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933892+0000", 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933896+0000", 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4209999999999997e-06 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007986+0000", 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074089981999999999 2024-09-21T22:18:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007996+0000", 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:14.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:14.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:14.840+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:14.943 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:14.941+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:14.965 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:18:14.972 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:18:14.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:18:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:14.994 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:14.995 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:15.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:15.047 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:15.046+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:15.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:15.144+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:15.175 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:15.175 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:15.175 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:15.175 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:15.175 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:15.184 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:15.268 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:15.267+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:15.330 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.41398395600001, 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.29124233899999, 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.337 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.2912328, 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.29122396, 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:18:15.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.29121475399999, 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.29120578, 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:18:15.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.357 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.291196875, 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.358 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:15.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.291175135, 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.362 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:15.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:18:15.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.291165711, 2024-09-21T22:18:15.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:18:15.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.291156812, 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:18:15.370 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:18:15.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:18:15.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.29114785900001, 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.28964299899999, 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:18:15.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.289633494, 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.289619755, 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:18:15.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:18:15.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 102.28961044499999, 2024-09-21T22:18:15.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:15.394 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.429599445999997, 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:15.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:18:15.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.400 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.425978025000006, 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:18:15.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:18:15.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:18:15.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 95.843507490999997, 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:15.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:15.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:18:15.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.124844550999995, 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:18:15.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200487 3.4 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.157528783, 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070564014999999994, 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:15.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200487 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170963+0000", 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5590000000000001e-06 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178398+0000", 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074350709999999997 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178437+0000", 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026000000000002e-05 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178452+0000", 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5128e-05 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178600+0000", 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014802700000000001 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178942+0000", 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034162 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179139+0000", 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196672 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237616+0000", 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058477256999999998 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241380+0000", 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003763654 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241460+0000", 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0438999999999993e-05 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241524+0000", 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3561999999999999e-05 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.423 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:15.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:15.425 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:15.423+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:15.525 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:15.524+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:15.569 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:15.570 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:15.570 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:15.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:15.626 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:15.625+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:15.682 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:15.682 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:15.682 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:15.682 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:15.682 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:15.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:15.726 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:15.725+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:15.794 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 149.27618685600001, 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:18:15.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.798 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 149.264740418, 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:18:15.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:18:15.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:18:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 138.71465319000001, 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:15.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:18:15.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 130.65956542699999, 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 129.38847273799999, 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:18:15.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 129.383566164, 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:15.818 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 129.37533386800001, 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 129.37334653600001, 2024-09-21T22:18:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:18:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 111.84949294499999, 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 105.80633133400001, 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:18:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 105.80483059300001, 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.825143604999994, 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:18:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:18:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.820259528999998, 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:18:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.819471832000005, 2024-09-21T22:18:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.812464390000002, 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:18:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:18:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:18:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.836539725999998, 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:18:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.718992428, 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:192338 3.9 e153/90 3:91686995:::rbd_data.1185cbdbd00.0000000000000019:head v 153'371, mlcod=144'369)", 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.710877607, 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071372069999999996, 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081784+0000", 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082349+0000", 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056494 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082362+0000", 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082371+0000", 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082435+0000", 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000007e-05 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082461+0000", 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5678e-05 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088868+0000", 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064072590000000002 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088921+0000", 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2417000000000003e-05 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200481 3.9 e156/90 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head v 156'377, mlcod=155'375)", 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.620168562, 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069452704000000004, 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172493+0000", 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197250+0000", 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024756805999999999 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197272+0000", 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2025999999999999e-05 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197285+0000", 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197371+0000", 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5525999999999994e-05 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197397+0000", 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6491000000000001e-05 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241890+0000", 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044492459999999998 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241945+0000", 2024-09-21T22:18:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5557999999999999e-05 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200487 3.4 e156/23 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head v 156'412, mlcod=154'410)", 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.613178844, 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057925425000000003, 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179483+0000", 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186401+0000", 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006918502 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186438+0000", 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7036000000000003e-05 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186459+0000", 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0738e-05 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186576+0000", 2024-09-21T22:18:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011731900000000001 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186615+0000", 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8571000000000001e-05 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237335+0000", 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050720316000000001 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237408+0000", 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2503999999999996e-05 2024-09-21T22:18:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:15.876 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:15.876 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:15.874+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:15.974 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:18:15.976 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:15.975+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:15.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:18:15.990 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:15.990 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:15.990 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:15.990 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:15.998 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:16.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:16.077+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:16.110 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:16.111 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:16.111 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:16.111 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:16.111 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:16.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:16.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:16.178+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 121.024749239, 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 121.022873358, 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 88.259548011000007, 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.235 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.239 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.407222219000005, 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:16.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 74.131685603999998, 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.245 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:16.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:16.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:16.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.800029961, 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.250 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.255 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.295127179000001, 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:16.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:16.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.295101858999999, 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.295067329999998, 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.295023771, 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.268 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:16.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:16.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.294998309, 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.272 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:16.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:16.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:16.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.294981102000001, 2024-09-21T22:18:16.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:16.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.224913018999999, 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:16.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:16.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:16.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.224889637, 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.224869866999999, 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.289 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.224850930999999, 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:16.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.297 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.224830988000001, 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:16.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:16.301 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.079491430000001, 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:16.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:16.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:16.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:16.306 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.052284894, 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:16.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:16.312 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.035918058, 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:16.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:16.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:16.316 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:16.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:16.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:16.316+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:16.418 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:16.417+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:16.421 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:16.421 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:16.421 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:16.421 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:16.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:16.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:16.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:16.518+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:16.550 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:16.566 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:16.574 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:16.574 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:16.574 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:16.574 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:16.574 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:16.582 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:16.583 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:16.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:16.598 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:16.615 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:16.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:16.619+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:16.632 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:16.650 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:16.650 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:16.666 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:16.666 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:16.689 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:16.689 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:16.697 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:16.740 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:16.739+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:16.801 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:16.802 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:16.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:16.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:16.820+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:16.908 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:18:16.922 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:16.921+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:16.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:18:16.969 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:16.969 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:16.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:16.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:18:17.051 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:17.050+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:17.124 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:17.123+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:17.127 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:17.127 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:17.136 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:17.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:17.225+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:17.281 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:17.281 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:17.289 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:17.333 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:17.331+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:17.392 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:17.392 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:17.400 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:17.442 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:17.440+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:17.528 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:17.527+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:17.543 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:17.544 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:17.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:17.629 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:17.628+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:17.657 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:17.657 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:17.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:17.730 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:17.729+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:17.770 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:17.770 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:17.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:17.862 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:17.861+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:17.922 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:17.922 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:17.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:17.932 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:17.931+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:17.979 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:18:17.979 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:18:17.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T22:18:18.032 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:18.031+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:18.096 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:18.096 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:18.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:18.149 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:18.148+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:18.212 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:18.212 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:18.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:18.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:18.261+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:18.335 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:18.334+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:18.365 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:18.365 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:18.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:18.435 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:18.434+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:18.518 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:18.518 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:18.527 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:18.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:18.569+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:18.629 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:18.629 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:18.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:18.636+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:18.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:18.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:18.737 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:18.736+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:18.785 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:18.785 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:18.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:18.818 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:18.818 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:18.835 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:18.838 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:18.837+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:18.851 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:18.852 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:18.868 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:18.869 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:18.885 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:18.885 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:18.899 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:18.900 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:18.900 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:18.900 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:18.902 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:18.902 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:18.909 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:18.919 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:18.920 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:18.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:18.971+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:18.982 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T22:18:18.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:18:19.029 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:19.029 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:19.030 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:19.030 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:19.030 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:19.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:19.041 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:19.039+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:19.140 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:19.139+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:19.189 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:19.189 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 152.671122873, 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:18:19.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:18:19.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:18:19.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 152.65967643499999, 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:18:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:18:19.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:18:19.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 142.109589207, 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:18:19.198 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:18:19.202 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.05450144400001, 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:18:19.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.78340875500001, 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:18:19.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:18:19.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.77850218099999, 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.770269885, 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:18:19.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:18:19.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:18:19.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.76828255300001, 2024-09-21T22:18:19.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:18:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:18:19.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:18:19.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:18:19.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 115.244428962, 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 109.201267351, 2024-09-21T22:18:19.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:18:19.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 109.19976661, 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 95.220079622, 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.241 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 95.215195546000004, 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:19.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 95.214407848999997, 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.246 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:18:19.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:18:19.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 95.207400406999994, 2024-09-21T22:18:19.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:18:19.254 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.231475742999997, 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:19.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:18:19.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:18:19.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.113928444999999, 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:18:19.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:18:19.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:18:19.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:192338 3.9 e153/90 3:91686995:::rbd_data.1185cbdbd00.0000000000000019:head v 153'371, mlcod=144'369)", 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.105813624, 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071372069999999996, 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081784+0000", 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:19.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082349+0000", 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056494 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082362+0000", 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082371+0000", 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-21T22:18:19.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082435+0000", 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000007e-05 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082461+0000", 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5678e-05 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088868+0000", 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064072590000000002 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088921+0000", 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2417000000000003e-05 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200481 3.9 e156/90 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head v 156'377, mlcod=155'375)", 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.015104578999999, 2024-09-21T22:18:19.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069452704000000004, 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172493+0000", 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197250+0000", 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024756805999999999 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197272+0000", 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2025999999999999e-05 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197285+0000", 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197371+0000", 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5525999999999994e-05 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197397+0000", 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6491000000000001e-05 2024-09-21T22:18:19.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241890+0000", 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044492459999999998 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241945+0000", 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5557999999999999e-05 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200487 3.4 e156/23 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head v 156'412, mlcod=154'410)", 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.008114860999999, 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057925425000000003, 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:19.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179483+0000", 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186401+0000", 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006918502 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186438+0000", 2024-09-21T22:18:19.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7036000000000003e-05 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186459+0000", 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0738e-05 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186576+0000", 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011731900000000001 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:19.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186615+0000", 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8571000000000001e-05 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237335+0000", 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050720316000000001 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237408+0000", 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2503999999999996e-05 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:19.276 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:19.276 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:19.277 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:19.277 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:19.276+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:19.378 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:19.376+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:19.382 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:19.382 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:19.382 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:19.382 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:19.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:19.478 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:19.478+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:19.536 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:19.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:19.589 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:19.588+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:19.650 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:19.650 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:19.650 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:19.650 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.449828478, 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.651 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:19.652 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:19.653 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:19.656 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.447952597, 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:19.658 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:19.659 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 91.684627250000005, 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.661 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:19.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.663 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.832301458000003, 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.666 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:19.667 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:19.668 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:19.669 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:19.671 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 77.556764842999996, 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.672 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:19.673 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.674 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:19.675 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.676 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.225109199999999, 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.677 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.678 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:19.679 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:19.680 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:19.681 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.682 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.720206418, 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.683 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:19.684 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.686 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.720181098000001, 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.687 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.688 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:19.689 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:19.690 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.720146569000001, 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:19.691 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.692 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.693 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:19.694 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.695 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.720103009999999, 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.696 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.697 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:19.698 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:19.699 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.720077547999999, 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.700 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.701 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:19.703 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:19.704 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.720060341, 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:19.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:19.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.708 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.649992258000001, 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.709 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.710 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.712 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.649968875999999, 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.713 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:19.714 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.716 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.649949106000001, 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:19.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:19.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.649930170000001, 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.721 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 26.649910226999999, 2024-09-21T22:18:19.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:19.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:19.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.504570669, 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:19.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:19.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.477364133000002, 2024-09-21T22:18:19.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:19.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:19.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:19.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.460997296999999, 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:19.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:19.745 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:19.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:19.747 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:19.745+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:19.848 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:19.846+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:19.893 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:19.893 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:19.893 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:19.893 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:19.902 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:19.986 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:19.984+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:19.987 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:18:19.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:18:20.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:18:20.048 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:20.047+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:20.054 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:20.054 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:20.054 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:20.054 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:20.054 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:20.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:20.149 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:20.147+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:20.209 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:20.209 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:20.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.260408971, 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.210 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.213 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.214 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.260389608, 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:20.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.26035696, 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.219 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:20.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.223 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.26030579299999, 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.226 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.260279121, 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.228 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:20.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.26025432200001, 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:20.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.236 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.26022337399999, 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.237 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:20.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.241 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.260199156, 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.242 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:20.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.260174804, 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:20.248 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:20.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.26015056099999, 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.253 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.26012082599999, 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:20.257 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:20.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:20.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:20.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.26008535599999, 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.262 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:20.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:20.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:20.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.222554151, 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.270 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.029686492, 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.271 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.272 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.274 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.02431996, 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.276 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.00675516699999, 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.282 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 105.974374174, 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 105.926570728, 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:20.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:20.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.019753407, 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:20.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:20.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:20.299 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 24.012670775, 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.304 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.304 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:20.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:20.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:20.304+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:20.406 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:20.404+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:20.450 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:20.451 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:20.451 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:20.451 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:20.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:20.506 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:20.506+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:20.604 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:20.604 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:20.604 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:20.604 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:20.604 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:20.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:20.607+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:20.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:20.708 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:20.707+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 144.20376799799999, 2024-09-21T22:18:20.717 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:20.718 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.719 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:18:20.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:18:20.721 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:20.723 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 139.80082569499999, 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:18:20.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:18:20.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:18:20.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:18:20.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 139.80076284, 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.731 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:18:20.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:18:20.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:18:20.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:18:20.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.674000001000003, 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:18:20.737 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:20.741 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673964910000002, 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:20.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:18:20.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673950470999998, 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.746 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:18:20.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:18:20.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.750 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673935812000003, 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.751 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.754 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673922769000001, 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.755 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:18:20.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:18:20.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673899280000001, 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.759 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:18:20.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:18:20.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673886142000001, 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:18:20.763 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:18:20.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673876006999997, 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:18:20.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673775485, 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:18:20.772 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:18:20.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673757692000002, 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.780 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673737172000003, 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:18:20.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.784 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.673715170999998, 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.785 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:18:20.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:18:20.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.665741242999999, 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.789 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178642 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3735552~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.648533663000002, 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015880737999999998, 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.794 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178642 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066650+0000", 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5300000000000003e-07 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066654+0000", 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5709999999999999e-06 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066665+0000", 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0209e-05 2024-09-21T22:18:20.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066671+0000", 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7120000000000003e-06 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080727+0000", 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014055896 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080811+0000", 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3710999999999999e-05 2024-09-21T22:18:20.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082530+0000", 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017187859999999999 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.648338932999998, 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:18:20.798 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:18:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:18:20.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.648196835999997, 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.803 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:18:20.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:18:20.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 37.647800951000001, 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:20.807 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:20.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:20.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:20.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:20.811 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:20.813 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:20.813 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:20.812+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:20.913 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:20.912+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:20.916 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:20.916 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:20.916 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:20.916 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:20.925 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:20.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:18:20.995 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:18:21.014 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:18:21.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:18:21.014 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:21.012+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:21.078 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:21.078 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:21.079 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:21.079 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:21.079 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:21.079 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:21.080 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:21.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:21.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:21.111 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:21.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:21.113+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:21.132 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:21.150 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:21.150 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:21.167 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:21.167 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:21.185 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:21.201 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:21.215 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:21.214+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:21.218 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:21.218 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:21.239 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:21.239 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:21.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:21.316 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:21.316+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:18:21.326 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:18:21.339 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-21T22:18:21.202985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":859529172,"num_objects":684,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":684,"num_whiteouts":0,"num_read":211040,"num_read_kb":1296772,"num_write":26482,"num_write_kb":884230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1390,"num_bytes_recovered":159942324,"num_keys_recovered":223,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19932,"ondisk_log_size":19932,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":902016,"kb_used_data":467736,"kb_used_omap":15,"kb_used_meta":433648,"kb_avail":754072704,"statfs":{"total":773094113280,"available":772170448896,"internally_reserved":0,"allocated":478961664,"data_stored":467906896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":444056348},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-168122554,"num_objects":-246,"num_object_clones":0,"num_object_copies":-492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-246,"num_whiteouts":0,"num_read":1166,"num_read_kb":996,"num_write":434,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000677"},"pg_stats":[{"pgid":"3.1f","version":"178'1226","reported_seq":27563,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.981217+0000","last_change":"2024-09-21T22:18:18.981217+0000","last_active":"2024-09-21T22:18:18.981217+0000","last_peered":"2024-09-21T22:18:18.981217+0000","last_clean":"2024-09-21T22:18:18.981217+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:18:18.981217+0000","last_undegraded":"2024-09-21T22:18:18.981217+0000","last_fullsized":"2024-09-21T22:18:18.981217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:24:05.701132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098070800000000006,"stat_sum":{"num_bytes":43390645,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":29863,"num_read_kb":75399,"num_write":2062,"num_write_kb":47569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1e","version":"177'700","reported_seq":4134,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.092772+0000","last_change":"2024-09-21T22:18:17.981915+0000","last_active":"2024-09-21T22:18:18.092772+0000","last_peered":"2024-09-21T22:18:18.092772+0000","last_clean":"2024-09-21T22:18:18.092772+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:18:18.092772+0000","last_undegraded":"2024-09-21T22:18:18.092772+0000","last_fullsized":"2024-09-21T22:18:18.092772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:42.723537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000783568,"stat_sum":{"num_bytes":25777853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5046,"num_read_kb":36168,"num_write":874,"num_write_kb":21910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1d","version":"178'407","reported_seq":8314,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.979367+0000","last_change":"2024-09-21T22:18:18.979367+0000","last_active":"2024-09-21T22:18:18.979367+0000","last_peered":"2024-09-21T22:18:18.979367+0000","last_clean":"2024-09-21T22:18:18.979367+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:18:18.979367+0000","last_undegraded":"2024-09-21T22:18:18.979367+0000","last_fullsized":"2024-09-21T22:18:18.979367+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:02:41.235157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085185399999999998,"stat_sum":{"num_bytes":52353770,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":7443,"num_read_kb":59847,"num_write":487,"num_write_kb":33904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1c","version":"178'863","reported_seq":3556,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.035602+0000","last_change":"2024-09-21T22:18:18.979821+0000","last_active":"2024-09-21T22:18:19.035602+0000","last_peered":"2024-09-21T22:18:19.035602+0000","last_clean":"2024-09-21T22:18:19.035602+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:18:19.035602+0000","last_undegraded":"2024-09-21T22:18:19.035602+0000","last_fullsized":"2024-09-21T22:18:19.035602+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:59:06.937223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099921800000000007,"stat_sum":{"num_bytes":22322254,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4575,"num_read_kb":35379,"num_write":1290,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1b","version":"178'463","reported_seq":10840,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.068957+0000","last_change":"2024-09-21T22:18:18.980788+0000","last_active":"2024-09-21T22:18:19.068957+0000","last_peered":"2024-09-21T22:18:19.068957+0000","last_clean":"2024-09-21T22:18:19.068957+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:18:19.068957+0000","last_undegraded":"2024-09-21T22:18:19.068957+0000","last_fullsized":"2024-09-21T22:18:19.068957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:43:30.486465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039184199999999999,"stat_sum":{"num_bytes":20491389,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":10743,"num_read_kb":37317,"num_write":491,"num_write_kb":23302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1a","version":"177'315","reported_seq":2858,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.082963+0000","last_change":"2024-09-21T22:18:18.979067+0000","last_active":"2024-09-21T22:18:19.082963+0000","last_peered":"2024-09-21T22:18:19.082963+0000","last_clean":"2024-09-21T22:18:19.082963+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:18:19.082963+0000","last_undegraded":"2024-09-21T22:18:19.082963+0000","last_fullsized":"2024-09-21T22:18:19.082963+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:46:08.397680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068726200000000001,"stat_sum":{"num_bytes":7718890,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":2268,"num_read_kb":17386,"num_write":391,"num_write_kb":17801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.19","version":"179'738","reported_seq":3684,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.991137+0000","last_change":"2024-09-21T22:18:19.991137+0000","last_active":"2024-09-21T22:18:19.991137+0000","last_peered":"2024-09-21T22:18:19.991137+0000","last_clean":"2024-09-21T22:18:19.991137+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:18:19.991137+0000","last_undegraded":"2024-09-21T22:18:19.991137+0000","last_fullsized":"2024-09-21T22:18:19.991137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:35:20.212065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00153386,"stat_sum":{"num_bytes":12801248,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":5235,"num_read_kb":28252,"num_write":824,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.18","version":"176'779","reported_seq":2476,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981984+0000","last_change":"2024-09-21T22:18:17.982179+0000","last_active":"2024-09-21T22:18:17.981984+0000","last_peered":"2024-09-21T22:18:17.981984+0000","last_clean":"2024-09-21T22:18:17.981984+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:18:17.981984+0000","last_undegraded":"2024-09-21T22:18:17.981984+0000","last_fullsized":"2024-09-21T22:18:17.981984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:19:15.578579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011395839999999999,"stat_sum":{"num_bytes":21737168,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3625,"num_read_kb":22875,"num_write":962,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.17","version":"178'1124","reported_seq":3723,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.098299+0000","last_change":"2024-09-21T22:18:18.981071+0000","last_active":"2024-09-21T22:18:19.098299+0000","last_peered":"2024-09-21T22:18:19.098299+0000","last_clean":"2024-09-21T22:18:19.098299+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:18:19.098299+0000","last_undegraded":"2024-09-21T22:18:19.098299+0000","last_fullsized":"2024-09-21T22:18:19.098299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:49.594215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055199199999999996,"stat_sum":{"num_bytes":12281890,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6151,"num_read_kb":35343,"num_write":1959,"num_write_kb":25029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.16","version":"178'289","reported_seq":14249,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.990279+0000","last_change":"2024-09-21T22:18:19.991102+0000","last_active":"2024-09-21T22:18:19.990279+0000","last_peered":"2024-09-21T22:18:19.990279+0000","last_clean":"2024-09-21T22:18:19.990279+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:18:19.990279+0000","last_undegraded":"2024-09-21T22:18:19.990279+0000","last_fullsized":"2024-09-21T22:18:19.990279+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:09:25.660924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012127209999999999,"stat_sum":{"num_bytes":41379263,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":371,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.15","version":"178'827","reported_seq":3547,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.988425+0000","last_change":"2024-09-21T22:18:18.988425+0000","last_active":"2024-09-21T22:18:18.988425+0000","last_peered":"2024-09-21T22:18:18.988425+0000","last_clean":"2024-09-21T22:18:18.988425+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:18:18.988425+0000","last_undegraded":"2024-09-21T22:18:18.988425+0000","last_fullsized":"2024-09-21T22:18:18.988425+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:28.661383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010455670000000001,"stat_sum":{"num_bytes":45112917,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":4378,"num_read_kb":45774,"num_write":1172,"num_write_kb":35129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.14","version":"176'978","reported_seq":4898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.979178+0000","last_change":"2024-09-21T22:18:18.979468+0000","last_active":"2024-09-21T22:18:18.979178+0000","last_peered":"2024-09-21T22:18:18.979178+0000","last_clean":"2024-09-21T22:18:18.979178+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:18:18.979178+0000","last_undegraded":"2024-09-21T22:18:18.979178+0000","last_fullsized":"2024-09-21T22:18:18.979178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:18:46.476351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093384399999999997,"stat_sum":{"num_bytes":44911202,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5989,"num_read_kb":47954,"num_write":1444,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":330,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.057531+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:18:19.057531+0000","last_peered":"2024-09-21T22:18:19.057531+0000","last_clean":"2024-09-21T22:18:19.057531+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:18:19.057531+0000","last_undegraded":"2024-09-21T22:18:19.057531+0000","last_fullsized":"2024-09-21T22:18:19.057531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"178'452","reported_seq":3860,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.980995+0000","last_change":"2024-09-21T22:18:18.980995+0000","last_active":"2024-09-21T22:18:18.980995+0000","last_peered":"2024-09-21T22:18:18.980995+0000","last_clean":"2024-09-21T22:18:18.980995+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:18:18.980995+0000","last_undegraded":"2024-09-21T22:18:18.980995+0000","last_fullsized":"2024-09-21T22:18:18.980995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:37.316883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048224200000000002,"stat_sum":{"num_bytes":32213787,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3697,"num_read_kb":43420,"num_write":480,"num_write_kb":27040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":336,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.990147+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:18:19.990147+0000","last_peered":"2024-09-21T22:18:19.990147+0000","last_clean":"2024-09-21T22:18:19.990147+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:18:19.990147+0000","last_undegraded":"2024-09-21T22:18:19.990147+0000","last_fullsized":"2024-09-21T22:18:19.990147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"177'448","reported_seq":10905,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.982500+0000","last_change":"2024-09-21T22:18:17.982500+0000","last_active":"2024-09-21T22:18:17.982500+0000","last_peered":"2024-09-21T22:18:17.982500+0000","last_clean":"2024-09-21T22:18:17.982500+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:18:17.982500+0000","last_undegraded":"2024-09-21T22:18:17.982500+0000","last_fullsized":"2024-09-21T22:18:17.982500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:22.322467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011672830000000001,"stat_sum":{"num_bytes":27119345,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":10651,"num_read_kb":38318,"num_write":575,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987363+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:18:18.987363+0000","last_peered":"2024-09-21T22:18:18.987363+0000","last_clean":"2024-09-21T22:18:18.987363+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:18:18.987363+0000","last_undegraded":"2024-09-21T22:18:18.987363+0000","last_fullsized":"2024-09-21T22:18:18.987363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"179'478","reported_seq":9925,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:20.103791+0000","last_change":"2024-09-21T22:18:19.990765+0000","last_active":"2024-09-21T22:18:20.103791+0000","last_peered":"2024-09-21T22:18:20.103791+0000","last_clean":"2024-09-21T22:18:20.103791+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:18:20.103791+0000","last_undegraded":"2024-09-21T22:18:20.103791+0000","last_fullsized":"2024-09-21T22:18:20.103791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:59:40.549573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001155241,"stat_sum":{"num_bytes":35203188,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":9409,"num_read_kb":64258,"num_write":531,"num_write_kb":36425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":336,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.989669+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:18:19.989669+0000","last_peered":"2024-09-21T22:18:19.989669+0000","last_clean":"2024-09-21T22:18:19.989669+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:18:19.989669+0000","last_undegraded":"2024-09-21T22:18:19.989669+0000","last_fullsized":"2024-09-21T22:18:19.989669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"177'471","reported_seq":14239,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.982557+0000","last_change":"2024-09-21T22:18:17.982557+0000","last_active":"2024-09-21T22:18:17.982557+0000","last_peered":"2024-09-21T22:18:17.982557+0000","last_clean":"2024-09-21T22:18:17.982557+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:18:17.982557+0000","last_undegraded":"2024-09-21T22:18:17.982557+0000","last_fullsized":"2024-09-21T22:18:17.982557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:50:36.847828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011908800000000001,"stat_sum":{"num_bytes":20133686,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13996,"num_read_kb":60966,"num_write":531,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.3","version":"178'633","reported_seq":3915,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.095672+0000","last_change":"2024-09-21T22:18:18.979805+0000","last_active":"2024-09-21T22:18:19.095672+0000","last_peered":"2024-09-21T22:18:19.095672+0000","last_clean":"2024-09-21T22:18:19.095672+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:18:19.095672+0000","last_undegraded":"2024-09-21T22:18:19.095672+0000","last_fullsized":"2024-09-21T22:18:19.095672+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:30:31.919141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209899,"stat_sum":{"num_bytes":19845325,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4289,"num_read_kb":41028,"num_write":673,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":182,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.989550+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:18:19.989550+0000","last_peered":"2024-09-21T22:18:19.989550+0000","last_clean":"2024-09-21T22:18:19.989550+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:18:19.989550+0000","last_undegraded":"2024-09-21T22:18:19.989550+0000","last_fullsized":"2024-09-21T22:18:19.989550+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"179'651","reported_seq":18211,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.990164+0000","last_change":"2024-09-21T22:18:19.990164+0000","last_active":"2024-09-21T22:18:19.990164+0000","last_peered":"2024-09-21T22:18:19.990164+0000","last_clean":"2024-09-21T22:18:19.990164+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:18:19.990164+0000","last_undegraded":"2024-09-21T22:18:19.990164+0000","last_fullsized":"2024-09-21T22:18:19.990164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:49:56.056653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062641699999999999,"stat_sum":{"num_bytes":35880557,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":17989,"num_read_kb":72552,"num_write":794,"num_write_kb":33444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":339,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:20.068392+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:18:20.068392+0000","last_peered":"2024-09-21T22:18:20.068392+0000","last_clean":"2024-09-21T22:18:20.068392+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:18:20.068392+0000","last_undegraded":"2024-09-21T22:18:20.068392+0000","last_fullsized":"2024-09-21T22:18:20.068392+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"178'410","reported_seq":2358,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.980715+0000","last_change":"2024-09-21T22:18:18.980715+0000","last_active":"2024-09-21T22:18:18.980715+0000","last_peered":"2024-09-21T22:18:18.980715+0000","last_clean":"2024-09-21T22:18:18.980715+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:18:18.980715+0000","last_undegraded":"2024-09-21T22:18:18.980715+0000","last_fullsized":"2024-09-21T22:18:18.980715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:05:42.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047030900000000003,"stat_sum":{"num_bytes":34239934,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1434,"num_read_kb":29449,"num_write":557,"num_write_kb":25523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":332,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987047+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:18:18.987047+0000","last_peered":"2024-09-21T22:18:18.987047+0000","last_clean":"2024-09-21T22:18:18.987047+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:18:18.987047+0000","last_undegraded":"2024-09-21T22:18:18.987047+0000","last_fullsized":"2024-09-21T22:18:18.987047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"176'394","reported_seq":1573,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981915+0000","last_change":"2024-09-21T22:18:17.982172+0000","last_active":"2024-09-21T22:18:17.981915+0000","last_peered":"2024-09-21T22:18:17.981915+0000","last_clean":"2024-09-21T22:18:17.981915+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:18:17.981915+0000","last_undegraded":"2024-09-21T22:18:17.981915+0000","last_fullsized":"2024-09-21T22:18:17.981915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:16:04.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098015400000000001,"stat_sum":{"num_bytes":19572055,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1198,"num_read_kb":37422,"num_write":491,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:20.068013+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:18:20.068013+0000","last_peered":"2024-09-21T22:18:20.068013+0000","last_clean":"2024-09-21T22:18:20.068013+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:18:20.068013+0000","last_undegraded":"2024-09-21T22:18:20.068013+0000","last_fullsized":"2024-09-21T22:18:20.068013+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":484,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987083+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:18:18.987083+0000","last_peered":"2024-09-21T22:18:18.987083+0000","last_clean":"2024-09-21T22:18:18.987083+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:18:18.987083+0000","last_undegraded":"2024-09-21T22:18:18.987083+0000","last_fullsized":"2024-09-21T22:18:18.987083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"176'639","reported_seq":1989,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981248+0000","last_change":"2024-09-21T22:18:17.981653+0000","last_active":"2024-09-21T22:18:17.981248+0000","last_peered":"2024-09-21T22:18:17.981248+0000","last_clean":"2024-09-21T22:18:17.981248+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:18:17.981248+0000","last_undegraded":"2024-09-21T22:18:17.981248+0000","last_fullsized":"2024-09-21T22:18:17.981248+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:56.391591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052537000000000005,"stat_sum":{"num_bytes":21676581,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2353,"num_read_kb":21574,"num_write":943,"num_write_kb":21286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.9","version":"178'489","reported_seq":4138,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.979026+0000","last_change":"2024-09-21T22:18:18.979026+0000","last_active":"2024-09-21T22:18:18.979026+0000","last_peered":"2024-09-21T22:18:18.979026+0000","last_clean":"2024-09-21T22:18:18.979026+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:18:18.979026+0000","last_undegraded":"2024-09-21T22:18:18.979026+0000","last_fullsized":"2024-09-21T22:18:18.979026+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:32.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000675886,"stat_sum":{"num_bytes":62031789,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4168,"num_read_kb":58396,"num_write":616,"num_write_kb":34431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.a","version":"178'758","reported_seq":3050,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.061039+0000","last_change":"2024-09-21T22:18:19.059830+0000","last_active":"2024-09-21T22:18:19.061039+0000","last_peered":"2024-09-21T22:18:19.061039+0000","last_clean":"2024-09-21T22:18:19.061039+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:18:19.061039+0000","last_undegraded":"2024-09-21T22:18:19.061039+0000","last_fullsized":"2024-09-21T22:18:19.061039+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:59.336062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001889162,"stat_sum":{"num_bytes":31892515,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":3969,"num_read_kb":33069,"num_write":942,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.b","version":"177'799","reported_seq":2738,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.982827+0000","last_change":"2024-09-21T22:18:17.982827+0000","last_active":"2024-09-21T22:18:17.982827+0000","last_peered":"2024-09-21T22:18:17.982827+0000","last_clean":"2024-09-21T22:18:17.982827+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:18:17.982827+0000","last_undegraded":"2024-09-21T22:18:17.982827+0000","last_fullsized":"2024-09-21T22:18:17.982827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:29:49.398566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013943390000000001,"stat_sum":{"num_bytes":12983887,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4565,"num_read_kb":31375,"num_write":1045,"num_write_kb":31256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.c","version":"174'467","reported_seq":1744,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981316+0000","last_change":"2024-09-21T22:18:17.981797+0000","last_active":"2024-09-21T22:18:17.981316+0000","last_peered":"2024-09-21T22:18:17.981316+0000","last_clean":"2024-09-21T22:18:17.981316+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:18:17.981316+0000","last_undegraded":"2024-09-21T22:18:17.981316+0000","last_fullsized":"2024-09-21T22:18:17.981316+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:10.711675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054845299999999996,"stat_sum":{"num_bytes":35602025,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1701,"num_read_kb":37972,"num_write":639,"num_write_kb":23541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.d","version":"176'623","reported_seq":2578,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.057837+0000","last_change":"2024-09-21T22:18:19.058090+0000","last_active":"2024-09-21T22:18:19.057837+0000","last_peered":"2024-09-21T22:18:19.057837+0000","last_clean":"2024-09-21T22:18:19.057837+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:18:19.057837+0000","last_undegraded":"2024-09-21T22:18:19.057837+0000","last_fullsized":"2024-09-21T22:18:19.057837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:49.605064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043186100000000002,"stat_sum":{"num_bytes":12091468,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":3590,"num_read_kb":26521,"num_write":791,"num_write_kb":20238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.e","version":"176'647","reported_seq":2048,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987865+0000","last_change":"2024-09-21T22:18:18.988288+0000","last_active":"2024-09-21T22:18:18.987865+0000","last_peered":"2024-09-21T22:18:18.987865+0000","last_clean":"2024-09-21T22:18:18.987865+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:18:18.987865+0000","last_undegraded":"2024-09-21T22:18:18.987865+0000","last_fullsized":"2024-09-21T22:18:18.987865+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:05:29.448107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082205500000000003,"stat_sum":{"num_bytes":6302461,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":934,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.f","version":"178'555","reported_seq":2422,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.097556+0000","last_change":"2024-09-21T22:18:18.988880+0000","last_active":"2024-09-21T22:18:19.097556+0000","last_peered":"2024-09-21T22:18:19.097556+0000","last_clean":"2024-09-21T22:18:19.097556+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:18:19.097556+0000","last_undegraded":"2024-09-21T22:18:19.097556+0000","last_fullsized":"2024-09-21T22:18:19.097556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:59.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013696789999999999,"stat_sum":{"num_bytes":12441271,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2440,"num_read_kb":24801,"num_write":670,"num_write_kb":20801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.10","version":"176'348","reported_seq":2335,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.077612+0000","last_change":"2024-09-21T22:18:19.058118+0000","last_active":"2024-09-21T22:18:19.077612+0000","last_peered":"2024-09-21T22:18:19.077612+0000","last_clean":"2024-09-21T22:18:19.077612+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:18:19.077612+0000","last_undegraded":"2024-09-21T22:18:19.077612+0000","last_fullsized":"2024-09-21T22:18:19.077612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:31:51.118143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042418700000000002,"stat_sum":{"num_bytes":22571921,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1479,"num_read_kb":33975,"num_write":368,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.11","version":"178'671","reported_seq":2240,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.056133+0000","last_change":"2024-09-21T22:18:18.987783+0000","last_active":"2024-09-21T22:18:19.056133+0000","last_peered":"2024-09-21T22:18:19.056133+0000","last_clean":"2024-09-21T22:18:19.056133+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:18:19.056133+0000","last_undegraded":"2024-09-21T22:18:19.056133+0000","last_fullsized":"2024-09-21T22:18:19.056133+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:17:31.332204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055802499999999997,"stat_sum":{"num_bytes":11021589,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2713,"num_read_kb":23633,"num_write":973,"num_write_kb":20981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.12","version":"176'510","reported_seq":6835,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987652+0000","last_change":"2024-09-21T22:18:18.987882+0000","last_active":"2024-09-21T22:18:18.987652+0000","last_peered":"2024-09-21T22:18:18.987652+0000","last_clean":"2024-09-21T22:18:18.987652+0000","last_became_active":"2024-09-21T22:17:37.898981+0000","last_became_peered":"2024-09-21T22:17:37.898981+0000","last_unstale":"2024-09-21T22:18:18.987652+0000","last_undegraded":"2024-09-21T22:18:18.987652+0000","last_fullsized":"2024-09-21T22:18:18.987652+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:16:28.310917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064002899999999997,"stat_sum":{"num_bytes":16379596,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":6939,"num_read_kb":25332,"num_write":612,"num_write_kb":19627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.13","version":"176'660","reported_seq":12321,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987952+0000","last_change":"2024-09-21T22:18:18.988232+0000","last_active":"2024-09-21T22:18:18.987952+0000","last_peered":"2024-09-21T22:18:18.987952+0000","last_clean":"2024-09-21T22:18:18.987952+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:18:18.987952+0000","last_undegraded":"2024-09-21T22:18:18.987952+0000","last_fullsized":"2024-09-21T22:18:18.987952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:44:50.182745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088991899999999997,"stat_sum":{"num_bytes":39457316,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12404,"num_read_kb":63729,"num_write":829,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":858938785,"num_objects":680,"num_object_clones":0,"num_object_copies":1360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":0,"num_read":210924,"num_read_kb":1296672,"num_write":26321,"num_write_kb":881812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1390,"num_bytes_recovered":159942324,"num_keys_recovered":223,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446783488,"data_stored":444569848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19812,"ondisk_log_size":19812,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121940,"kb_used_data":50056,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94249900,"statfs":{"total":96636764160,"available":96511897600,"internally_reserved":0,"allocated":51257344,"data_stored":49900038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62432,"kb_used_data":22920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94309408,"statfs":{"total":96636764160,"available":96572833792,"internally_reserved":0,"allocated":23470080,"data_stored":22245465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129248,"kb_used_data":61956,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94242592,"statfs":{"total":96636764160,"available":96504414208,"internally_reserved":0,"allocated":63442944,"data_stored":62051839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153716,"kb_used_data":86428,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94218124,"statfs":{"total":96636764160,"available":96479358976,"internally_reserved":0,"allocated":88502272,"data_stored":86988357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528349,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121092,"kb_used_data":70772,"kb_used_omap":4,"kb_used_meta":50299,"kb_avail":94250748,"statfs":{"total":96636764160,"available":96512765952,"internally_reserved":0,"allocated":72470528,"data_stored":70978746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":51506866},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68884,"kb_used_data":33536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":34340864,"data_stored":33063393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88836,"kb_used_data":61808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94283004,"statfs":{"total":96636764160,"available":96545796096,"internally_reserved":0,"allocated":63291392,"data_stored":61909432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155868,"kb_used_data":80260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94215972,"statfs":{"total":96636764160,"available":96477155328,"internally_reserved":0,"allocated":82186240,"data_stored":80769626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":78073856,"data_stored":77760510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":56668160,"data_stored":56407013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32014336,"data_stored":31850869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70336512,"data_stored":69932428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":82509824,"data_stored":82111471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59346944,"data_stored":59062150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21286912,"data_stored":21158642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46546944,"data_stored":46286765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:18:21.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:18:21.376 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:21.376 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:21.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:21.417 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:21.417+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:21.519 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:21.518+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:21.531 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:21.531 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:21.540 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:21.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:21.619+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:21.627 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:18:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:18:21.641 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-21T22:18:21.202985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":859529172,"num_objects":684,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":684,"num_whiteouts":0,"num_read":211040,"num_read_kb":1296772,"num_write":26482,"num_write_kb":884230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1390,"num_bytes_recovered":159942324,"num_keys_recovered":223,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19932,"ondisk_log_size":19932,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":902016,"kb_used_data":467736,"kb_used_omap":15,"kb_used_meta":433648,"kb_avail":754072704,"statfs":{"total":773094113280,"available":772170448896,"internally_reserved":0,"allocated":478961664,"data_stored":467906896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":444056348},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-168122554,"num_objects":-246,"num_object_clones":0,"num_object_copies":-492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-246,"num_whiteouts":0,"num_read":1166,"num_read_kb":996,"num_write":434,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000677"},"pg_stats":[{"pgid":"3.1f","version":"178'1226","reported_seq":27563,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.981217+0000","last_change":"2024-09-21T22:18:18.981217+0000","last_active":"2024-09-21T22:18:18.981217+0000","last_peered":"2024-09-21T22:18:18.981217+0000","last_clean":"2024-09-21T22:18:18.981217+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:18:18.981217+0000","last_undegraded":"2024-09-21T22:18:18.981217+0000","last_fullsized":"2024-09-21T22:18:18.981217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:24:05.701132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098070800000000006,"stat_sum":{"num_bytes":43390645,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":29863,"num_read_kb":75399,"num_write":2062,"num_write_kb":47569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1e","version":"177'700","reported_seq":4134,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.092772+0000","last_change":"2024-09-21T22:18:17.981915+0000","last_active":"2024-09-21T22:18:18.092772+0000","last_peered":"2024-09-21T22:18:18.092772+0000","last_clean":"2024-09-21T22:18:18.092772+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:18:18.092772+0000","last_undegraded":"2024-09-21T22:18:18.092772+0000","last_fullsized":"2024-09-21T22:18:18.092772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:42.723537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000783568,"stat_sum":{"num_bytes":25777853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5046,"num_read_kb":36168,"num_write":874,"num_write_kb":21910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1d","version":"178'407","reported_seq":8314,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.979367+0000","last_change":"2024-09-21T22:18:18.979367+0000","last_active":"2024-09-21T22:18:18.979367+0000","last_peered":"2024-09-21T22:18:18.979367+0000","last_clean":"2024-09-21T22:18:18.979367+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:18:18.979367+0000","last_undegraded":"2024-09-21T22:18:18.979367+0000","last_fullsized":"2024-09-21T22:18:18.979367+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:02:41.235157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085185399999999998,"stat_sum":{"num_bytes":52353770,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":7443,"num_read_kb":59847,"num_write":487,"num_write_kb":33904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1c","version":"178'863","reported_seq":3556,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.035602+0000","last_change":"2024-09-21T22:18:18.979821+0000","last_active":"2024-09-21T22:18:19.035602+0000","last_peered":"2024-09-21T22:18:19.035602+0000","last_clean":"2024-09-21T22:18:19.035602+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:18:19.035602+0000","last_undegraded":"2024-09-21T22:18:19.035602+0000","last_fullsized":"2024-09-21T22:18:19.035602+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:59:06.937223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099921800000000007,"stat_sum":{"num_bytes":22322254,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4575,"num_read_kb":35379,"num_write":1290,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1b","version":"178'463","reported_seq":10840,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.068957+0000","last_change":"2024-09-21T22:18:18.980788+0000","last_active":"2024-09-21T22:18:19.068957+0000","last_peered":"2024-09-21T22:18:19.068957+0000","last_clean":"2024-09-21T22:18:19.068957+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:18:19.068957+0000","last_undegraded":"2024-09-21T22:18:19.068957+0000","last_fullsized":"2024-09-21T22:18:19.068957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:43:30.486465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039184199999999999,"stat_sum":{"num_bytes":20491389,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":10743,"num_read_kb":37317,"num_write":491,"num_write_kb":23302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1a","version":"177'315","reported_seq":2858,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.082963+0000","last_change":"2024-09-21T22:18:18.979067+0000","last_active":"2024-09-21T22:18:19.082963+0000","last_peered":"2024-09-21T22:18:19.082963+0000","last_clean":"2024-09-21T22:18:19.082963+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:18:19.082963+0000","last_undegraded":"2024-09-21T22:18:19.082963+0000","last_fullsized":"2024-09-21T22:18:19.082963+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:46:08.397680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068726200000000001,"stat_sum":{"num_bytes":7718890,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":2268,"num_read_kb":17386,"num_write":391,"num_write_kb":17801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.19","version":"179'738","reported_seq":3684,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.991137+0000","last_change":"2024-09-21T22:18:19.991137+0000","last_active":"2024-09-21T22:18:19.991137+0000","last_peered":"2024-09-21T22:18:19.991137+0000","last_clean":"2024-09-21T22:18:19.991137+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:18:19.991137+0000","last_undegraded":"2024-09-21T22:18:19.991137+0000","last_fullsized":"2024-09-21T22:18:19.991137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:35:20.212065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00153386,"stat_sum":{"num_bytes":12801248,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":5235,"num_read_kb":28252,"num_write":824,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.18","version":"176'779","reported_seq":2476,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981984+0000","last_change":"2024-09-21T22:18:17.982179+0000","last_active":"2024-09-21T22:18:17.981984+0000","last_peered":"2024-09-21T22:18:17.981984+0000","last_clean":"2024-09-21T22:18:17.981984+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:18:17.981984+0000","last_undegraded":"2024-09-21T22:18:17.981984+0000","last_fullsized":"2024-09-21T22:18:17.981984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:19:15.578579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011395839999999999,"stat_sum":{"num_bytes":21737168,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3625,"num_read_kb":22875,"num_write":962,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.17","version":"178'1124","reported_seq":3723,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.098299+0000","last_change":"2024-09-21T22:18:18.981071+0000","last_active":"2024-09-21T22:18:19.098299+0000","last_peered":"2024-09-21T22:18:19.098299+0000","last_clean":"2024-09-21T22:18:19.098299+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:18:19.098299+0000","last_undegraded":"2024-09-21T22:18:19.098299+0000","last_fullsized":"2024-09-21T22:18:19.098299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:49.594215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055199199999999996,"stat_sum":{"num_bytes":12281890,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6151,"num_read_kb":35343,"num_write":1959,"num_write_kb":25029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.16","version":"178'289","reported_seq":14249,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.990279+0000","last_change":"2024-09-21T22:18:19.991102+0000","last_active":"2024-09-21T22:18:19.990279+0000","last_peered":"2024-09-21T22:18:19.990279+0000","last_clean":"2024-09-21T22:18:19.990279+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:18:19.990279+0000","last_undegraded":"2024-09-21T22:18:19.990279+0000","last_fullsized":"2024-09-21T22:18:19.990279+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:09:25.660924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012127209999999999,"stat_sum":{"num_bytes":41379263,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":371,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.15","version":"178'827","reported_seq":3547,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.988425+0000","last_change":"2024-09-21T22:18:18.988425+0000","last_active":"2024-09-21T22:18:18.988425+0000","last_peered":"2024-09-21T22:18:18.988425+0000","last_clean":"2024-09-21T22:18:18.988425+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:18:18.988425+0000","last_undegraded":"2024-09-21T22:18:18.988425+0000","last_fullsized":"2024-09-21T22:18:18.988425+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:28.661383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010455670000000001,"stat_sum":{"num_bytes":45112917,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":4378,"num_read_kb":45774,"num_write":1172,"num_write_kb":35129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.14","version":"176'978","reported_seq":4898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.979178+0000","last_change":"2024-09-21T22:18:18.979468+0000","last_active":"2024-09-21T22:18:18.979178+0000","last_peered":"2024-09-21T22:18:18.979178+0000","last_clean":"2024-09-21T22:18:18.979178+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:18:18.979178+0000","last_undegraded":"2024-09-21T22:18:18.979178+0000","last_fullsized":"2024-09-21T22:18:18.979178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:18:46.476351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093384399999999997,"stat_sum":{"num_bytes":44911202,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5989,"num_read_kb":47954,"num_write":1444,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":330,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.057531+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:18:19.057531+0000","last_peered":"2024-09-21T22:18:19.057531+0000","last_clean":"2024-09-21T22:18:19.057531+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:18:19.057531+0000","last_undegraded":"2024-09-21T22:18:19.057531+0000","last_fullsized":"2024-09-21T22:18:19.057531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"178'452","reported_seq":3860,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.980995+0000","last_change":"2024-09-21T22:18:18.980995+0000","last_active":"2024-09-21T22:18:18.980995+0000","last_peered":"2024-09-21T22:18:18.980995+0000","last_clean":"2024-09-21T22:18:18.980995+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:18:18.980995+0000","last_undegraded":"2024-09-21T22:18:18.980995+0000","last_fullsized":"2024-09-21T22:18:18.980995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:37.316883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048224200000000002,"stat_sum":{"num_bytes":32213787,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3697,"num_read_kb":43420,"num_write":480,"num_write_kb":27040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":336,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.990147+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:18:19.990147+0000","last_peered":"2024-09-21T22:18:19.990147+0000","last_clean":"2024-09-21T22:18:19.990147+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:18:19.990147+0000","last_undegraded":"2024-09-21T22:18:19.990147+0000","last_fullsized":"2024-09-21T22:18:19.990147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"177'448","reported_seq":10905,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.982500+0000","last_change":"2024-09-21T22:18:17.982500+0000","last_active":"2024-09-21T22:18:17.982500+0000","last_peered":"2024-09-21T22:18:17.982500+0000","last_clean":"2024-09-21T22:18:17.982500+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:18:17.982500+0000","last_undegraded":"2024-09-21T22:18:17.982500+0000","last_fullsized":"2024-09-21T22:18:17.982500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:22.322467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011672830000000001,"stat_sum":{"num_bytes":27119345,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":10651,"num_read_kb":38318,"num_write":575,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987363+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:18:18.987363+0000","last_peered":"2024-09-21T22:18:18.987363+0000","last_clean":"2024-09-21T22:18:18.987363+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:18:18.987363+0000","last_undegraded":"2024-09-21T22:18:18.987363+0000","last_fullsized":"2024-09-21T22:18:18.987363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"179'478","reported_seq":9925,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:20.103791+0000","last_change":"2024-09-21T22:18:19.990765+0000","last_active":"2024-09-21T22:18:20.103791+0000","last_peered":"2024-09-21T22:18:20.103791+0000","last_clean":"2024-09-21T22:18:20.103791+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:18:20.103791+0000","last_undegraded":"2024-09-21T22:18:20.103791+0000","last_fullsized":"2024-09-21T22:18:20.103791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:59:40.549573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001155241,"stat_sum":{"num_bytes":35203188,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":9409,"num_read_kb":64258,"num_write":531,"num_write_kb":36425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":336,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.989669+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:18:19.989669+0000","last_peered":"2024-09-21T22:18:19.989669+0000","last_clean":"2024-09-21T22:18:19.989669+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:18:19.989669+0000","last_undegraded":"2024-09-21T22:18:19.989669+0000","last_fullsized":"2024-09-21T22:18:19.989669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"177'471","reported_seq":14239,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.982557+0000","last_change":"2024-09-21T22:18:17.982557+0000","last_active":"2024-09-21T22:18:17.982557+0000","last_peered":"2024-09-21T22:18:17.982557+0000","last_clean":"2024-09-21T22:18:17.982557+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:18:17.982557+0000","last_undegraded":"2024-09-21T22:18:17.982557+0000","last_fullsized":"2024-09-21T22:18:17.982557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:50:36.847828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011908800000000001,"stat_sum":{"num_bytes":20133686,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13996,"num_read_kb":60966,"num_write":531,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.3","version":"178'633","reported_seq":3915,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.095672+0000","last_change":"2024-09-21T22:18:18.979805+0000","last_active":"2024-09-21T22:18:19.095672+0000","last_peered":"2024-09-21T22:18:19.095672+0000","last_clean":"2024-09-21T22:18:19.095672+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:18:19.095672+0000","last_undegraded":"2024-09-21T22:18:19.095672+0000","last_fullsized":"2024-09-21T22:18:19.095672+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:30:31.919141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209899,"stat_sum":{"num_bytes":19845325,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4289,"num_read_kb":41028,"num_write":673,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":182,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.989550+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:18:19.989550+0000","last_peered":"2024-09-21T22:18:19.989550+0000","last_clean":"2024-09-21T22:18:19.989550+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:18:19.989550+0000","last_undegraded":"2024-09-21T22:18:19.989550+0000","last_fullsized":"2024-09-21T22:18:19.989550+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"179'651","reported_seq":18211,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.990164+0000","last_change":"2024-09-21T22:18:19.990164+0000","last_active":"2024-09-21T22:18:19.990164+0000","last_peered":"2024-09-21T22:18:19.990164+0000","last_clean":"2024-09-21T22:18:19.990164+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:18:19.990164+0000","last_undegraded":"2024-09-21T22:18:19.990164+0000","last_fullsized":"2024-09-21T22:18:19.990164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:49:56.056653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062641699999999999,"stat_sum":{"num_bytes":35880557,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":17989,"num_read_kb":72552,"num_write":794,"num_write_kb":33444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":339,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:20.068392+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:18:20.068392+0000","last_peered":"2024-09-21T22:18:20.068392+0000","last_clean":"2024-09-21T22:18:20.068392+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:18:20.068392+0000","last_undegraded":"2024-09-21T22:18:20.068392+0000","last_fullsized":"2024-09-21T22:18:20.068392+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"178'410","reported_seq":2358,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.980715+0000","last_change":"2024-09-21T22:18:18.980715+0000","last_active":"2024-09-21T22:18:18.980715+0000","last_peered":"2024-09-21T22:18:18.980715+0000","last_clean":"2024-09-21T22:18:18.980715+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:18:18.980715+0000","last_undegraded":"2024-09-21T22:18:18.980715+0000","last_fullsized":"2024-09-21T22:18:18.980715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:05:42.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047030900000000003,"stat_sum":{"num_bytes":34239934,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1434,"num_read_kb":29449,"num_write":557,"num_write_kb":25523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":332,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987047+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:18:18.987047+0000","last_peered":"2024-09-21T22:18:18.987047+0000","last_clean":"2024-09-21T22:18:18.987047+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:18:18.987047+0000","last_undegraded":"2024-09-21T22:18:18.987047+0000","last_fullsized":"2024-09-21T22:18:18.987047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"176'394","reported_seq":1573,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981915+0000","last_change":"2024-09-21T22:18:17.982172+0000","last_active":"2024-09-21T22:18:17.981915+0000","last_peered":"2024-09-21T22:18:17.981915+0000","last_clean":"2024-09-21T22:18:17.981915+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:18:17.981915+0000","last_undegraded":"2024-09-21T22:18:17.981915+0000","last_fullsized":"2024-09-21T22:18:17.981915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:16:04.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098015400000000001,"stat_sum":{"num_bytes":19572055,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1198,"num_read_kb":37422,"num_write":491,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T22:18:20.068013+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:18:20.068013+0000","last_peered":"2024-09-21T22:18:20.068013+0000","last_clean":"2024-09-21T22:18:20.068013+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:18:20.068013+0000","last_undegraded":"2024-09-21T22:18:20.068013+0000","last_fullsized":"2024-09-21T22:18:20.068013+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":484,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987083+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:18:18.987083+0000","last_peered":"2024-09-21T22:18:18.987083+0000","last_clean":"2024-09-21T22:18:18.987083+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:18:18.987083+0000","last_undegraded":"2024-09-21T22:18:18.987083+0000","last_fullsized":"2024-09-21T22:18:18.987083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"176'639","reported_seq":1989,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981248+0000","last_change":"2024-09-21T22:18:17.981653+0000","last_active":"2024-09-21T22:18:17.981248+0000","last_peered":"2024-09-21T22:18:17.981248+0000","last_clean":"2024-09-21T22:18:17.981248+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:18:17.981248+0000","last_undegraded":"2024-09-21T22:18:17.981248+0000","last_fullsized":"2024-09-21T22:18:17.981248+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:56.391591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052537000000000005,"stat_sum":{"num_bytes":21676581,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2353,"num_read_kb":21574,"num_write":943,"num_write_kb":21286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.9","version":"178'489","reported_seq":4138,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.979026+0000","last_change":"2024-09-21T22:18:18.979026+0000","last_active":"2024-09-21T22:18:18.979026+0000","last_peered":"2024-09-21T22:18:18.979026+0000","last_clean":"2024-09-21T22:18:18.979026+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:18:18.979026+0000","last_undegraded":"2024-09-21T22:18:18.979026+0000","last_fullsized":"2024-09-21T22:18:18.979026+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:32.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000675886,"stat_sum":{"num_bytes":62031789,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4168,"num_read_kb":58396,"num_write":616,"num_write_kb":34431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.a","version":"178'758","reported_seq":3050,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.061039+0000","last_change":"2024-09-21T22:18:19.059830+0000","last_active":"2024-09-21T22:18:19.061039+0000","last_peered":"2024-09-21T22:18:19.061039+0000","last_clean":"2024-09-21T22:18:19.061039+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:18:19.061039+0000","last_undegraded":"2024-09-21T22:18:19.061039+0000","last_fullsized":"2024-09-21T22:18:19.061039+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:59.336062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001889162,"stat_sum":{"num_bytes":31892515,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":3969,"num_read_kb":33069,"num_write":942,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.b","version":"177'799","reported_seq":2738,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.982827+0000","last_change":"2024-09-21T22:18:17.982827+0000","last_active":"2024-09-21T22:18:17.982827+0000","last_peered":"2024-09-21T22:18:17.982827+0000","last_clean":"2024-09-21T22:18:17.982827+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:18:17.982827+0000","last_undegraded":"2024-09-21T22:18:17.982827+0000","last_fullsized":"2024-09-21T22:18:17.982827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:29:49.398566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013943390000000001,"stat_sum":{"num_bytes":12983887,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4565,"num_read_kb":31375,"num_write":1045,"num_write_kb":31256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.c","version":"174'467","reported_seq":1744,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T22:18:17.981316+0000","last_change":"2024-09-21T22:18:17.981797+0000","last_active":"2024-09-21T22:18:17.981316+0000","last_peered":"2024-09-21T22:18:17.981316+0000","last_clean":"2024-09-21T22:18:17.981316+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:18:17.981316+0000","last_undegraded":"2024-09-21T22:18:17.981316+0000","last_fullsized":"2024-09-21T22:18:17.981316+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:10.711675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054845299999999996,"stat_sum":{"num_bytes":35602025,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1701,"num_read_kb":37972,"num_write":639,"num_write_kb":23541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.d","version":"176'623","reported_seq":2578,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.057837+0000","last_change":"2024-09-21T22:18:19.058090+0000","last_active":"2024-09-21T22:18:19.057837+0000","last_peered":"2024-09-21T22:18:19.057837+0000","last_clean":"2024-09-21T22:18:19.057837+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:18:19.057837+0000","last_undegraded":"2024-09-21T22:18:19.057837+0000","last_fullsized":"2024-09-21T22:18:19.057837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:49.605064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043186100000000002,"stat_sum":{"num_bytes":12091468,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":3590,"num_read_kb":26521,"num_write":791,"num_write_kb":20238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.e","version":"176'647","reported_seq":2048,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987865+0000","last_change":"2024-09-21T22:18:18.988288+0000","last_active":"2024-09-21T22:18:18.987865+0000","last_peered":"2024-09-21T22:18:18.987865+0000","last_clean":"2024-09-21T22:18:18.987865+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:18:18.987865+0000","last_undegraded":"2024-09-21T22:18:18.987865+0000","last_fullsized":"2024-09-21T22:18:18.987865+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:05:29.448107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082205500000000003,"stat_sum":{"num_bytes":6302461,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":934,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.f","version":"178'555","reported_seq":2422,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.097556+0000","last_change":"2024-09-21T22:18:18.988880+0000","last_active":"2024-09-21T22:18:19.097556+0000","last_peered":"2024-09-21T22:18:19.097556+0000","last_clean":"2024-09-21T22:18:19.097556+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:18:19.097556+0000","last_undegraded":"2024-09-21T22:18:19.097556+0000","last_fullsized":"2024-09-21T22:18:19.097556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:59.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013696789999999999,"stat_sum":{"num_bytes":12441271,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2440,"num_read_kb":24801,"num_write":670,"num_write_kb":20801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.10","version":"176'348","reported_seq":2335,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.077612+0000","last_change":"2024-09-21T22:18:19.058118+0000","last_active":"2024-09-21T22:18:19.077612+0000","last_peered":"2024-09-21T22:18:19.077612+0000","last_clean":"2024-09-21T22:18:19.077612+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:18:19.077612+0000","last_undegraded":"2024-09-21T22:18:19.077612+0000","last_fullsized":"2024-09-21T22:18:19.077612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:31:51.118143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042418700000000002,"stat_sum":{"num_bytes":22571921,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1479,"num_read_kb":33975,"num_write":368,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.11","version":"178'671","reported_seq":2240,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:19.056133+0000","last_change":"2024-09-21T22:18:18.987783+0000","last_active":"2024-09-21T22:18:19.056133+0000","last_peered":"2024-09-21T22:18:19.056133+0000","last_clean":"2024-09-21T22:18:19.056133+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:18:19.056133+0000","last_undegraded":"2024-09-21T22:18:19.056133+0000","last_fullsized":"2024-09-21T22:18:19.056133+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:17:31.332204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055802499999999997,"stat_sum":{"num_bytes":11021589,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2713,"num_read_kb":23633,"num_write":973,"num_write_kb":20981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.12","version":"176'510","reported_seq":6835,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987652+0000","last_change":"2024-09-21T22:18:18.987882+0000","last_active":"2024-09-21T22:18:18.987652+0000","last_peered":"2024-09-21T22:18:18.987652+0000","last_clean":"2024-09-21T22:18:18.987652+0000","last_became_active":"2024-09-21T22:17:37.898981+0000","last_became_peered":"2024-09-21T22:17:37.898981+0000","last_unstale":"2024-09-21T22:18:18.987652+0000","last_undegraded":"2024-09-21T22:18:18.987652+0000","last_fullsized":"2024-09-21T22:18:18.987652+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:16:28.310917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064002899999999997,"stat_sum":{"num_bytes":16379596,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":6939,"num_read_kb":25332,"num_write":612,"num_write_kb":19627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.13","version":"176'660","reported_seq":12321,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T22:18:18.987952+0000","last_change":"2024-09-21T22:18:18.988232+0000","last_active":"2024-09-21T22:18:18.987952+0000","last_peered":"2024-09-21T22:18:18.987952+0000","last_clean":"2024-09-21T22:18:18.987952+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:18:18.987952+0000","last_undegraded":"2024-09-21T22:18:18.987952+0000","last_fullsized":"2024-09-21T22:18:18.987952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:44:50.182745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088991899999999997,"stat_sum":{"num_bytes":39457316,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12404,"num_read_kb":63729,"num_write":829,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"},{"start":"3b","length":"1"},{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"41","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":858938785,"num_objects":680,"num_object_clones":0,"num_object_copies":1360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":0,"num_read":210924,"num_read_kb":1296672,"num_write":26321,"num_write_kb":881812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1390,"num_bytes_recovered":159942324,"num_keys_recovered":223,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446783488,"data_stored":444569848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19812,"ondisk_log_size":19812,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121940,"kb_used_data":50056,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94249900,"statfs":{"total":96636764160,"available":96511897600,"internally_reserved":0,"allocated":51257344,"data_stored":49900038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62432,"kb_used_data":22920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94309408,"statfs":{"total":96636764160,"available":96572833792,"internally_reserved":0,"allocated":23470080,"data_stored":22245465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129248,"kb_used_data":61956,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94242592,"statfs":{"total":96636764160,"available":96504414208,"internally_reserved":0,"allocated":63442944,"data_stored":62051839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153716,"kb_used_data":86428,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94218124,"statfs":{"total":96636764160,"available":96479358976,"internally_reserved":0,"allocated":88502272,"data_stored":86988357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528349,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121092,"kb_used_data":70772,"kb_used_omap":4,"kb_used_meta":50299,"kb_avail":94250748,"statfs":{"total":96636764160,"available":96512765952,"internally_reserved":0,"allocated":72470528,"data_stored":70978746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":51506866},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68884,"kb_used_data":33536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":34340864,"data_stored":33063393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88836,"kb_used_data":61808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94283004,"statfs":{"total":96636764160,"available":96545796096,"internally_reserved":0,"allocated":63291392,"data_stored":61909432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155868,"kb_used_data":80260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94215972,"statfs":{"total":96636764160,"available":96477155328,"internally_reserved":0,"allocated":82186240,"data_stored":80769626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":78073856,"data_stored":77760510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":56668160,"data_stored":56407013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32014336,"data_stored":31850869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70336512,"data_stored":69932428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":82509824,"data_stored":82111471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59346944,"data_stored":59062150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21286912,"data_stored":21158642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46546944,"data_stored":46286765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:18:21.643 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:18:21.643 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:18:21.643 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-21T22:18:21.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-21T22:18:21.645 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:21.646 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:21.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:21.721 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:21.720+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:21.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-21T22:18:21.803 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:21.803 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:21.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:21.856 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:21.855+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:21.923 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:21.922+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:21.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-21T22:18:21.975 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:21.975 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:21.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:22.024 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:22.023+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:22.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-21T22:18:22.124 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:22.123+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:22.137 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:22.137 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:22.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:22.224 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:22.224+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:22.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-21T22:18:22.295 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:22.295 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:22.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:22.326 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:22.325+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:22.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-21T22:18:22.434 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:22.433+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:22.451 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:22.451 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:22.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:22.526 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-21T22:18:22.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:22.566+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:22.606 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:22.606 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:22.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:22.628 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:22.627+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:22.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-21T22:18:22.729 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:22.728+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:22.763 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:22.763 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:22.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:22.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:22.829+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:22.878 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:22.878 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:22.887 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:22.930 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:22.930+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:23.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:18:23.031 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:23.030+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:23.040 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:23.040 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:23.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:23.132 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:23.132+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:23.163 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:23.163 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:23.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:23.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:23.233 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:23.232+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:23.317 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:23.317 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:23.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:23.350 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:23.367 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:23.370 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:23.369+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:23.383 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:23.398 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:23.415 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:23.432 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:23.432 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:23.432 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:23.432 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:23.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 128.23138002300001, 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:23.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:23.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:23.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 128.229504142, 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.442 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.466178795000005, 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.443 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:23.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:23.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:23.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 81.613853003000003, 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:23.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:23.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 81.338316387999996, 2024-09-21T22:18:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 36.006660744999998, 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.501757962999999, 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.501732643, 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.468 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:23.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.501698114, 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.501654555000002, 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:23.479 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.501629092999998, 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:23.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:23.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.501611885999999, 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.484 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:23.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:23.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.431543803, 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:23.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:23.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.431520420999998, 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.492 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.431500651, 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.496 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:23.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.431481715, 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 30.431461771999999, 2024-09-21T22:18:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.286122213999999, 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:23.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:23.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.258915678000001, 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:23.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:23.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:23.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.518 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.242548842000001, 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:23.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:23.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:23.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:23.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:23.523 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.523 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.523 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.523 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.523 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.523 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:23.524 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:23.524 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:23.524 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:23.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:23.526 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:23.526 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:23.523+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:23.625 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:23.625+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:23.669 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:23.669 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:23.669 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:23.669 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:23.677 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:23.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:23.726+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:23.782 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:23.782 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:23.782 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:23.782 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:23.782 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:23.791 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:23.834 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:23.834+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:23.895 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.895 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.94609698599999, 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.899 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.94607762300001, 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.900 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:23.903 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.94604497500001, 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:23.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:23.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:23.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.907 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.945993808, 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.908 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:23.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.94596713600001, 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.912 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.94594233699999, 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:23.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.945911389, 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.920 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:23.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:23.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.94588717100001, 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:23.924 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.94586281900001, 2024-09-21T22:18:23.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.945838576, 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:23.932 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.945808841, 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 138.945773371, 2024-09-21T22:18:23.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:23.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.90824216599999, 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.944 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:23.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.71537450700001, 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:23.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:23.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.710007975, 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:23.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:23.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:23.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.69244318200001, 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.660062189, 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:23.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.612258743, 2024-09-21T22:18:23.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.972 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.705441422, 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:23.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.69835879, 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:23.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:23.980 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:23.982 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:23.982 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:23.981+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:24.013 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:18:24.082 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:24.082+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:24.137 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:24.137 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:24.137 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:24.137 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:24.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:24.183 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:24.183+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:24.284 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:24.283+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:24.290 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:24.291 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:24.291 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:24.291 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:24.291 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:24.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:24.385 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:24.385+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:24.446 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:24.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 147.93313038299999, 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:18:24.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:18:24.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:18:24.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 143.53018807999999, 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.452 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.454 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 143.53012522500001, 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:24.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:18:24.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:18:24.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:18:24.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:18:24.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403362385999998, 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:18:24.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403327294999997, 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.469 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.470 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.471 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.472 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403312855999999, 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.473 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.474 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.475 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.476 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403298196999998, 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.477 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.478 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.479 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:18:24.480 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403285154000002, 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.481 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:24.482 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:18:24.483 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:18:24.484 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403261665000002, 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.485 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:18:24.487 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:18:24.488 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403248527000002, 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:18:24.489 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:18:24.491 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403238391999999, 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.493 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:18:24.495 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.496 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403137870000002, 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.497 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:18:24.498 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:18:24.499 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:18:24.500 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403120076999997, 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.501 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:24.502 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:18:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:18:24.504 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403099556999997, 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:18:24.505 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.506 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.507 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.508 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.403077556, 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.509 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.510 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.511 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.512 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.395103628000001, 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.513 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:18:24.514 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:18:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:18:24.516 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178642 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3735552~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.377896047999997, 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015880737999999998, 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.517 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178642 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066649+0000", 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.518 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066650+0000", 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5300000000000003e-07 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066654+0000", 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5709999999999999e-06 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066665+0000", 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0209e-05 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066671+0000", 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7120000000000003e-06 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080727+0000", 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014055896 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.080811+0000", 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3710999999999999e-05 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.520 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082530+0000", 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0017187859999999999 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.377701318, 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.521 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.522 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:18:24.523 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.524 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.377559220999999, 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.525 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.526 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:18:24.527 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:18:24.528 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.377163336000002, 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.529 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.530 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.531 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.533 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:24.535 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:24.535 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:24.534+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:24.635 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:24.635+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:24.679 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:24.679 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:24.679 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:24.679 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:24.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:24.737 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:24.736+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:24.792 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:24.792 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:24.792 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:24.792 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:24.792 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:24.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:24.838 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:24.837+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:24.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:24.938+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:24.945 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:24.945 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.54368864, 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.949 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543641763, 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.950 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543577023, 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.954 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.958 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.54354079399999, 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543446867, 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.54342309899999, 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543358228, 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:24.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.54332060500001, 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.975 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.976 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:24.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:24.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.54327981199999, 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.979 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:24.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:24.983 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543204351, 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.987 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543133978, 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:24.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:24.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.991 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543100303, 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:24.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:24.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.543031551, 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:24.996 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:24.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:24.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.54298715500001, 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.542896207, 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:25.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.008 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.542867683, 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.012 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.542835389, 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:25.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:25.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:25.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:25.016 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.542797256, 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:25.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:25.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:25.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:25.020 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 28.773070154999999, 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:25.021 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:25.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:25.025 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.026 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 23.947089680000001, 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:25.027 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:25.028 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:25.029 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:25.030 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:25.032 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:25.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:25.039 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:25.038+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:25.139 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:25.138+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:25.176 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:25.176 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:25.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.176 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:211843 3.7 3:e208a70b:::rbd_header.11851c929b6b:head [call rbd.set_protection_status in=33b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e184)", 2024-09-21T22:18:25.176 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:18:25.174700+0000", 2024-09-21T22:18:25.176 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00081899100000000003, 2024-09-21T22:18:25.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00083695299999999998, 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 211843 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174700+0000", 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174700+0000", 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174701+0000", 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8199999999999999e-07 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174705+0000", 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5109999999999997e-06 2024-09-21T22:18:25.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174715+0000", 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0314e-05 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174721+0000", 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2650000000000004e-06 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174757+0000", 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6668000000000002e-05 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174824+0000", 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6829999999999995e-05 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.174976+0000", 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015140499999999999 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:25.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:25.175370+0000", 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039417100000000002 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-09-21T22:18:25.181 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:25.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:25.240 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:25.239+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:25.291 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:25.291 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:25.291 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:25.291 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:25.291 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:25.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:25.341 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:25.341+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:25.443 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:25.442+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 145.53297408500001, 2024-09-21T22:18:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:18:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 145.53035201200001, 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:18:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.547646813999997, 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:18:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.498360963000003, 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:18:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:18:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.496110272999999, 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:18:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:18:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:18:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.496008121999999, 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.492187846, 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.492167707999997, 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:18:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.492147189999997, 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:18:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.464220646000001, 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:18:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.464201076000002, 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.464182485000002, 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.464162805000001, 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.464134444999999, 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.464112903, 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:18:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:18:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:18:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190908 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 303104~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.514216984000001, 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057426265999999997, 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190908 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928944+0000", 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2010000000000002e-06 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928951+0000", 2024-09-21T22:18:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928956+0000", 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1030000000000001e-06 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986168+0000", 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212363000000002 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986213+0000", 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5142999999999998e-05 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986367+0000", 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190909 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 385024~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.514195876000002, 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057618427999999999, 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190909 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928963+0000", 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928965+0000", 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928972+0000", 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5610000000000001e-06 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928977+0000", 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986391+0000", 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057413929000000002 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986434+0000", 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2582e-05 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986581+0000", 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014685300000000001 2024-09-21T22:18:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190910 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 450560~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.514174050000001, 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057841218, 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190910 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928987+0000", 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6740000000000001e-06 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928993+0000", 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929000+0000", 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6159999999999998e-06 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986611+0000", 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057611258999999998 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986651+0000", 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0303999999999999e-05 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986825+0000", 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173847 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190911 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 598016~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.514152795999998, 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058186806000000001, 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190911 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929007+0000", 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929012+0000", 2024-09-21T22:18:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929015+0000", 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986859+0000", 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057844049000000002 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986940+0000", 2024-09-21T22:18:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1265000000000002e-05 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.987192+0000", 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175700000000002 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200490 3.b 3:d36e58d9:::rbd_data.1185b457050c.0000000000000005:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.268735467999999, 2024-09-21T22:18:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067382992000000003, 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200490 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174426+0000", 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3400000000000002e-06 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183430+0000", 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090044610000000001 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183473+0000", 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2531000000000003e-05 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183494+0000", 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0939999999999999e-05 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183619+0000", 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125334 2024-09-21T22:18:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183864+0000", 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000244536 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.184078+0000", 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021405400000000001 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237365+0000", 2024-09-21T22:18:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053287147999999999 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241686+0000", 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043208910000000003 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241753+0000", 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7396000000000003e-05 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241806+0000", 2024-09-21T22:18:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2361000000000002e-05 2024-09-21T22:18:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:25.536 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:25.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:25.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:25.544 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:25.543+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:25.645 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:25.644+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:25.686 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:25.686 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:25.699 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:25.706 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:25.706 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:25.724 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:25.725 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:25.741 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:25.741 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:25.746 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:25.745+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:25.757 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:25.757 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:25.774 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:25.775 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:25.791 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:25.791 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:25.804 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:25.805 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:25.808 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:25.808 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:25.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:25.825 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:25.878 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:25.877+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:25.929 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:25.929 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:25.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:25.947 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:25.946+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:26.034 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:18:26.048 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:26.047+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.093 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:26.148 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:26.148+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:26.216 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.217 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:26.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:26.268+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.330 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:26.350 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:26.349+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:26.450 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:26.449+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:26.484 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.485 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:26.551 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:26.550+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:26.596 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.596 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:26.652 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:26.651+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:26.708 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.708 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:26.753 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:26.752+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:26.826 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.826 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:26.880 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:26.879+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:18:26.945 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:26.945 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:26.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:26.965 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:26.964+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:27.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:27.055+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:27.100 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.100 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:27.156 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:27.156+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:27.213 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.213 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:27.258 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:27.256+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:27.327 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.327 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:27.359 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:27.358+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:27.440 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.440 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:27.459 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:27.458+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:27.553 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.553 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.560 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:27.559+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:27.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:27.661 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:27.660+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:27.665 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.666 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.674 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:27.761 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:27.759+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:27.818 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.818 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:27.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:27.842 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:18:27.842 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:18:27.842 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:18:27.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:18:27.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:27.879+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:27.934 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:27.934 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:27.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:27.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:27.961+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:27.983 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:28.011 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:28.029 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:28.029 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:28.046 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:28.047 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:28.062 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:28.062 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:28.063 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:28.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:28.061+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:28.064 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:28.072 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:28.080 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:28.080 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:28.097 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:28.097 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:28.113 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:28.113 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:28.166 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:28.164+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:28.177 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:28.177 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:28.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:28.177 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:28.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.177 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.177 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.775421092, 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.775374215, 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.775309475, 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:28.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.775273246, 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:28.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.193 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.775179319, 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:28.195 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:28.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.775155551, 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:28.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:28.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.77509068000001, 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.204 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:28.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:28.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:28.208 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.77505305699999, 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.775012264, 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:28.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:28.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.216 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.774936803, 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:28.221 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.77486643, 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:28.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.225 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.77483275500001, 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.226 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:28.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:28.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:28.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:28.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:28.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.774764003, 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.232 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.234 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.235 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.77471960699999, 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.236 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.238 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:28.239 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.774628659, 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:28.240 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.241 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:28.243 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.244 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.774600135, 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.245 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:28.247 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:28.248 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.77456784100001, 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.249 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:28.250 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.251 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.252 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:28.253 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 112.774529708, 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:28.254 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.255 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.256 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 32.004802607000002, 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:28.258 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.259 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.260 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:28.261 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:28.262 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.263 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 27.178822132000001, 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.264 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:28.265 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.267 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.268 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:28.269 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:28.272 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:28.272 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:28.270+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 187, 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "fsid": "aacb52bd-b292-44e0-94ba-ee8e83c0c924", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "created": "2024-09-21T22:15:07.092340+0000", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "modified": "2024-09-21T22:18:27.902574+0000", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "last_up_change": "2024-09-21T22:15:59.900683+0000", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "last_in_change": "2024-09-21T22:16:44.923178+0000", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_num": 5806080, 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_set": [ 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "nodeep-scrub", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "noscrub", 2024-09-21T22:18:28.273 INFO:teuthology.orchestra.run.smithi134.stdout: "pglog_hardlimit", 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "purged_snapdirs", 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_deletes", 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "sortbitwise" 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_version": 5, 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_snapshot": "", 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_max": 3, 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "max_osd": 8, 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:18:28.274 INFO:teuthology.orchestra.run.smithi134.stdout: "min_compat_client": "luminous", 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "require_osd_release": "squid", 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "allow_crimson": false, 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "pools": [ 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 1, 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": ".mgr", 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:21.204402+0000", 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 1, 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool", 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:18:28.275 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 1, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 1, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 1, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 1, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 1, 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:18:28.276 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "17", 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 0, 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 0, 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:18:28.277 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:18:28.278 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:18:28.279 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "options": { 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_max": 32, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_min": 1 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": {} 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 6.9000000953674316, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 6.9000000953674316, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 0.28999999165534973, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:18:28.280 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.82696914672851562, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 2, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "rbd", 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:25.020799+0000", 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:18:28.281 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 8, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 8, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 8, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 8, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 8, 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:18:28.282 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "21", 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 2, 2024-09-21T22:18:28.283 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 21, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:18:28.284 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:18:28.285 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 2.630000114440918, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 2.630000114440918, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.82696914672851562, 2024-09-21T22:18:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_name": "pool_client.0", 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "create_time": "2024-09-21T22:15:34.502611+0000", 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flags": 8193, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type": 1, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 2, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "min_size": 1, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_rule": 0, 2024-09-21T22:18:28.287 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "is_stretch_pool": false, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "object_hash": 2, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num": 32, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num": 32, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_placement_num_target": 32, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_target": 32, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_num_pending": 32, 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "last_pg_merge_meta": { 2024-09-21T22:18:28.288 INFO:teuthology.orchestra.run.smithi134.stdout: "source_pgid": "0.0", 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "ready_epoch": 0, 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_started": 0, 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "last_epoch_clean": 0, 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "source_version": "0'0", 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "target_version": "0'0" 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "last_change": "187", 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend": "0", 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "auid": 0, 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_seq": 72, 2024-09-21T22:18:28.289 INFO:teuthology.orchestra.run.smithi134.stdout: "snap_epoch": 187, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "pool_snaps": [], 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps": "[]", 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_bytes": 0, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "quota_max_objects": 0, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tiers": [], 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tier_of": -1, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "read_tier": -1, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "write_tier": -1, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_mode": "none", 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_bytes": 0, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "target_max_objects": 0, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:18:28.290 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_flush_age": 0, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "cache_min_evict_age": 0, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profile": "", 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_params": { 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "none" 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_period": 0, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_count": 0, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "use_gmt_hitset": true, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:18:28.291 INFO:teuthology.orchestra.run.smithi134.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "grade_table": [], 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "stripe_width": 0, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "expected_num_objects": 0, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "fast_read": false, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "options": {}, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "application_metadata": { 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "rbd": {} 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "read_balance": { 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "score_type": "Fair distribution", 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "score_acting": 1.75, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "score_stable": 1.75, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "optimal_score": 1.1399999856948853, 2024-09-21T22:18:28.292 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_acting": 2, 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "raw_score_stable": 2, 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity_weighted": 0.82696914672851562, 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "96ad0a5a-c464-448c-b390-6e73c8fb449e", 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 0.615753173828125, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 129, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6816", 2024-09-21T22:18:28.294 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6817", 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.295 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6818", 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6819", 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6822", 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6823", 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6820", 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6821", 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1738784974 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6817/1738784974", 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6819/1738784974", 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6823/1738784974", 2024-09-21T22:18:28.298 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6821/1738784974", 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "f2c75579-e93c-44e8-85ed-144ec4ba096d", 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:28.299 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 116, 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6824", 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.300 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6825", 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6826", 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6827", 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6830", 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6831", 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6828", 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6829", 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3328015815 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6825/3328015815", 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6827/3328015815", 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3328015815", 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3328015815", 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.304 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a2ae2709-79f1-4a99-b854-d72cfe661be9", 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:18:28.305 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6800", 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6801", 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6802", 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6803", 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6806", 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6807", 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6804", 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6805", 2024-09-21T22:18:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1987494452 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6801/1987494452", 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6803/1987494452", 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1987494452", 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1987494452", 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "94ed467c-6601-41ec-8bdb-9d1f0d4c078b", 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 13, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 26, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 45, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 101, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 27, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6808", 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6809", 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6810", 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6811", 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6814", 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6815", 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6812", 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.134:6813", 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 704257458 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.134:6809/704257458", 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.134:6811/704257458", 2024-09-21T22:18:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.134:6815/704257458", 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.134:6813/704257458", 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "74e011e7-766b-437a-b71b-09fc990e210d", 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 115, 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6800", 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6801", 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6802", 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6803", 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6806", 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6807", 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6804", 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6805", 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1724687038 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6801/1724687038", 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6803/1724687038", 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6807/1724687038", 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6805/1724687038", 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "e7650da2-cbad-4915-bc9c-d5154151bcc0", 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 0, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.322 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6808", 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6809", 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6810", 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6811", 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6814", 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6815", 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6812", 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6813", 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 497583447 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6809/497583447", 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6811/497583447", 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6815/497583447", 2024-09-21T22:18:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6813/497583447", 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "aec4bd84-857e-4cc9-898c-93440ba485c8", 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 90, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6824", 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6825", 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6826", 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6827", 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6830", 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6831", 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6828", 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6829", 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1853322645 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6825/1853322645", 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6827/1853322645", 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6831/1853322645", 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6829/1853322645", 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.332 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "uuid": "a244e703-8ec9-4edc-b0ca-e33b38bbd99c", 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "up": 1, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "in": 1, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "weight": 1, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_affinity": 1, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_begin": 0, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "last_clean_end": 0, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "up_from": 13, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "up_thru": 170, 2024-09-21T22:18:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "down_at": 0, 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "lost_at": 0, 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addrs": { 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6816", 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6817", 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addrs": { 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6818", 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6819", 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addrs": { 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6822", 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6823", 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addrs": { 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "addrvec": [ 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v2", 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6820", 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "172.21.15.149:6821", 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1872776196 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "public_addr": "172.21.15.149:6817/1872776196", 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_addr": "172.21.15.149:6819/1872776196", 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_back_addr": "172.21.15.149:6823/1872776196", 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "heartbeat_front_addr": "172.21.15.149:6821/1872776196", 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "state": [ 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "exists", 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "up" 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_xinfo": [ 2024-09-21T22:18:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 0, 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.845585+0000", 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 1, 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.467598+0000", 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 2, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.110690+0000", 2024-09-21T22:18:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 3, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.614040+0000", 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 27 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 4, 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.594902+0000", 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 5, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.591315+0000", 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 6, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:16.191972+0000", 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": 7, 2024-09-21T22:18:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "down_stamp": "0.000000", 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_probability": 0, 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "laggy_interval": 0, 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "features": 4540701547738038271, 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "old_weight": 0, 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "last_purged_snaps_scrub": "2024-09-21T22:15:15.510686+0000", 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "dead_epoch": 0 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap": [ 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.1", 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: 0, 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: 1 2024-09-21T22:18:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.d", 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: 6, 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: 0 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "3.16", 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "osds": [ 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: 1, 2024-09-21T22:18:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: 2 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_items": [], 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_upmap_primaries": [], 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "pg_temp": [], 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "primary_temp": [], 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklist": {}, 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "range_blocklist": {}, 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "erasure_code_profiles": { 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "default": { 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "crush-failure-domain": "osd", 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "k": "2", 2024-09-21T22:18:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "m": "1", 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "plugin": "jerasure", 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "technique": "reed_sol_van" 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "removed_snaps_queue": [ 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 31, 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 33, 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 35, 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 37, 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 39, 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 41, 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 43, 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 45, 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "new_removed_snaps": [ 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "pool": 3, 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "snaps": [ 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "begin": 31, 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "length": 1 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "new_purged_snaps": [], 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "crush_node_flags": {}, 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "device_class_flags": {}, 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode": { 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_enabled": false, 2024-09-21T22:18:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_bucket_count": 0, 2024-09-21T22:18:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:18:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:18:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "stretch_mode_bucket": 0 2024-09-21T22:18:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.351 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:28.352 INFO:tasks.thrashosds.thrasher:j is {'epoch': 187, 'fsid': 'aacb52bd-b292-44e0-94ba-ee8e83c0c924', 'created': '2024-09-21T22:15:07.092340+0000', 'modified': '2024-09-21T22:18:27.902574+0000', 'last_up_change': '2024-09-21T22:15:59.900683+0000', 'last_in_change': '2024-09-21T22:16:44.923178+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:15:21.204402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8269691467285156, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:15:25.020799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.8269691467285156, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:15:34.502611+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 72, 'snap_epoch': 187, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8269691467285156, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.8299999833106995}}], 'osds': [{'osd': 0, 'uuid': '96ad0a5a-c464-448c-b390-6e73c8fb449e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.615753173828125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 1738784974}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 1738784974}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 1738784974}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 1738784974}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 1738784974}]}, 'public_addr': '172.21.15.134:6817/1738784974', 'cluster_addr': '172.21.15.134:6819/1738784974', 'heartbeat_back_addr': '172.21.15.134:6823/1738784974', 'heartbeat_front_addr': '172.21.15.134:6821/1738784974', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f2c75579-e93c-44e8-85ed-144ec4ba096d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3328015815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3328015815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3328015815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3328015815}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3328015815}]}, 'public_addr': '172.21.15.134:6825/3328015815', 'cluster_addr': '172.21.15.134:6827/3328015815', 'heartbeat_back_addr': '172.21.15.134:6831/3328015815', 'heartbeat_front_addr': '172.21.15.134:6829/3328015815', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a2ae2709-79f1-4a99-b854-d72cfe661be9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1987494452}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1987494452}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1987494452}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1987494452}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1987494452}]}, 'public_addr': '172.21.15.134:6801/1987494452', 'cluster_addr': '172.21.15.134:6803/1987494452', 'heartbeat_back_addr': '172.21.15.134:6807/1987494452', 'heartbeat_front_addr': '172.21.15.134:6805/1987494452', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '94ed467c-6601-41ec-8bdb-9d1f0d4c078b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 26, 'up_from': 45, 'up_thru': 101, 'down_at': 27, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 704257458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 704257458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 704257458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 704257458}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 704257458}]}, 'public_addr': '172.21.15.134:6809/704257458', 'cluster_addr': '172.21.15.134:6811/704257458', 'heartbeat_back_addr': '172.21.15.134:6815/704257458', 'heartbeat_front_addr': '172.21.15.134:6813/704257458', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '74e011e7-766b-437a-b71b-09fc990e210d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6801', 'nonce': 1724687038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6802', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6803', 'nonce': 1724687038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6806', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6807', 'nonce': 1724687038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6804', 'nonce': 1724687038}, {'type': 'v1', 'addr': '172.21.15.149:6805', 'nonce': 1724687038}]}, 'public_addr': '172.21.15.149:6801/1724687038', 'cluster_addr': '172.21.15.149:6803/1724687038', 'heartbeat_back_addr': '172.21.15.149:6807/1724687038', 'heartbeat_front_addr': '172.21.15.149:6805/1724687038', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e7650da2-cbad-4915-bc9c-d5154151bcc0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6808', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6809', 'nonce': 497583447}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6810', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6811', 'nonce': 497583447}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6814', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6815', 'nonce': 497583447}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6812', 'nonce': 497583447}, {'type': 'v1', 'addr': '172.21.15.149:6813', 'nonce': 497583447}]}, 'public_addr': '172.21.15.149:6809/497583447', 'cluster_addr': '172.21.15.149:6811/497583447', 'heartbeat_back_addr': '172.21.15.149:6815/497583447', 'heartbeat_front_addr': '172.21.15.149:6813/497583447', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'aec4bd84-857e-4cc9-898c-93440ba485c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6824', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6825', 'nonce': 1853322645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6826', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6827', 'nonce': 1853322645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6830', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6831', 'nonce': 1853322645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6828', 'nonce': 1853322645}, {'type': 'v1', 'addr': '172.21.15.149:6829', 'nonce': 1853322645}]}, 'public_addr': '172.21.15.149:6825/1853322645', 'cluster_addr': '172.21.15.149:6827/1853322645', 'heartbeat_back_addr': '172.21.15.149:6831/1853322645', 'heartbeat_front_addr': '172.21.15.149:6829/1853322645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a244e703-8ec9-4edc-b0ca-e33b38bbd99c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 170, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6816', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6817', 'nonce': 1872776196}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6818', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6819', 'nonce': 1872776196}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6822', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6823', 'nonce': 1872776196}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6820', 'nonce': 1872776196}, {'type': 'v1', 'addr': '172.21.15.149:6821', 'nonce': 1872776196}]}, 'public_addr': '172.21.15.149:6817/1872776196', 'cluster_addr': '172.21.15.149:6819/1872776196', 'heartbeat_back_addr': '172.21.15.149:6823/1872776196', 'heartbeat_front_addr': '172.21.15.149:6821/1872776196', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.845585+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.467598+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.110690+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.614040+0000', 'dead_epoch': 27}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.594902+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.591315+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:16.191972+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:15:15.510686+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.1', 'osds': [0, 1]}, {'pgid': '3.d', 'osds': [6, 0]}, {'pgid': '3.16', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 1}, {'begin': 33, 'length': 1}, {'begin': 35, 'length': 1}, {'begin': 37, 'length': 1}, {'begin': 39, 'length': 1}, {'begin': 41, 'length': 1}, {'begin': 43, 'length': 1}, {'begin': 45, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:18:28.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:18:28.371 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:28.371+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:28.458 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:28.458 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:28.458 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:28.459 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:28.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:28.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:28.511+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:28.573 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:28.573 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:28.573 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:28.573 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:28.573 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:28.574 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:28.571+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:28.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:18:28.642 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:18:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-09-21T22:18:27.909597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658562760,"num_objects":503,"num_object_clones":0,"num_object_copies":1006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":503,"num_whiteouts":0,"num_read":212270,"num_read_kb":1297831,"num_write":26846,"num_write_kb":884300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1390,"num_bytes_recovered":159942324,"num_keys_recovered":223,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20344,"ondisk_log_size":20344,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":811136,"kb_used_data":360640,"kb_used_omap":15,"kb_used_meta":450288,"kb_avail":754163584,"statfs":{"total":773094113280,"available":772263510016,"internally_reserved":0,"allocated":369295360,"data_stored":358537527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":461095708},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-161848625,"num_objects":-142,"num_object_clones":0,"num_object_copies":-284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-142,"num_whiteouts":0,"num_read":1049,"num_read_kb":905,"num_write":309,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.895823"},"pg_stats":[{"pgid":"3.1f","version":"183'1232","reported_seq":27604,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.092686+0000","last_change":"2024-09-21T22:18:24.020287+0000","last_active":"2024-09-21T22:18:24.092686+0000","last_peered":"2024-09-21T22:18:24.092686+0000","last_clean":"2024-09-21T22:18:24.092686+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:18:24.092686+0000","last_undegraded":"2024-09-21T22:18:24.092686+0000","last_fullsized":"2024-09-21T22:18:24.092686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1232,"log_dups_size":0,"ondisk_log_size":1232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:13:38.240177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041198199999999997,"stat_sum":{"num_bytes":39948669,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":29863,"num_read_kb":75399,"num_write":2068,"num_write_kb":47569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.1e","version":"182'705","reported_seq":4175,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.004786+0000","last_change":"2024-09-21T22:18:23.004786+0000","last_active":"2024-09-21T22:18:23.004786+0000","last_peered":"2024-09-21T22:18:23.004786+0000","last_clean":"2024-09-21T22:18:23.004786+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:18:23.004786+0000","last_undegraded":"2024-09-21T22:18:23.004786+0000","last_fullsized":"2024-09-21T22:18:23.004786+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:10:51.518266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069929300000000003,"stat_sum":{"num_bytes":18508878,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":5048,"num_read_kb":36169,"num_write":879,"num_write_kb":21910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.1d","version":"181'414","reported_seq":8356,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.016587+0000","last_change":"2024-09-21T22:18:24.016821+0000","last_active":"2024-09-21T22:18:24.016587+0000","last_peered":"2024-09-21T22:18:24.016587+0000","last_clean":"2024-09-21T22:18:24.016587+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:18:24.016587+0000","last_undegraded":"2024-09-21T22:18:24.016587+0000","last_fullsized":"2024-09-21T22:18:24.016587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:23:46.583364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079246199999999996,"stat_sum":{"num_bytes":50943552,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":7443,"num_read_kb":59847,"num_write":494,"num_write_kb":33904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.1c","version":"183'876","reported_seq":3622,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.114273+0000","last_change":"2024-09-21T22:18:24.016710+0000","last_active":"2024-09-21T22:18:24.114273+0000","last_peered":"2024-09-21T22:18:24.114273+0000","last_clean":"2024-09-21T22:18:24.114273+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:18:24.114273+0000","last_undegraded":"2024-09-21T22:18:24.114273+0000","last_fullsized":"2024-09-21T22:18:24.114273+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:39.130931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072796600000000003,"stat_sum":{"num_bytes":18989036,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4605,"num_read_kb":35406,"num_write":1308,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.1b","version":"183'488","reported_seq":10971,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.105820+0000","last_change":"2024-09-21T22:18:24.021670+0000","last_active":"2024-09-21T22:18:24.105820+0000","last_peered":"2024-09-21T22:18:24.105820+0000","last_clean":"2024-09-21T22:18:24.105820+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:18:24.105820+0000","last_undegraded":"2024-09-21T22:18:24.105820+0000","last_fullsized":"2024-09-21T22:18:24.105820+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:35:53.819568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00175176,"stat_sum":{"num_bytes":17869949,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":10916,"num_read_kb":37468,"num_write":511,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.1a","version":"183'318","reported_seq":2926,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.117833+0000","last_change":"2024-09-21T22:18:24.016492+0000","last_active":"2024-09-21T22:18:24.117833+0000","last_peered":"2024-09-21T22:18:24.117833+0000","last_clean":"2024-09-21T22:18:24.117833+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:18:24.117833+0000","last_undegraded":"2024-09-21T22:18:24.117833+0000","last_fullsized":"2024-09-21T22:18:24.117833+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:07.361984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542313,"stat_sum":{"num_bytes":5162986,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2298,"num_read_kb":17416,"num_write":394,"num_write_kb":17801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.19","version":"184'772","reported_seq":3828,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.169011+0000","last_change":"2024-09-21T22:18:25.019438+0000","last_active":"2024-09-21T22:18:25.169011+0000","last_peered":"2024-09-21T22:18:25.169011+0000","last_clean":"2024-09-21T22:18:25.169011+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:18:25.169011+0000","last_undegraded":"2024-09-21T22:18:25.169011+0000","last_fullsized":"2024-09-21T22:18:25.169011+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:26:53.200539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086213299999999995,"stat_sum":{"num_bytes":10879065,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":5414,"num_read_kb":28405,"num_write":848,"num_write_kb":24187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"1"},{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.18","version":"182'804","reported_seq":2611,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.095701+0000","last_change":"2024-09-21T22:18:23.005560+0000","last_active":"2024-09-21T22:18:23.095701+0000","last_peered":"2024-09-21T22:18:23.095701+0000","last_clean":"2024-09-21T22:18:23.095701+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:18:23.095701+0000","last_undegraded":"2024-09-21T22:18:23.095701+0000","last_fullsized":"2024-09-21T22:18:23.095701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:22.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011534760000000001,"stat_sum":{"num_bytes":21442240,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":3801,"num_read_kb":23027,"num_write":982,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.17","version":"180'1125","reported_seq":3759,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.021528+0000","last_change":"2024-09-21T22:18:24.021747+0000","last_active":"2024-09-21T22:18:24.021528+0000","last_peered":"2024-09-21T22:18:24.021528+0000","last_clean":"2024-09-21T22:18:24.021528+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:18:24.021528+0000","last_undegraded":"2024-09-21T22:18:24.021528+0000","last_fullsized":"2024-09-21T22:18:24.021528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:10.282848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107649999999999,"stat_sum":{"num_bytes":12052514,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":6151,"num_read_kb":35343,"num_write":1960,"num_write_kb":25029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.16","version":"184'300","reported_seq":14295,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.149493+0000","last_change":"2024-09-21T22:18:25.018865+0000","last_active":"2024-09-21T22:18:25.149493+0000","last_peered":"2024-09-21T22:18:25.149493+0000","last_clean":"2024-09-21T22:18:25.149493+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:18:25.149493+0000","last_undegraded":"2024-09-21T22:18:25.149493+0000","last_fullsized":"2024-09-21T22:18:25.149493+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:34:53.173938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010980530000000001,"stat_sum":{"num_bytes":40934626,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":373,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"1"},{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.15","version":"183'834","reported_seq":3590,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.130857+0000","last_change":"2024-09-21T22:18:24.030945+0000","last_active":"2024-09-21T22:18:24.130857+0000","last_peered":"2024-09-21T22:18:24.130857+0000","last_clean":"2024-09-21T22:18:24.130857+0000","last_became_active":"2024-09-21T22:16:03.923123+0000","last_became_peered":"2024-09-21T22:16:03.923123+0000","last_unstale":"2024-09-21T22:18:24.130857+0000","last_undegraded":"2024-09-21T22:18:24.130857+0000","last_fullsized":"2024-09-21T22:18:24.130857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:47.449216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083351300000000003,"stat_sum":{"num_bytes":43468110,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4380,"num_read_kb":45775,"num_write":1179,"num_write_kb":35129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":7721187,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.14","version":"183'984","reported_seq":4939,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.016966+0000","last_change":"2024-09-21T22:18:24.016966+0000","last_active":"2024-09-21T22:18:24.016966+0000","last_peered":"2024-09-21T22:18:24.016966+0000","last_clean":"2024-09-21T22:18:24.016966+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:18:24.016966+0000","last_undegraded":"2024-09-21T22:18:24.016966+0000","last_fullsized":"2024-09-21T22:18:24.016966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:16:17.667563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082017600000000004,"stat_sum":{"num_bytes":36424290,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5989,"num_read_kb":47954,"num_write":1450,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":340,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.024186+0000","last_change":"2024-09-21T22:15:29.004098+0000","last_active":"2024-09-21T22:18:24.024186+0000","last_peered":"2024-09-21T22:18:24.024186+0000","last_clean":"2024-09-21T22:18:24.024186+0000","last_became_active":"2024-09-21T22:15:26.399495+0000","last_became_peered":"2024-09-21T22:15:26.399495+0000","last_unstale":"2024-09-21T22:18:24.024186+0000","last_undegraded":"2024-09-21T22:18:24.024186+0000","last_fullsized":"2024-09-21T22:18:24.024186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:56:11.827679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"183'462","reported_seq":3905,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.097409+0000","last_change":"2024-09-21T22:18:24.020574+0000","last_active":"2024-09-21T22:18:24.097409+0000","last_peered":"2024-09-21T22:18:24.097409+0000","last_clean":"2024-09-21T22:18:24.097409+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:18:24.097409+0000","last_undegraded":"2024-09-21T22:18:24.097409+0000","last_fullsized":"2024-09-21T22:18:24.097409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:52.656208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066766099999999995,"stat_sum":{"num_bytes":29363518,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":3697,"num_read_kb":43420,"num_write":485,"num_write_kb":27040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":346,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.018064+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:18:25.018064+0000","last_peered":"2024-09-21T22:18:25.018064+0000","last_clean":"2024-09-21T22:18:25.018064+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:18:25.018064+0000","last_undegraded":"2024-09-21T22:18:25.018064+0000","last_fullsized":"2024-09-21T22:18:25.018064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"181'452","reported_seq":10944,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.005404+0000","last_change":"2024-09-21T22:18:23.005609+0000","last_active":"2024-09-21T22:18:23.005404+0000","last_peered":"2024-09-21T22:18:23.005404+0000","last_clean":"2024-09-21T22:18:23.005404+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:18:23.005404+0000","last_undegraded":"2024-09-21T22:18:23.005404+0000","last_fullsized":"2024-09-21T22:18:23.005404+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:07:38.023501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099802500000000004,"stat_sum":{"num_bytes":26301427,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":10651,"num_read_kb":38318,"num_write":579,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":342,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.030068+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:18:24.030068+0000","last_peered":"2024-09-21T22:18:24.030068+0000","last_clean":"2024-09-21T22:18:24.030068+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:18:24.030068+0000","last_undegraded":"2024-09-21T22:18:24.030068+0000","last_fullsized":"2024-09-21T22:18:24.030068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"184'534","reported_seq":10095,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.160803+0000","last_change":"2024-09-21T22:18:25.018874+0000","last_active":"2024-09-21T22:18:25.160803+0000","last_peered":"2024-09-21T22:18:25.160803+0000","last_clean":"2024-09-21T22:18:25.160803+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:18:25.160803+0000","last_undegraded":"2024-09-21T22:18:25.160803+0000","last_fullsized":"2024-09-21T22:18:25.160803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:17:24.347118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099214700000000008,"stat_sum":{"num_bytes":33269593,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":9638,"num_read_kb":64453,"num_write":582,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"1"},{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":346,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.018052+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:18:25.018052+0000","last_peered":"2024-09-21T22:18:25.018052+0000","last_clean":"2024-09-21T22:18:25.018052+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:18:25.018052+0000","last_undegraded":"2024-09-21T22:18:25.018052+0000","last_fullsized":"2024-09-21T22:18:25.018052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"181'478","reported_seq":14281,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.005710+0000","last_change":"2024-09-21T22:18:23.005892+0000","last_active":"2024-09-21T22:18:23.005710+0000","last_peered":"2024-09-21T22:18:23.005710+0000","last_clean":"2024-09-21T22:18:23.005710+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:18:23.005710+0000","last_undegraded":"2024-09-21T22:18:23.005710+0000","last_fullsized":"2024-09-21T22:18:23.005710+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:17:24.699061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044174999999999998,"stat_sum":{"num_bytes":18085375,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13996,"num_read_kb":60966,"num_write":538,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.3","version":"183'670","reported_seq":4010,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.111272+0000","last_change":"2024-09-21T22:18:24.017095+0000","last_active":"2024-09-21T22:18:24.111272+0000","last_peered":"2024-09-21T22:18:24.111272+0000","last_clean":"2024-09-21T22:18:24.111272+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:18:24.111272+0000","last_undegraded":"2024-09-21T22:18:24.111272+0000","last_fullsized":"2024-09-21T22:18:24.111272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:06.941741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084526100000000004,"stat_sum":{"num_bytes":9100862,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4344,"num_read_kb":41078,"num_write":712,"num_write_kb":35667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":192,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.018366+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:18:25.018366+0000","last_peered":"2024-09-21T22:18:25.018366+0000","last_clean":"2024-09-21T22:18:25.018366+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:18:25.018366+0000","last_undegraded":"2024-09-21T22:18:25.018366+0000","last_fullsized":"2024-09-21T22:18:25.018366+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"184'665","reported_seq":18260,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.146759+0000","last_change":"2024-09-21T22:18:25.019198+0000","last_active":"2024-09-21T22:18:25.146759+0000","last_peered":"2024-09-21T22:18:25.146759+0000","last_clean":"2024-09-21T22:18:25.146759+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:18:25.146759+0000","last_undegraded":"2024-09-21T22:18:25.146759+0000","last_fullsized":"2024-09-21T22:18:25.146759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:09.034381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083361600000000002,"stat_sum":{"num_bytes":28409453,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":17989,"num_read_kb":72552,"num_write":800,"num_write_kb":33444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"1"},{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":349,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.021651+0000","last_change":"2024-09-21T22:16:00.914992+0000","last_active":"2024-09-21T22:18:25.021651+0000","last_peered":"2024-09-21T22:18:25.021651+0000","last_clean":"2024-09-21T22:18:25.021651+0000","last_became_active":"2024-09-21T22:16:00.914709+0000","last_became_peered":"2024-09-21T22:16:00.914709+0000","last_unstale":"2024-09-21T22:18:25.021651+0000","last_undegraded":"2024-09-21T22:18:25.021651+0000","last_fullsized":"2024-09-21T22:18:25.021651+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:04:21.724360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"181'418","reported_seq":2401,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.019975+0000","last_change":"2024-09-21T22:18:24.020250+0000","last_active":"2024-09-21T22:18:24.019975+0000","last_peered":"2024-09-21T22:18:24.019975+0000","last_clean":"2024-09-21T22:18:24.019975+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:18:24.019975+0000","last_undegraded":"2024-09-21T22:18:24.019975+0000","last_fullsized":"2024-09-21T22:18:24.019975+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:17:36.716910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053136600000000002,"stat_sum":{"num_bytes":9370304,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1434,"num_read_kb":29449,"num_write":565,"num_write_kb":25523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":342,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.029443+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:18:24.029443+0000","last_peered":"2024-09-21T22:18:24.029443+0000","last_clean":"2024-09-21T22:18:24.029443+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:18:24.029443+0000","last_undegraded":"2024-09-21T22:18:24.029443+0000","last_fullsized":"2024-09-21T22:18:24.029443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"181'398","reported_seq":1612,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.005644+0000","last_change":"2024-09-21T22:18:23.005853+0000","last_active":"2024-09-21T22:18:23.005644+0000","last_peered":"2024-09-21T22:18:23.005644+0000","last_clean":"2024-09-21T22:18:23.005644+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:18:23.005644+0000","last_undegraded":"2024-09-21T22:18:23.005644+0000","last_fullsized":"2024-09-21T22:18:23.005644+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:23:06.447942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098126099999999998,"stat_sum":{"num_bytes":17999191,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1198,"num_read_kb":37422,"num_write":495,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":181,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T22:18:25.021456+0000","last_change":"2024-09-21T22:17:00.003407+0000","last_active":"2024-09-21T22:18:25.021456+0000","last_peered":"2024-09-21T22:18:25.021456+0000","last_clean":"2024-09-21T22:18:25.021456+0000","last_became_active":"2024-09-21T22:17:00.003044+0000","last_became_peered":"2024-09-21T22:17:00.003044+0000","last_unstale":"2024-09-21T22:18:25.021456+0000","last_undegraded":"2024-09-21T22:18:25.021456+0000","last_fullsized":"2024-09-21T22:18:25.021456+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:06.358350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":494,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.029495+0000","last_change":"2024-09-21T22:15:22.364603+0000","last_active":"2024-09-21T22:18:24.029495+0000","last_peered":"2024-09-21T22:18:24.029495+0000","last_clean":"2024-09-21T22:18:24.029495+0000","last_became_active":"2024-09-21T22:15:22.364322+0000","last_became_peered":"2024-09-21T22:15:22.364322+0000","last_unstale":"2024-09-21T22:18:24.029495+0000","last_undegraded":"2024-09-21T22:18:24.029495+0000","last_fullsized":"2024-09-21T22:18:24.029495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:20:40.777587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"181'647","reported_seq":2034,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.103530+0000","last_change":"2024-09-21T22:18:23.005339+0000","last_active":"2024-09-21T22:18:23.103530+0000","last_peered":"2024-09-21T22:18:23.103530+0000","last_clean":"2024-09-21T22:18:23.103530+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:18:23.103530+0000","last_undegraded":"2024-09-21T22:18:23.103530+0000","last_fullsized":"2024-09-21T22:18:23.103530+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:10:13.881695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093165800000000003,"stat_sum":{"num_bytes":19459906,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2356,"num_read_kb":21575,"num_write":951,"num_write_kb":21286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.9","version":"183'519","reported_seq":4276,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.016503+0000","last_change":"2024-09-21T22:18:24.016503+0000","last_active":"2024-09-21T22:18:24.016503+0000","last_peered":"2024-09-21T22:18:24.016503+0000","last_clean":"2024-09-21T22:18:24.016503+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:18:24.016503+0000","last_undegraded":"2024-09-21T22:18:24.016503+0000","last_fullsized":"2024-09-21T22:18:24.016503+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:32:26.091329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056583899999999995,"stat_sum":{"num_bytes":11929723,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4344,"num_read_kb":58548,"num_write":640,"num_write_kb":34437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.a","version":"183'765","reported_seq":3093,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.094072+0000","last_change":"2024-09-21T22:18:24.024667+0000","last_active":"2024-09-21T22:18:24.094072+0000","last_peered":"2024-09-21T22:18:24.094072+0000","last_clean":"2024-09-21T22:18:24.094072+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:18:24.094072+0000","last_undegraded":"2024-09-21T22:18:24.094072+0000","last_fullsized":"2024-09-21T22:18:24.094072+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:19:38.249198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000380873,"stat_sum":{"num_bytes":4161521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3971,"num_read_kb":33070,"num_write":949,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.b","version":"180'801","reported_seq":2775,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.004574+0000","last_change":"2024-09-21T22:18:23.004805+0000","last_active":"2024-09-21T22:18:23.004574+0000","last_peered":"2024-09-21T22:18:23.004574+0000","last_clean":"2024-09-21T22:18:23.004574+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:18:23.004574+0000","last_undegraded":"2024-09-21T22:18:23.004574+0000","last_fullsized":"2024-09-21T22:18:23.004574+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:00.858062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067826900000000001,"stat_sum":{"num_bytes":12654871,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4565,"num_read_kb":31375,"num_write":1047,"num_write_kb":31256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.c","version":"181'472","reported_seq":1784,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-21T22:18:23.005030+0000","last_change":"2024-09-21T22:18:23.005268+0000","last_active":"2024-09-21T22:18:23.005030+0000","last_peered":"2024-09-21T22:18:23.005030+0000","last_clean":"2024-09-21T22:18:23.005030+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:18:23.005030+0000","last_undegraded":"2024-09-21T22:18:23.005030+0000","last_fullsized":"2024-09-21T22:18:23.005030+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:37:57.162988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090362600000000004,"stat_sum":{"num_bytes":11032925,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1701,"num_read_kb":37972,"num_write":644,"num_write_kb":23541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.d","version":"183'628","reported_seq":2618,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.024720+0000","last_change":"2024-09-21T22:18:24.024720+0000","last_active":"2024-09-21T22:18:24.024720+0000","last_peered":"2024-09-21T22:18:24.024720+0000","last_clean":"2024-09-21T22:18:24.024720+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:18:24.024720+0000","last_undegraded":"2024-09-21T22:18:24.024720+0000","last_fullsized":"2024-09-21T22:18:24.024720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:32.864447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041455799999999998,"stat_sum":{"num_bytes":10321996,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3590,"num_read_kb":26521,"num_write":796,"num_write_kb":20238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.e","version":"183'653","reported_seq":2089,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.031300+0000","last_change":"2024-09-21T22:18:24.031300+0000","last_active":"2024-09-21T22:18:24.031300+0000","last_peered":"2024-09-21T22:18:24.031300+0000","last_clean":"2024-09-21T22:18:24.031300+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:18:24.031300+0000","last_undegraded":"2024-09-21T22:18:24.031300+0000","last_fullsized":"2024-09-21T22:18:24.031300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:56.788938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092281700000000004,"stat_sum":{"num_bytes":4459101,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":940,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.f","version":"181'576","reported_seq":2529,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.031110+0000","last_change":"2024-09-21T22:18:24.031374+0000","last_active":"2024-09-21T22:18:24.031110+0000","last_peered":"2024-09-21T22:18:24.031110+0000","last_clean":"2024-09-21T22:18:24.031110+0000","last_became_active":"2024-09-21T22:16:48.959123+0000","last_became_peered":"2024-09-21T22:16:48.959123+0000","last_unstale":"2024-09-21T22:18:24.031110+0000","last_undegraded":"2024-09-21T22:18:24.031110+0000","last_fullsized":"2024-09-21T22:18:24.031110+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:40:07.691040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095197299999999995,"stat_sum":{"num_bytes":11731551,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2543,"num_read_kb":24893,"num_write":685,"num_write_kb":20802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":6771508,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.10","version":"183'367","reported_seq":2393,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.101454+0000","last_change":"2024-09-21T22:18:24.025469+0000","last_active":"2024-09-21T22:18:24.101454+0000","last_peered":"2024-09-21T22:18:24.101454+0000","last_clean":"2024-09-21T22:18:24.101454+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:18:24.101454+0000","last_undegraded":"2024-09-21T22:18:24.101454+0000","last_fullsized":"2024-09-21T22:18:24.101454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:43:42.183550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011356490000000001,"stat_sum":{"num_bytes":20907480,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":1510,"num_read_kb":33999,"num_write":389,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.11","version":"181'684","reported_seq":2292,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.030075+0000","last_change":"2024-09-21T22:18:24.030360+0000","last_active":"2024-09-21T22:18:24.030075+0000","last_peered":"2024-09-21T22:18:24.030075+0000","last_clean":"2024-09-21T22:18:24.030075+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:18:24.030075+0000","last_undegraded":"2024-09-21T22:18:24.030075+0000","last_fullsized":"2024-09-21T22:18:24.030075+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:00.937624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066639399999999995,"stat_sum":{"num_bytes":10759225,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":988,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.12","version":"183'517","reported_seq":6878,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.128549+0000","last_change":"2024-09-21T22:18:24.030871+0000","last_active":"2024-09-21T22:18:24.128549+0000","last_peered":"2024-09-21T22:18:24.128549+0000","last_clean":"2024-09-21T22:18:24.128549+0000","last_became_active":"2024-09-21T22:17:37.898981+0000","last_became_peered":"2024-09-21T22:17:37.898981+0000","last_unstale":"2024-09-21T22:18:24.128549+0000","last_undegraded":"2024-09-21T22:18:24.128549+0000","last_fullsized":"2024-09-21T22:18:24.128549+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:04.948577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079740300000000002,"stat_sum":{"num_bytes":15587996,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":6945,"num_read_kb":25336,"num_write":619,"num_write_kb":19628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]},{"pgid":"3.13","version":"183'666","reported_seq":12363,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-21T22:18:24.030415+0000","last_change":"2024-09-21T22:18:24.030415+0000","last_active":"2024-09-21T22:18:24.030415+0000","last_peered":"2024-09-21T22:18:24.030415+0000","last_clean":"2024-09-21T22:18:24.030415+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:18:24.030415+0000","last_undegraded":"2024-09-21T22:18:24.030415+0000","last_fullsized":"2024-09-21T22:18:24.030415+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:41.695909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062142899999999995,"stat_sum":{"num_bytes":36442440,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":12406,"num_read_kb":63730,"num_write":835,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"1"},{"start":"29","length":"1"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"2f","length":"1"},{"start":"31","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"},{"start":"37","length":"1"},{"start":"39","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":657972373,"num_objects":499,"num_object_clones":0,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":0,"num_read":212154,"num_read_kb":1297731,"num_write":26685,"num_write_kb":881882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1390,"num_bytes_recovered":159942324,"num_keys_recovered":223,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":328531968,"data_stored":326769777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20224,"ondisk_log_size":20224,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111384,"kb_used_data":39936,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94260456,"statfs":{"total":96636764160,"available":96522706944,"internally_reserved":0,"allocated":40894464,"data_stored":39554984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57264,"kb_used_data":17748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94314576,"statfs":{"total":96636764160,"available":96578125824,"internally_reserved":0,"allocated":18173952,"data_stored":16964695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119268,"kb_used_data":51980,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94252572,"statfs":{"total":96636764160,"available":96514633728,"internally_reserved":0,"allocated":53227520,"data_stored":51861271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122524,"kb_used_data":55244,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94249316,"statfs":{"total":96636764160,"available":96511299584,"internally_reserved":0,"allocated":56569856,"data_stored":55150364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528350,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110580,"kb_used_data":56096,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94261260,"statfs":{"total":96636764160,"available":96523530240,"internally_reserved":0,"allocated":57442304,"data_stored":55988749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64576,"kb_used_data":25056,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307264,"statfs":{"total":96636764160,"available":96570638336,"internally_reserved":0,"allocated":25657344,"data_stored":24407939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78484,"kb_used_data":47288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94293356,"statfs":{"total":96636764160,"available":96556396544,"internally_reserved":0,"allocated":48422912,"data_stored":47075875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147056,"kb_used_data":67292,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94224784,"statfs":{"total":96636764160,"available":96486178816,"internally_reserved":0,"allocated":68907008,"data_stored":67533650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61693952,"data_stored":61450261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42504192,"data_stored":42289164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21716992,"data_stored":21590828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":55246848,"data_stored":54910013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54362112,"data_stored":54065170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":46796800,"data_stored":46554951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13660160,"data_stored":13572352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32550912,"data_stored":32337038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:18:28.658 INFO:tasks.thrashosds.thrasher:Setting 3.15 to [6, 5] 2024-09-21T22:18:28.658 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.15', '6', '5'] 2024-09-21T22:18:28.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.15 6 5 2024-09-21T22:18:28.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:28.695+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 148.81683066100001, 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:18:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:18:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 148.81420858800001, 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:18:28.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.831503390000002, 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:18:28.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:18:28.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.782217539000001, 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:18:28.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.779966848999997, 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.779864697999997, 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.776044421999998, 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.776024284000002, 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:18:28.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:18:28.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.776003766000002, 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:18:28.766 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.770 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.748077221999999, 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:28.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:18:28.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:18:28.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.748057652, 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:18:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.748039061, 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:18:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.748019380999999, 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:18:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.747991020999997, 2024-09-21T22:18:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:18:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:18:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.747969478999998, 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190908 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 303104~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.798073559999999, 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057426265999999997, 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190908 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928944+0000", 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2010000000000002e-06 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928951+0000", 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928956+0000", 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1030000000000001e-06 2024-09-21T22:18:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986168+0000", 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212363000000002 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986213+0000", 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5142999999999998e-05 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986367+0000", 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-21T22:18:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190909 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 385024~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.798052452, 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057618427999999999, 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190909 2024-09-21T22:18:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928963+0000", 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:18:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928965+0000", 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928972+0000", 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5610000000000001e-06 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928977+0000", 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:18:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986391+0000", 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057413929000000002 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986434+0000", 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2582e-05 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986581+0000", 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014685300000000001 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190910 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 450560~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.798030625999999, 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057841218, 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190910 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928987+0000", 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6740000000000001e-06 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928993+0000", 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929000+0000", 2024-09-21T22:18:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6159999999999998e-06 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986611+0000", 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057611258999999998 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986651+0000", 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0303999999999999e-05 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986825+0000", 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173847 2024-09-21T22:18:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190911 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 598016~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.798009372000003, 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058186806000000001, 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190911 2024-09-21T22:18:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929007+0000", 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929012+0000", 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929015+0000", 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986859+0000", 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057844049000000002 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986940+0000", 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1265000000000002e-05 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.987192+0000", 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175700000000002 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200490 3.b 3:d36e58d9:::rbd_data.1185b457050c.0000000000000005:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.552592044000001, 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067382992000000003, 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200490 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174426+0000", 2024-09-21T22:18:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3400000000000002e-06 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183430+0000", 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090044610000000001 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183473+0000", 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2531000000000003e-05 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183494+0000", 2024-09-21T22:18:28.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0939999999999999e-05 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183619+0000", 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125334 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183864+0000", 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000244536 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.184078+0000", 2024-09-21T22:18:28.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021405400000000001 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237365+0000", 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053287147999999999 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241686+0000", 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043208910000000003 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241753+0000", 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7396000000000003e-05 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:28.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241806+0000", 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2361000000000002e-05 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:28.817 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:28.818 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:28.816+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:28.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:28.919 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:28.919+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:28.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:18:28.967 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:28.967 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:28.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:set 3.15 pg_upmap mapping to [6,5] 2024-09-21T22:18:29.036 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:29.034+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:29.121 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:29.120+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:29.133 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:29.133 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:29.133 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:29.133 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:29.133 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:29.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:29.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:29.220+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:29.248 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.320021758000003, 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.320003241000002, 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:18:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.319830654999997, 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:18:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:18:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.319808813000002, 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.319788275999997, 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:18:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.319763747000003, 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:18:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:18:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.318913889000001, 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:18:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:18:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.318887502000003, 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:18:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.318864935999997, 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:18:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:18:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.318843225999998, 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:18:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.318822085999997, 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:18:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:18:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.318800211000003, 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.317184922999999, 2024-09-21T22:18:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:18:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:18:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.317165144999997, 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.317145666000002, 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:18:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.317127265000003, 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:18:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:18:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:18:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.317094865999998, 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:18:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.317074726999998, 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160176 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.313008961999998, 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074083248000000004, 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160176 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933867+0000", 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933869+0000", 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1210000000000001e-06 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933874+0000", 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933879+0000", 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4830000000000001e-06 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007941+0000", 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074061907999999996 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007950+0000", 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7329999999999992e-06 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160177 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.312990945999999, 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074112131999999997, 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160177 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933885+0000", 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933887+0000", 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933892+0000", 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2024-09-21T22:18:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933896+0000", 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4209999999999997e-06 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007986+0000", 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074089981999999999 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007996+0000", 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.333 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:29.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:29.335 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:29.333+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:29.435 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:29.434+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:29.477 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:29.477 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:29.478 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:29.478 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:29.486 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:29.535 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:29.533+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:29.589 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:29.589 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:29.589 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:29.589 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:29.589 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:29.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:29.636 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:29.635+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:29.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:29.734+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:29.742 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 148.82584624, 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:18:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.703104623, 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:18:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.703095084, 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.703086244, 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:18:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.703077038, 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.70306806400001, 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.70305915900001, 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.703037419, 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:18:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.703027995, 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.70301909600001, 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:18:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.703010143, 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:18:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.701505283, 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:18:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:18:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:18:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.70149577799999, 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.701482039, 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 116.701472729, 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:18:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 110.84146173000001, 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:18:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:18:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 110.837840309, 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:18:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:18:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:18:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 110.25536977500001, 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:18:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:18:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.536706835000004, 2024-09-21T22:18:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:18:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200487 3.4 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.569391066999998, 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070564014999999994, 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200487 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170963+0000", 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5590000000000001e-06 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178398+0000", 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074350709999999997 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178437+0000", 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026000000000002e-05 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178452+0000", 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5128e-05 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178600+0000", 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014802700000000001 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178942+0000", 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034162 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179139+0000", 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196672 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237616+0000", 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058477256999999998 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241380+0000", 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003763654 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241460+0000", 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0438999999999993e-05 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241524+0000", 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3561999999999999e-05 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:29.841 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:29.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:29.842 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:29.840+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:29.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:29.940+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:29.986 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:29.986 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:29.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:18:30.050 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:30.048+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:30.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:30.140 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:30.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:30.140 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:30.140 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:30.140 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:30.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:30.142+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:30.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:30.245 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:30.245+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:30.262 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:30.263 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:30.281 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:30.281 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:30.297 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:30.297 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:30.308 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:30.308 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:30.313 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:30.314 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:30.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:30.331 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:30.331 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:30.348 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:30.348 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:30.361 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:30.361+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:30.364 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:30.364 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:30.381 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:30.381 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:30.435 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:30.435 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:30.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:30.447 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:30.445+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:30.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:30.546+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:30.590 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:30.590 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:30.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:30.649 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:30.648+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:30.703 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:30.703 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:30.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:30.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:30.748+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:30.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:30.849+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:30.855 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:30.855 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:30.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:30.951 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:30.950+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:30.967 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:30.968 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:30.976 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:31.061 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:31.060+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:31.122 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:31.123 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:31.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:31.173 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:31.172+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:31.253 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:31.253+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:31.276 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:31.276 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:31.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:31.354 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:31.353+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:31.438 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:31.438 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:31.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:31.492 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:31.491+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:31.556 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:31.555+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:31.571 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:31.571 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:31.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:31.657 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:31.656+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:31.725 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:31.725 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:31.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:31.758 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:31.756+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:31.838 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:31.898 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:31.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:31.900 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:31.898+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:32.000 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:31.999+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:32.045 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:32.045 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:32.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:18:32.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:32.100 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:32.100+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:32.202 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:32.201+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:32.208 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:32.209 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:32.218 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:32.302 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:32.301+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:32.321 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:32.321 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:32.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:32.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:32.403 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:32.402+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:32.435 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:32.435 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:32.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:32.503 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:32.503+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:32.522 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:32.522 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:32.538 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:32.538 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:32.555 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:32.555 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:32.571 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:32.571 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:32.588 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:32.588 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:32.595 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:32.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:32.595 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:32.595 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:32.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:32.605 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:32.603+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:32.605 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:32.605 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:32.621 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:32.639 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:32.639 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:32.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:32.703+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:32.728 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:32.728 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:32.728 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:32.728 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:32.728 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:32.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:32.806 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:32.806+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:32.881 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:32.881 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:32.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:32.881 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:32.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.952362768999997, 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:18:32.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:18:32.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:18:32.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.952344252000003, 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.952171665999998, 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:18:32.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.952149824000003, 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:18:32.894 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:32.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.952129286999998, 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:18:32.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.952104757999997, 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.951254900000002, 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:18:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.951228512999997, 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:18:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:18:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.951205946999998, 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.951184237, 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.951163096999998, 2024-09-21T22:18:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:18:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:18:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:18:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:18:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:18:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:18:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:18:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:18:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:18:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:18:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:18:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:18:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:18:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:18:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:18:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.951141221999997, 2024-09-21T22:18:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:18:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:18:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:18:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:18:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:18:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:18:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:18:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:18:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.949525934, 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:18:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:18:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.949506155999998, 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:18:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.949486677000003, 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:18:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.949468275999998, 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:18:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.949435876999999, 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:18:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.949415737999999, 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:18:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:18:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160176 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.945349972999999, 2024-09-21T22:18:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074083248000000004, 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160176 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933866+0000", 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933867+0000", 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933869+0000", 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1210000000000001e-06 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933874+0000", 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933879+0000", 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4830000000000001e-06 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007941+0000", 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074061907999999996 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007950+0000", 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7329999999999992e-06 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160177 3.1f 3.48ed47f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.945331957000001, 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074112131999999997, 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160177 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933884+0000", 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933885+0000", 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933887+0000", 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933892+0000", 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.933896+0000", 2024-09-21T22:18:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4209999999999997e-06 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007986+0000", 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074089981999999999 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.007996+0000", 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:32.979 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:32.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:32.981 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:18:32.981 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:32.978+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:33.081 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:33.079+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:33.124 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:33.125 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:33.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:33.182 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:33.182+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:33.277 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:33.277 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:33.277 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:33.283 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:33.283+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:33.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:33.385 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:33.384+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 152.47266656299999, 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.349924946, 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:18:33.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.349915407, 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:33.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.349906567, 2024-09-21T22:18:33.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:18:33.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.349897361, 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:18:33.407 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:33.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.34988838699999, 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:33.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:18:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:18:33.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.34987948200001, 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:18:33.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:18:33.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.349857742, 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.349848318, 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.34983941900001, 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.349830466, 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:18:33.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.348325606, 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:18:33.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.34831610099999, 2024-09-21T22:18:33.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:18:33.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.444 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.348302362, 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:33.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:18:33.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:33.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 120.348293052, 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:33.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:18:33.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 114.48828205300001, 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 114.484660632, 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:33.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:18:33.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:18:33.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 113.90219009800001, 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.466 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:18:33.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:18:33.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:33.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.183527158000004, 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.472 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:33.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200487 3.4 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.216211389999998, 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070564014999999994, 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200487 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.477 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170963+0000", 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5590000000000001e-06 2024-09-21T22:18:33.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178398+0000", 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074350709999999997 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178437+0000", 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026000000000002e-05 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178452+0000", 2024-09-21T22:18:33.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5128e-05 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178600+0000", 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014802700000000001 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178942+0000", 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034162 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:33.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179139+0000", 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196672 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237616+0000", 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058477256999999998 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241380+0000", 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003763654 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241460+0000", 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0438999999999993e-05 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241524+0000", 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3561999999999999e-05 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.482 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:33.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:33.485 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:33.485+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:33.586 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:33.584+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:33.587 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:33.587 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:33.587 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:33.596 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:33.688 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:33.687+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:33.739 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:33.739 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:33.740 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:33.740 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:33.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:33.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:33.790+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:33.853 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 167.335031187, 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:18:33.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 167.32358474899999, 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 156.773497521, 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:18:33.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 148.71840975800001, 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:18:33.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:18:33.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 147.44731706900001, 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:18:33.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:18:33.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 147.44241049499999, 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:18:33.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 147.434178199, 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:18:33.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 147.432190867, 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.885 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:18:33.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:18:33.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 129.908337276, 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:18:33.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 123.865175665, 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:18:33.894 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:18:33.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 123.86367492399999, 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 109.883987936, 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:18:33.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:18:33.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 109.87910386, 2024-09-21T22:18:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:18:33.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:18:33.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 109.87831616299999, 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:18:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:18:33.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 109.87130872100001, 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:18:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 73.895384057000001, 2024-09-21T22:18:33.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.777836759000003, 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:18:33.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:192338 3.9 e153/90 3:91686995:::rbd_data.1185cbdbd00.0000000000000019:head v 153'371, mlcod=144'369)", 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.769721938000004, 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071372069999999996, 2024-09-21T22:18:33.929 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:33.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081784+0000", 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082349+0000", 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056494 2024-09-21T22:18:33.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082362+0000", 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082371+0000", 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082435+0000", 2024-09-21T22:18:33.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000007e-05 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082461+0000", 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5678e-05 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088868+0000", 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064072590000000002 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088921+0000", 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2417000000000003e-05 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200481 3.9 e156/90 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head v 156'377, mlcod=155'375)", 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.679012892999999, 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069452704000000004, 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.934 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172493+0000", 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197250+0000", 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024756805999999999 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197272+0000", 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2025999999999999e-05 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197285+0000", 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197371+0000", 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5525999999999994e-05 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197397+0000", 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6491000000000001e-05 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241890+0000", 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044492459999999998 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241945+0000", 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5557999999999999e-05 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.938 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200487 3.4 e156/23 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head v 156'412, mlcod=154'410)", 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.672023175, 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057925425000000003, 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:33.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179483+0000", 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:33.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186401+0000", 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006918502 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186438+0000", 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7036000000000003e-05 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186459+0000", 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0738e-05 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186576+0000", 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011731900000000001 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186615+0000", 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8571000000000001e-05 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237335+0000", 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050720316000000001 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:33.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237408+0000", 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2503999999999996e-05 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:33.943 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:33.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:33.945 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:33.943+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:34.045 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:34.043+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:34.054 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:34.055 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:34.055 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:34.055 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:34.057 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:18:34.057 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:18:34.057 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T22:18:34.057 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2024-09-21T22:18:34.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2024-09-21T22:18:34.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:34.146 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:34.144+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:34.170 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:34.170 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:34.170 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:34.170 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:34.170 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:34.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:34.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:34.245+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 139.08219338699999, 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.283 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.284 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.285 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 139.080317506, 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:34.289 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:34.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:34.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:34.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.31699215899999, 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.293 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:34.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:34.297 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.464666367000007, 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.298 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.299 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 92.189129751999999, 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:34.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:34.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.857474109000002, 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:34.309 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:34.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:34.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:34.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.352571327, 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:34.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:34.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.352546007000001, 2024-09-21T22:18:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:34.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.352511477999997, 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:34.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:34.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.352467918999999, 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.328 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.332 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.352442457000002, 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.336 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.352425250000003, 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:34.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:34.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.282357167000001, 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:34.341 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:34.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:34.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.282333784999999, 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:34.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.282314014999997, 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:34.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:34.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.282295079000001, 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:34.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:34.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.282275136000003, 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.359 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.136935577999999, 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.363 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:34.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.368 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.109729041999998, 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.369 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:34.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:34.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.093362206000002, 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:34.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:34.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:34.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.380 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:34.382 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:34.382 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:34.381+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:34.482 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:34.481+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:34.528 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:34.528 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:34.528 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:34.528 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:34.537 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:34.621 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:34.621+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:34.651 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:34.681 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:34.681 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:34.681 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:34.681 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:34.681 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:34.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:34.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:34.693+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:34.771 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:34.771 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:34.785 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:34.784+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:34.787 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:34.787 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:34.803 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:34.803 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:34.819 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:34.819 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:34.836 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:34.836 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:34.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:34.836 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88655006499999, 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:34.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:34.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88653070199999, 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:34.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:34.844 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88649805399999, 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.845 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88644688700001, 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88642021499999, 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:34.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.886395416, 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.857 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:34.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88636446800001, 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.862 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:34.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88634024999999, 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.866 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:34.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:34.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88631589799999, 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.870 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:34.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:34.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.874 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88629165500001, 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:34.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88626192000001, 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:34.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.882 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 149.88622645000001, 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:34.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:34.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.848695245, 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.655827586, 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.650461054, 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.632896261, 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:34.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:34.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.904 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.600515268, 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:34.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:34.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:34.908 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.55271182200001, 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:34.909 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:34.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:34.915 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.645894501000001, 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:34.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:34.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.638811869000001, 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:34.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:34.923 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:34.924 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:34.924 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:34.925 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:34.925 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:34.926 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:34.926 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:34.924+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:34.926 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:34.927 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:34.927 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:34.928 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:34.928 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.2 primary-affinity to 0 (802) 2024-09-21T22:18:34.981 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:18:35.026 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:35.024+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:35.086 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:35.086 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:35.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:35.139 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:35.138+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:35.199 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:35.199 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:35.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:35.228 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:35.226+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:35.328 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:35.327+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:35.352 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:35.352 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:35.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:35.429 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:35.428+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:35.506 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:35.506 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:35.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:35.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:35.529+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:35.618 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:35.618 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:35.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:35.631 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:35.629+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:35.730 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:35.730 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:35.732 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:35.731+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:35.739 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:35.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:35.831+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:35.846 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:35.846 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:35.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:35.921 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:18:35.934 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:35.934+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:36.013 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.013 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:36.035 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:36.035+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:36.128 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.128 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.136 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:36.134+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:36.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:36.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:36.236+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:36.283 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.283 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:36.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:36.375+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:36.437 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.437 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:36.438+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:36.446 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:36.541 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:36.540+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:36.589 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.589 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:36.641 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:36.641+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:36.702 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.702 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:36.742 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:36.741+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:36.814 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.814 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:36.843 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:36.843+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:36.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:36.932 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:36.932 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:36.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:36.984 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:36.982+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:37.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:37.043+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:37.077 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:37.094 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:37.094 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:37.103 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:37.104 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:37.110 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:37.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:37.127 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:37.128 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:37.145 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:37.145 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:37.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:37.144+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:37.162 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:37.162 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:37.179 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:37.179 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:37.209 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:37.210 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:37.247 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:37.246+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:37.247 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:37.248 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:37.256 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:37.347 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:37.345+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:37.400 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 170.88240812999999, 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:18:37.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 170.87096169200001, 2024-09-21T22:18:37.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 160.32087446400001, 2024-09-21T22:18:37.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:37.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:18:37.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 152.265786701, 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:18:37.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.418 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 150.994694012, 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:18:37.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 150.98978743800001, 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.423 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:18:37.427 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 150.98155514199999, 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:37.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:18:37.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:18:37.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 150.97956780999999, 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.435 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 133.45571421899999, 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.412552608, 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:18:37.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:37.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.411051867, 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:37.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 113.431364879, 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 113.426480803, 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:18:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:18:37.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:18:37.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 113.425693106, 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:18:37.458 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:18:37.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:18:37.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 113.41868566399999, 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:18:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:18:37.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 77.442761000000004, 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:18:37.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:18:37.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.325213701999999, 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:37.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:18:37.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:18:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:18:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:192338 3.9 e153/90 3:91686995:::rbd_data.1185cbdbd00.0000000000000019:head v 153'371, mlcod=144'369)", 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.317098881, 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071372069999999996, 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:37.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081784+0000", 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082349+0000", 2024-09-21T22:18:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056494 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082362+0000", 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082371+0000", 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082435+0000", 2024-09-21T22:18:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000007e-05 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082461+0000", 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5678e-05 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088868+0000", 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064072590000000002 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088921+0000", 2024-09-21T22:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2417000000000003e-05 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200481 3.9 e156/90 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head v 156'377, mlcod=155'375)", 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.226389836000003, 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069452704000000004, 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172493+0000", 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197250+0000", 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024756805999999999 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197272+0000", 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2025999999999999e-05 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197285+0000", 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197371+0000", 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5525999999999994e-05 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197397+0000", 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6491000000000001e-05 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241890+0000", 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044492459999999998 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241945+0000", 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5557999999999999e-05 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200487 3.4 e156/23 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head v 156'412, mlcod=154'410)", 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.219400118000003, 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057925425000000003, 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179483+0000", 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186401+0000", 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006918502 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186438+0000", 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7036000000000003e-05 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186459+0000", 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0738e-05 2024-09-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186576+0000", 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011731900000000001 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186615+0000", 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8571000000000001e-05 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237335+0000", 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050720316000000001 2024-09-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237408+0000", 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2503999999999996e-05 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:37.489 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:37.490 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:37.489+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:37.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:37.589+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:37.602 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:37.602 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:37.602 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:37.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:37.692 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:37.691+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:37.714 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:37.714 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:37.714 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:37.714 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:37.714 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:37.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:37.793 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:37.792+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:37.828 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 142.628081124, 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.829 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.830 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:37.831 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.832 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:37.833 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.834 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 142.62620524299999, 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:37.836 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:37.837 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.838 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 109.862879896, 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.839 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.840 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:37.841 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:37.842 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.843 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 96.010554103999993, 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.844 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.845 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:37.846 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.847 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.848 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.849 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 95.735017489000001, 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:37.850 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.851 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:37.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:37.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:37.855 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.403361846000003, 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:37.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:37.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:37.861 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.898459064000001, 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:37.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:37.865 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.898433744000002, 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.866 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:37.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.870 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.898399214999998, 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.874 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.898355656, 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.875 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.898330194000003, 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.898312986999997, 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:37.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:37.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.828244904000002, 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.888 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:37.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:37.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.828221522, 2024-09-21T22:18:37.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:37.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:37.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.828201751999998, 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:37.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:37.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.828182816000002, 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.901 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:37.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:37.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 44.828162872999997, 2024-09-21T22:18:37.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:37.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.909 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.682823315, 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.915 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.655616778999999, 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:37.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.639249943000003, 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:37.921 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:37.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:37.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:37.926 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:37.926 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:37.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:37.927 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:37.926+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:37.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:18:38.028 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:38.027+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:38.078 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:38.079 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:38.079 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:38.079 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:38.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:38.128 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:38.127+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:38.191 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:38.191 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:38.191 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:38.191 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:38.191 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:38.199 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:38.244 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:38.243+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:38.305 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.356470304, 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.306 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:38.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:38.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:38.310 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35645094099999, 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:38.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:38.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35641829299999, 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.315 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:38.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35636712600001, 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:38.319 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.323 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35634045399999, 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.356315655, 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.328 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:38.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35628470699999, 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.332 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:38.336 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35626048899999, 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:38.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.356236137, 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:38.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:38.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:38.344 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35621189400001, 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.345 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35618215900001, 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.349 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.35614668900001, 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.357 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.31861548400001, 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.358 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:38.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:38.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:38.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.125747825, 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:38.362 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:38.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:38.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:38.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.12038129299999, 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.367 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:38.371 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.1028165, 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:38.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.070435507, 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:38.376 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:38.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 124.022632061, 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:38.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:38.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:38.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:38.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:38.387 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.115814739999998, 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:38.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:38.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 42.108732107999998, 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.395 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.396 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.396 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.396 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.396 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:38.397 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:38.397 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:38.396+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:38.497 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:38.497+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:38.543 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:38.543 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:38.543 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:38.543 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:38.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:38.636 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:38.635+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:38.699 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:38.698+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:38.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:38.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:38.799+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:38.850 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:38.850 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 162.33728568000001, 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.851 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.852 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.853 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 157.934343377, 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.857 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:18:38.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:18:38.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:18:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 157.93428052199999, 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807517683, 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807482591999999, 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807468153000002, 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:18:38.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:18:38.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807453494000001, 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.884 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:18:38.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:18:38.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.888 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807440450999998, 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:18:38.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:18:38.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807416961999998, 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.893 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807403823999998, 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.901 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807393689000001, 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:18:38.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:18:38.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807293166999997, 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.906 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:38.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:18:38.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:18:38.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807275374, 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:18:38.910 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:18:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:18:38.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807254854, 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.918 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.807232853000002, 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:18:38.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:18:38.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:18:38.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.799258924999997, 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.923 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:18:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:18:38.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.781856615000002, 2024-09-21T22:18:38.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.931 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.781714518000001, 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.781318632999998, 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:212530 3.15 3.b8de775 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e188)", 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 9.6966680190000005, 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.88748263100000002, 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:38.940 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 212530 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:38.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152033+0000", 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4799999999999998e-07 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152037+0000", 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6030000000000001e-06 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152044+0000", 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152049+0000", 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152089+0000", 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0169000000000001e-05 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152095+0000", 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9000000000000003e-06 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:30.039503+0000", 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.887408325 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:30.039515+0000", 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1433999999999999e-05 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.944 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:38.945 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:38.945 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:38.945 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is set 2024-09-21T22:18:38.946 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:38.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:38.945+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:39.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:39.046+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:39.062 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:39.062 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:39.062 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:39.062 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:39.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:39.147 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:39.146+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:39.175 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:39.175 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:39.175 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:39.175 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:39.175 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:39.184 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:39.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:39.270 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:39.269+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:39.288 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:39.289 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.886171828, 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.290 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.291 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.292 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:39.293 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.294 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.886124951, 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.295 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:39.296 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:39.297 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.298 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.886060211, 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.299 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.303 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.886023982, 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.307 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885930055, 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:39.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885906287, 2024-09-21T22:18:39.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.316 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.88584141600001, 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.88580379299999, 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.321 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885763, 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.325 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:39.329 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885687539, 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:39.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.333 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885617166, 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:39.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:39.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:39.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.88558349100001, 2024-09-21T22:18:39.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:39.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:39.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885514739, 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.88547034299999, 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:39.347 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:39.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.351 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885379395, 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.352 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885350871, 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:39.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:39.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.360 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.88531857700001, 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.364 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 123.885280444, 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.365 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 43.115553343000002, 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.369 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 38.289572868, 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:39.375 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:39.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:39.382 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:39.382 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:39.383 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:39.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:39.383 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:39.381+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:39.384 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:39.384 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:39.396 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:39.396 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:39.413 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:39.413 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:39.430 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:39.446 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:39.446 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:39.463 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:39.463 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:39.490 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:39.490 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:39.491 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:39.489+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:39.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:39.583 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:39.582+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:39.641 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:39.641 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:39.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:39.683 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:39.683+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:39.785 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:39.784+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:39.792 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:39.792 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:39.801 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:39.885 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:39.885+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:39.930 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:18:39.930 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:18:39.930 INFO:tasks.thrashosds.thrasher:Reweighting osd 7 to 0.6586808497443105 2024-09-21T22:18:39.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 0.6586808497443105 2024-09-21T22:18:39.945 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:39.945 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:39.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:39.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:39.998+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:40.087 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:40.086+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:40.112 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:40.112 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:40.122 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:40.206 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:40.205+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:40.267 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:40.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:40.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:40.316+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:40.389 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:40.388+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:40.419 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:40.419 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:40.427 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:40.490 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:40.489+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:40.530 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:40.531 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:40.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:40.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:40.622+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:40.683 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:40.683 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:40.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:40.692 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:40.690+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:40.791 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:40.791+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:40.834 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:40.835 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:40.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:40.892 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:40.892+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:40.946 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:40.946 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:40.954 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.7 to 0.658681 (a89f) 2024-09-21T22:18:40.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:18:40.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:41.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:41.014+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:41.094 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:41.094+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:41.123 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:41.124 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:41.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:41.195 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:41.194+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:41.240 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:41.240 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:41.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:41.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:41.295+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:41.352 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:41.352 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:41.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:41.405 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:41.405+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:41.466 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:41.467 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:41.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:41.476 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:41.518 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:41.517+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:41.596 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:41.596 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:41.598 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:41.597+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:41.612 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:41.612 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:41.628 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:41.628 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:41.631 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:41.643 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:41.644 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:41.660 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:41.660 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:41.676 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:41.693 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:41.694 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:41.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:41.698+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:41.710 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:41.710 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:41.737 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:41.737 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:41.737 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:41.737 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:41.737 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:41.746 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:41.800 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:41.799+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:41.852 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:41.852 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:41.852 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:41.852 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:41.852 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90318206000001, 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.853 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:41.855 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.903162697, 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:41.860 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:41.861 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:41.862 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.903130049, 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.863 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:41.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.866 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90307888199999, 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.867 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:41.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90305221, 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.872 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.876 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90302741100001, 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:41.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90299646299999, 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:41.881 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.885 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.902972245, 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.886 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:41.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:41.889 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.902947893, 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.890 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:41.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:41.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90292364999999, 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:41.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.899 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90289391499999, 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 156.90285844499999, 2024-09-21T22:18:41.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:41.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:41.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.908 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.86532724, 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:41.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.913 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.672459581, 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.914 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:41.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.667093049, 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.919 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.920 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.921 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.649528256, 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:41.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:41.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.61714726300001, 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.569343817, 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:41.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:41.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:41.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:41.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:41.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:41.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:41.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:41.941 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 45.662526495999998, 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:41.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.946 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 45.655443863999999, 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:41.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:41.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:41.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.951 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.951 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:41.951 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:41.951 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:41.952 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:18:41.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:41.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:41.951+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:42.052 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:42.052+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:42.098 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:42.098 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:42.099 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:42.099 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:42.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:42.154 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:42.153+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:42.252 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:42.252 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:42.252 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:42.253 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:42.253 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:42.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:42.254+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:42.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:42.355 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:42.355+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 165.85469643799999, 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.368 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:18:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:42.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 161.45175413499999, 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.374 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:42.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 161.45169128000001, 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:18:42.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:18:42.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324928440999997, 2024-09-21T22:18:42.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:42.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:18:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.393 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324893350000004, 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:18:42.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:18:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:18:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324878910999999, 2024-09-21T22:18:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:18:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:18:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:18:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:18:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:18:42.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:18:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:18:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324864251999998, 2024-09-21T22:18:42.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.410 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324851209000002, 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:18:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324827720000002, 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:18:42.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:18:42.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324814582000002, 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:42.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:18:42.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.423 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324804446999998, 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.424 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:18:42.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:18:42.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324703925000001, 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.428 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324686131999997, 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.432 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.436 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324665611999997, 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:42.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:18:42.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.324643610999999, 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.441 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.443 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:18:42.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.316669683000001, 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:18:42.445 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:18:42.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:18:42.449 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.299267372999999, 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.450 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.451 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.452 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.453 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.299125275999998, 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.454 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.455 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.456 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:18:42.457 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.458 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 59.298729391000002, 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:18:42.459 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.460 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.461 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:18:42.462 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:212530 3.15 3.b8de775 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e188)", 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 13.214078776999999, 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.88748263100000002, 2024-09-21T22:18:42.463 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 212530 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:42.464 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152033+0000", 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4799999999999998e-07 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.465 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152037+0000", 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6030000000000001e-06 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152044+0000", 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152049+0000", 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.466 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152089+0000", 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0169000000000001e-05 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152095+0000", 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9000000000000003e-06 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:30.039503+0000", 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.887408325 2024-09-21T22:18:42.467 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:30.039515+0000", 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1433999999999999e-05 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.468 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:42.470 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:42.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:42.468+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:42.571 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:42.570+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:42.614 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:42.615 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:42.615 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:42.615 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:42.623 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:42.708 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:42.707+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:42.768 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:42.768 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:42.769 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:42.769 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:42.769 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:42.772 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:42.771+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:42.777 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:42.872 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:42.872+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:42.927 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:42.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.525054539, 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.928 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:42.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52500766199999, 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:42.933 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:42.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:42.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:42.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52494292199999, 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.938 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:42.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:42.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.942 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52490669300001, 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:42.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:42.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524812766, 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.950 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52478899800001, 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.952 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524724127, 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.957 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:42.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524686504, 2024-09-21T22:18:42.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:42.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52464571100001, 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.966 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.967 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.968 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.969 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.970 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52457025, 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.971 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.972 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524499877, 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.976 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.977 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524466202, 2024-09-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:42.984 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.985 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52439745, 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.986 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:42.987 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.988 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.989 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.990 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524353054, 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.991 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:42.992 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.993 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:42.995 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52426210599999, 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.996 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:42.997 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:42.998 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:42.999 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.000 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.52423358199999, 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:43.001 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.002 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.003 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.004 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524201288, 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:43.005 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:43.006 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.007 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:43.008 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 127.524163155, 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:43.009 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.010 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.011 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.012 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 46.754436054000003, 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:43.014 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.015 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.017 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:43.018 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 41.928455579000001, 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:43.019 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:43.020 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:43.021 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:43.022 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:43.023 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:43.024 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:43.025 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.025 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:43.025 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.025 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:43.025 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:43.025 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:43.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:43.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:43.025+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:43.127 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:43.126+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:43.134 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:43.134 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:43.135 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:43.135 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:43.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:43.228 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:43.227+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:43.248 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:43.248 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:43.248 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:43.248 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:43.248 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:43.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:43.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:43.328+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:43.362 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:43.362 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:43.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:43.362 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:43.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 163.45014577000001, 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:18:43.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 163.44752369700001, 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.464818499000003, 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:18:43.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:18:43.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.415532647999996, 2024-09-21T22:18:43.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:18:43.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.413281957999999, 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.385 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:18:43.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:18:43.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.413179807000006, 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.409359531000007, 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:18:43.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:18:43.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:43.400 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.409339392999996, 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:18:43.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:18:43.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.404 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.409318874999997, 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:18:43.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:18:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.381392331000001, 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.381372760999994, 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:18:43.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:18:43.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.381354169999994, 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.38133449, 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:18:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.425 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.381306129999999, 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:43.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:18:43.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.381284588, 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:18:43.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190908 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 303104~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.431388669, 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057426265999999997, 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190908 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928944+0000", 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2010000000000002e-06 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928951+0000", 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928956+0000", 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1030000000000001e-06 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986168+0000", 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212363000000002 2024-09-21T22:18:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986213+0000", 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5142999999999998e-05 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986367+0000", 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190909 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 385024~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.431367561000002, 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057618427999999999, 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190909 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928963+0000", 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928965+0000", 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928972+0000", 2024-09-21T22:18:43.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5610000000000001e-06 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928977+0000", 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986391+0000", 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057413929000000002 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986434+0000", 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2582e-05 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986581+0000", 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014685300000000001 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190910 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 450560~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:43.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.431345735000001, 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057841218, 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190910 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:43.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928987+0000", 2024-09-21T22:18:43.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6740000000000001e-06 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928993+0000", 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929000+0000", 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6159999999999998e-06 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986611+0000", 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057611258999999998 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986651+0000", 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0303999999999999e-05 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986825+0000", 2024-09-21T22:18:43.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173847 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190911 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 598016~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.431324480999997, 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058186806000000001, 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190911 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929007+0000", 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:18:43.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929012+0000", 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929015+0000", 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986859+0000", 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057844049000000002 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986940+0000", 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1265000000000002e-05 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.987192+0000", 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175700000000002 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200490 3.b 3:d36e58d9:::rbd_data.1185b457050c.0000000000000005:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.185907153000002, 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067382992000000003, 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200490 2024-09-21T22:18:43.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:43.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174426+0000", 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3400000000000002e-06 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183430+0000", 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090044610000000001 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183473+0000", 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2531000000000003e-05 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:43.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183494+0000", 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0939999999999999e-05 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183619+0000", 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125334 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183864+0000", 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000244536 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.184078+0000", 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021405400000000001 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237365+0000", 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053287147999999999 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241686+0000", 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043208910000000003 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241753+0000", 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7396000000000003e-05 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241806+0000", 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2361000000000002e-05 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:43.460 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:43.460 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:43.459+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:43.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:43.560+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:43.604 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:43.604 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:43.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:43.662 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:43.661+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:43.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:18:43.758 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:43.758 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:43.758 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:43.758 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:43.758 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:43.762 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:43.762+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:43.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:43.847 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:43.847 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:43.863 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:43.863+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:43.864 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:43.864 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:43.880 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:43.880 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:43.896 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:43.913 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:43.913 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:43.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:43.948 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:43.948 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:43.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:18:43.964 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:43.963+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:43.965 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:43.965 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:44.043 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:44.043 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:44.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:44.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:44.095+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:44.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:44.164+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:44.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:44.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:44.265+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:44.312 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:44.312 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:44.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:44.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:44.404+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:44.467 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:44.467+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:44.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:44.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:44.568+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:44.618 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:44.618 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:44.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:44.669 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:44.668+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:44.770 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:44.768+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:44.772 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:44.772 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:44.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:44.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:44.870+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:44.897 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:44.897 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:44.906 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:44.971 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:18:44.972 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:44.970+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:45.019 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.019 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:45.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:45.072+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:45.172 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.172 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.173 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:45.172+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:45.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:45.274 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:45.272+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:45.326 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.326 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:45.375 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:45.374+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:45.477 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:45.475+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:45.479 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.479 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:45.577 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:45.576+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:45.591 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.591 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:45.678 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:45.676+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:45.704 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.704 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.714 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:45.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:45.778+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:45.858 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.858 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:45.911 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:45.909+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:45.971 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:45.971 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:45.974 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-21T22:18:45.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:18:45.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:45.980 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:45.978+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:45.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:18:46.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:46.080+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:46.131 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:46.131 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:46.140 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0: {} 2024-09-21T22:18:46.159 INFO:teuthology.orchestra.run.smithi134.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:18:46.176 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1: {} 2024-09-21T22:18:46.176 INFO:teuthology.orchestra.run.smithi134.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:18:46.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:46.181+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:46.192 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2: {} 2024-09-21T22:18:46.192 INFO:teuthology.orchestra.run.smithi134.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:18:46.209 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3: {} 2024-09-21T22:18:46.209 INFO:teuthology.orchestra.run.smithi134.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:18:46.227 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4: {} 2024-09-21T22:18:46.227 INFO:teuthology.orchestra.run.smithi134.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:18:46.243 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5: {} 2024-09-21T22:18:46.244 INFO:teuthology.orchestra.run.smithi134.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:18:46.245 INFO:teuthology.orchestra.run.smithi149.stdout:ERROR: (22) Invalid argument 2024-09-21T22:18:46.245 INFO:teuthology.orchestra.run.smithi149.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:18:46.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:46.260 INFO:teuthology.orchestra.run.smithi134.stdout:osd.6: {} 2024-09-21T22:18:46.260 INFO:teuthology.orchestra.run.smithi134.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:18:46.276 INFO:teuthology.orchestra.run.smithi134.stdout:osd.7: {} 2024-09-21T22:18:46.276 INFO:teuthology.orchestra.run.smithi134.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:18:46.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:46.281+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:46.359 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:46.359 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95750011499999, 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:46.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:46.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:46.363 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.957453238, 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:46.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.957388498, 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.368 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.372 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95735226900001, 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95725834199999, 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.381 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95723457400001, 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.385 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95716970300001, 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:46.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.389 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95713208000001, 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:46.392 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.393 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.957091287, 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:46.395 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:46.396 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.398 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.957015826, 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:46.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:46.402 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.956945453, 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.403 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:46.405 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:46.406 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95691177800001, 2024-09-21T22:18:46.407 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:46.409 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.410 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.956843026, 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.412 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:46.413 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.414 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95679863000001, 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.416 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.417 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:46.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.956707682, 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.420 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.421 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.422 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95667915799999, 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95664686399999, 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.429 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:46.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 130.95660873099999, 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.433 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.434 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.435 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.436 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 50.186881630000002, 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:46.437 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:46.438 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.439 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.440 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.441 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.442 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 45.360901155000001, 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.443 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:46.444 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.445 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:46.446 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:46.447 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:46.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:46.450 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T22:18:46.448+0000 7fe58d913640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33712) UID: 0 2024-09-21T22:18:46.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:46.550+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:46.552 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:46.552 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:46.552 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:46.552 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:46.561 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:46.651 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:46.650+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:46.704 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:46.704 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:46.704 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:46.704 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:46.704 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:46.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:46.756 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:46.755+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:46.817 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:46.817 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:46.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:46.817 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:46.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 166.90512564599999, 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:18:46.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:18:46.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 166.90250357299999, 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:18:46.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.919798374999999, 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:46.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.870512524000006, 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.868261833999995, 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:18:46.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.868159683000002, 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.864339407000003, 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:18:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:18:46.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.864319269000006, 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:18:46.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.864298751000007, 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.855 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.836372206999997, 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:46.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:18:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.863 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.836352637000005, 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.867 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.836334046000005, 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.868 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.836314365999996, 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.872 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.876 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.836286005999995, 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.836264463999996, 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190908 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 303104~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.886368545000003, 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057426265999999997, 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190908 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:46.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928944+0000", 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2010000000000002e-06 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928951+0000", 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:18:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928956+0000", 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1030000000000001e-06 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986168+0000", 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212363000000002 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986213+0000", 2024-09-21T22:18:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5142999999999998e-05 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986367+0000", 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190909 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 385024~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.886347436999998, 2024-09-21T22:18:46.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057618427999999999, 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190909 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928963+0000", 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928965+0000", 2024-09-21T22:18:46.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928972+0000", 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5610000000000001e-06 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928977+0000", 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986391+0000", 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057413929000000002 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986434+0000", 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2582e-05 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986581+0000", 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014685300000000001 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190910 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 450560~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.886325610999997, 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057841218, 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.894 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190910 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928987+0000", 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6740000000000001e-06 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928993+0000", 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929000+0000", 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6159999999999998e-06 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986611+0000", 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057611258999999998 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986651+0000", 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0303999999999999e-05 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986825+0000", 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173847 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190911 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 598016~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.886304357, 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058186806000000001, 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190911 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929007+0000", 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929012+0000", 2024-09-21T22:18:46.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929015+0000", 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986859+0000", 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057844049000000002 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986940+0000", 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1265000000000002e-05 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.987192+0000", 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175700000000002 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200490 3.b 3:d36e58d9:::rbd_data.1185b457050c.0000000000000005:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.640887028999998, 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067382992000000003, 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200490 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174426+0000", 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3400000000000002e-06 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183430+0000", 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090044610000000001 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183473+0000", 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2531000000000003e-05 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183494+0000", 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0939999999999999e-05 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183619+0000", 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125334 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183864+0000", 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000244536 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.184078+0000", 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021405400000000001 2024-09-21T22:18:46.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237365+0000", 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053287147999999999 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241686+0000", 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043208910000000003 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241753+0000", 2024-09-21T22:18:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7396000000000003e-05 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241806+0000", 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2361000000000002e-05 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:46.908 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:46.910 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:46.908+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:46.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:18:46.910 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:18:46.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:18:46.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:18:47.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-09-21T22:18:47.011+0000 7f37810bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33204) UID: 0 2024-09-21T22:18:47.034 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:47.034 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:47.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:18:47.128 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:47.127+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:47.191 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:47.191 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:47.191 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:47.191 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:47.191 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:47.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:18:47.212 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:47.210+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:47.312 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T22:18:47.311+0000 7f5e521d7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33705) UID: 0 2024-09-21T22:18:47.346 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:47.346 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:47.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:47.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:47.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160015 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5466112~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.417482704999998, 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074392530999999998, 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160015 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926854+0000", 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926856+0000", 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.956e-06 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926862+0000", 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7830000000000004e-06 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926866+0000", 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7469999999999996e-06 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000662+0000", 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073795628000000002 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.000734+0000", 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1581000000000005e-05 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001246+0000", 2024-09-21T22:18:47.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051249800000000001 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160016 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5474304~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.417464187999997, 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074567296000000005, 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160016 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.926872+0000", 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927014+0000", 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014214300000000001 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927018+0000", 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6339999999999999e-06 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927027+0000", 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0580000000000004e-06 2024-09-21T22:18:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927033+0000", 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6109999999999999e-06 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001278+0000", 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074244847000000003 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001348+0000", 2024-09-21T22:18:47.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9586999999999996e-05 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001439+0000", 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160017 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5482496~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.417291602000006, 2024-09-21T22:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582296000000006, 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160017 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927045+0000", 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927047+0000", 2024-09-21T22:18:47.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927054+0000", 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927059+0000", 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9289999999999997e-06 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001468+0000", 2024-09-21T22:18:47.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074408969000000005 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001535+0000", 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7498999999999999e-05 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001627+0000", 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1577999999999996e-05 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160018 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5490688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.417269759999996, 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074753964000000006, 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160018 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927066+0000", 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927067+0000", 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3099999999999998e-07 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927069+0000", 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.153e-06 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927075+0000", 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0809999999999999e-06 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927080+0000", 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1819999999999997e-06 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001656+0000", 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074575137999999999 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001723+0000", 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7410999999999995e-05 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001820+0000", 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7467999999999996e-05 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160019 3.1f 3:fbd4f807:::rbd_data.11859234a8c3.0000000000000005:37 [read 5498880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.417249222999999, 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074921800999999996, 2024-09-21T22:18:47.364 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160019 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927087+0000", 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.72e-07 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927094+0000", 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6769999999999998e-06 2024-09-21T22:18:47.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927100+0000", 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2700000000000001e-06 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927105+0000", 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001854+0000", 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074748466 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.001923+0000", 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8986000000000007e-05 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002009+0000", 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6150999999999996e-05 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160148 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5245952~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.417224693999998, 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075083285999999999, 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160148 2024-09-21T22:18:47.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927112+0000", 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927924+0000", 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081218900000000005 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927929+0000", 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927941+0000", 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1544e-05 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927948+0000", 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.559e-06 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002037+0000", 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074088216999999998 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002110+0000", 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3292000000000002e-05 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002195+0000", 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4983999999999998e-05 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160149 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5254144~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.416374836000003, 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074409669999999997, 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160149 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927961+0000", 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927962+0000", 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927964+0000", 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5780000000000001e-06 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927972+0000", 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927979+0000", 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002222+0000", 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074243058000000001 2024-09-21T22:18:47.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002289+0000", 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7199000000000005e-05 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002371+0000", 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2201999999999997e-05 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160150 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5262336~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.416348448999997, 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074556519000000002, 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160150 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927988+0000", 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000002e-07 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927991+0000", 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3410000000000001e-06 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.927998+0000", 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.007e-06 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928003+0000", 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6740000000000002e-06 2024-09-21T22:18:47.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002398+0000", 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074394363000000005 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002463+0000", 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5143999999999998e-05 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002544+0000", 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1543000000000002e-05 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160151 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5270528~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.416325882999999, 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074707212999999995, 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160151 2024-09-21T22:18:47.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928010+0000", 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928011+0000", 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9200000000000002e-07 2024-09-21T22:18:47.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928013+0000", 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1349999999999999e-06 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928020+0000", 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928025+0000", 2024-09-21T22:18:47.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002571+0000", 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074546075000000003 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002636+0000", 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4962000000000006e-05 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002718+0000", 2024-09-21T22:18:47.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1184000000000001e-05 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160152 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5278720~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.416304173, 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076974906999999995, 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160152 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928032+0000", 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928033+0000", 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6100000000000001e-07 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928035+0000", 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928041+0000", 2024-09-21T22:18:47.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7320000000000001e-06 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928047+0000", 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002745+0000", 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074698116999999994 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.002824+0000", 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9228999999999996e-05 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.005007+0000", 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021829340000000001 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160153 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5286912~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:47.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.416283032999999, 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075280171000000007, 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160153 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928053+0000", 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928054+0000", 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928056+0000", 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T22:18:47.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928063+0000", 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928068+0000", 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.711e-06 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003170+0000", 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075102076000000004 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003245+0000", 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4878999999999999e-05 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003333+0000", 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8196999999999996e-05 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160154 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5295104~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.416261157999998, 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075433947000000001, 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160154 2024-09-21T22:18:47.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.928075+0000", 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929637+0000", 2024-09-21T22:18:47.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001561738 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929642+0000", 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.023e-06 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929650+0000", 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0369999999999995e-06 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929656+0000", 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2689999999999996e-06 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003358+0000", 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073702291000000003 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003427+0000", 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8297e-05 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003509+0000", 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2292000000000004e-05 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160156 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5311488~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.414645870000001, 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074173825999999998, 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160156 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929690+0000", 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929691+0000", 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929693+0000", 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929699+0000", 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0020000000000003e-06 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929704+0000", 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003708+0000", 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074003581999999998 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003782+0000", 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4530999999999995e-05 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003864+0000", 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1976000000000003e-05 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160157 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5319680~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.414626092000006, 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074311917000000005, 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160157 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929710+0000", 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929711+0000", 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8500000000000002e-07 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929713+0000", 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929719+0000", 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9039999999999997e-06 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929724+0000", 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559999999999998e-06 2024-09-21T22:18:47.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003887+0000", 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074163534000000003 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003944+0000", 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6437000000000002e-05 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004022+0000", 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8502000000000002e-05 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160158 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5327872~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.414606613000004, 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074467400000000003, 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160158 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929730+0000", 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4200000000000002e-07 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929732+0000", 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9800000000000001e-06 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929738+0000", 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8479999999999997e-06 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929742+0000", 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004046+0000", 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074303333999999999 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004112+0000", 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6744999999999999e-05 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004197+0000", 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4611999999999996e-05 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160159 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5336064~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.414588211999998, 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074604956, 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160159 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929748+0000", 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929757+0000", 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929763+0000", 2024-09-21T22:18:47.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929773+0000", 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004214+0000", 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074441182999999994 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004271+0000", 2024-09-21T22:18:47.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6808999999999998e-05 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004353+0000", 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1796000000000001e-05 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160160 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5344256~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.414555813000007, 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074723590000000006, 2024-09-21T22:18:47.416 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160160 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929780+0000", 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929781+0000", 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3099999999999998e-07 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929783+0000", 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3470000000000001e-06 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929789+0000", 2024-09-21T22:18:47.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1319999999999999e-06 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929794+0000", 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004377+0000", 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074582873999999993 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004440+0000", 2024-09-21T22:18:47.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2514000000000005e-05 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004504+0000", 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4449000000000006e-05 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160161 3.1f 3:fe2b7120:::rbd_data.11859234a8c3.0000000000000002:37 [read 5352448~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.414535674000007, 2024-09-21T22:18:47.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074868287000000006, 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160161 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929801+0000", 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929803+0000", 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1550000000000001e-06 2024-09-21T22:18:47.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929810+0000", 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4749999999999998e-06 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.929814+0000", 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-06 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004528+0000", 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074713358999999993 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004591+0000", 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-05 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004669+0000", 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7348999999999994e-05 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:214108 3.12 3:4b6efdab:::rbd_data.1185acca6c1f.0000000000000020:head [delete] snapc b=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e201)", 2024-09-21T22:18:47.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:18:41.906448+0000", 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4378880949999999, 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0223834629999999, 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 214108 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906448+0000", 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906448+0000", 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906450+0000", 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9410000000000001e-06 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906460+0000", 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906476+0000", 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5826999999999999e-05 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906484+0000", 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7139999999999999e-06 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906558+0000", 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3387999999999996e-05 2024-09-21T22:18:47.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906564+0000", 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1310000000000003e-06 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.910048+0000", 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034837290000000001 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:47.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.910058+0000", 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0652000000000001e-05 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.926783+0000", 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0167243340000001 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.927008+0000", 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225007 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.927188+0000", 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018032700000000001 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.928620+0000", 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001431898 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.928656+0000", 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6377000000000001e-05 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.928705+0000", 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8844999999999997e-05 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.928832+0000", 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012643299999999999 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:214115 3.12 3:4a49afd6:::rbd_data.1185acca6c1f.0000000000000039:head [delete] snapc b=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e201)", 2024-09-21T22:18:47.431 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:18:41.906505+0000", 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4378314530000003, 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.022897787, 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 214115 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906505+0000", 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906505+0000", 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906505+0000", 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1199999999999999e-07 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906507+0000", 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1959999999999998e-06 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906512+0000", 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906516+0000", 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3380000000000001e-06 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906607+0000", 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1810000000000004e-05 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.906612+0000", 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8579999999999999e-06 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.910084+0000", 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003471914 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:41.910092+0000", 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4599999999999997e-06 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.927943+0000", 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017851579 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.928064+0000", 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012098400000000001 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.928176+0000", 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111567 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.928941+0000", 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076549699999999997 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.929200+0000", 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000259051 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.929288+0000", 2024-09-21T22:18:47.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:18:42.929403+0000", 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114438 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.438 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:47.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:18:47.440 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:47.438+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:47.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-21T22:18:47.540+0000 7faa2f4f5640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33208) UID: 0 2024-09-21T22:18:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:47.585 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:47.585 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:47.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:18:47.678 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:47.677+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:47.736 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:47.736 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:47.736 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:47.736 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:47.737 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:47.742 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T22:18:47.740+0000 7fc6469df640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33707) UID: 0 2024-09-21T22:18:47.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:18:47.843 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T22:18:47.841+0000 7f0f6a021640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33715) UID: 0 2024-09-21T22:18:47.891 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:47.891 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:47.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:47.891 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:47.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11584 3.19 3:9a42aaea:::rbd_header.1185acca6c1f:head [watch reconnect cookie 140355169210704 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 166.97478884200001, 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.009944591, 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11584 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914504+0000", 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914506+0000", 2024-09-21T22:18:47.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.871e-06 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914512+0000", 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914522+0000", 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8749999999999995e-06 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914531+0000", 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9129999999999992e-06 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915183+0000", 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065172600000000004 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.915190+0000", 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9199999999999998e-06 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922696+0000", 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0075065839999999 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.922836+0000", 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013931100000000001 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:01.924449+0000", 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001613443 2024-09-21T22:18:47.896 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44894 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1667072~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85204722500001, 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057424472999999997, 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.897 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44894 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037246+0000", 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037247+0000", 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9199999999999999e-07 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037251+0000", 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3220000000000001e-06 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037253+0000", 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094577+0000", 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057323878000000002 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094619+0000", 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2633999999999999e-05 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094671+0000", 2024-09-21T22:18:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1082999999999999e-05 2024-09-21T22:18:47.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44895 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1695744~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85203768599999, 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057539382, 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44895 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037256+0000", 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037257+0000", 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037260+0000", 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.762e-06 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037262+0000", 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094695+0000", 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057433567999999997 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094736+0000", 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0587999999999998e-05 2024-09-21T22:18:47.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094795+0000", 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8934999999999997e-05 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44896 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1724416~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.852028846, 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057640824, 2024-09-21T22:18:47.906 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44896 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037264+0000", 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037265+0000", 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0599999999999999e-07 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037266+0000", 2024-09-21T22:18:47.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037268+0000", 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7819999999999998e-06 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037271+0000", 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3039999999999999e-06 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094820+0000", 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057549177999999999 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094858+0000", 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8087999999999999e-05 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094905+0000", 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7305999999999997e-05 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44897 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1753088~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85201964000001, 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057739153000000001, 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.911 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44897 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037274+0000", 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.05e-07 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037275+0000", 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037278+0000", 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8329999999999998e-06 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037280+0000", 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2989999999999999e-06 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094928+0000", 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057647721999999998 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.094966+0000", 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.875e-05 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095013+0000", 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6288999999999997e-05 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44898 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1781760~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85201066600001, 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057835465000000003, 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44898 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037283+0000", 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037284+0000", 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3699999999999999e-07 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037287+0000", 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037289+0000", 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2570000000000002e-06 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095035+0000", 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057746278999999998 2024-09-21T22:18:47.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095072+0000", 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6999999999999998e-05 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095118+0000", 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5989999999999998e-05 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44899 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1810432~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.852001761, 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057931369000000003, 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44899 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037292+0000", 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-07 2024-09-21T22:18:47.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037301+0000", 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3100000000000006e-06 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037305+0000", 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037310+0000", 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3650000000000003e-06 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095140+0000", 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057829717000000003 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095177+0000", 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7449e-05 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095223+0000", 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5606999999999999e-05 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44900 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1839104~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.851980021, 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058041926000000001, 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44900 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:47.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037313+0000", 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.11e-07 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037315+0000", 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037318+0000", 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1360000000000001e-06 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037320+0000", 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3180000000000001e-06 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095256+0000", 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057935598999999997 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095305+0000", 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9393e-05 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095355+0000", 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0154999999999997e-05 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44901 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1867776~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.928 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85197059699999, 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058147572000000002, 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44901 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037323+0000", 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037324+0000", 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0720000000000001e-06 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037327+0000", 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8210000000000002e-06 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037329+0000", 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2460000000000002e-06 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095378+0000", 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058049124000000001 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095421+0000", 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2658999999999999e-05 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095470+0000", 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9441999999999999e-05 2024-09-21T22:18:47.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44902 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1896448~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.851961698, 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058256700000000002, 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44902 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037332+0000", 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037333+0000", 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037336+0000", 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8200000000000001e-06 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037338+0000", 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.289e-06 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095494+0000", 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058156140000000002 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095537+0000", 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3111000000000001e-05 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095588+0000", 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1128000000000002e-05 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44903 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 1925120~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85195274500001, 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058366844000000001, 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44903 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.037341+0000", 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038774+0000", 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014330460000000001 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038778+0000", 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1060000000000002e-06 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038786+0000", 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1519999999999992e-06 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038790+0000", 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4939999999999997e-06 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095616+0000", 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056825765 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095658+0000", 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.095707+0000", 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9561000000000002e-05 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44907 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2039808~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85044788499999, 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057531315, 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44907 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038845+0000", 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038846+0000", 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.03e-07 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038847+0000", 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038850+0000", 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.05e-06 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038852+0000", 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3e-06 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096270+0000", 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057418326999999998 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096318+0000", 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7239e-05 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096377+0000", 2024-09-21T22:18:47.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9064999999999998e-05 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44908 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2068480~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85043838000001, 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057776290000000001, 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44908 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038855+0000", 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038856+0000", 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038859+0000", 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.965e-06 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038866+0000", 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096448+0000", 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057582567000000001 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096528+0000", 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9776000000000003e-05 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096631+0000", 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44909 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2121728~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85042464099999, 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057906821999999997, 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.949 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44909 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038869+0000", 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1e-07 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038870+0000", 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1960000000000001e-06 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038873+0000", 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1039999999999998e-06 2024-09-21T22:18:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038875+0000", 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1770000000000001e-06 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096649+0000", 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05777376 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096707+0000", 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7856999999999998e-05 2024-09-21T22:18:47.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096775+0000", 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8517999999999997e-05 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:44910 3.16 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:1d [read 2150400~2048 [fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.85041533099999, 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058103667999999997, 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.953 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44910 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.038878+0000", 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040803+0000", 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019246490000000001 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040814+0000", 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1538e-05 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040824+0000", 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2024-09-21T22:18:47.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.040830+0000", 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2249999999999997e-06 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096798+0000", 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055968229000000001 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096876+0000", 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7323000000000005e-05 2024-09-21T22:18:47.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:33.096982+0000", 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105858 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95192 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch reconnect cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 128.990404332, 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017148028, 2024-09-21T22:18:47.957 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95192 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898889+0000", 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898891+0000", 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.68e-06 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898899+0000", 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0979999999999994e-06 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898914+0000", 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5213e-05 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.898926+0000", 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1894e-05 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899006+0000", 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9841999999999999e-05 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.899013+0000", 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.661e-06 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902164+0000", 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031508159999999999 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902175+0000", 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1221e-05 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911044+0000", 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088687489999999 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911344+0000", 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029969799999999999 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913550+0000", 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002206024 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.913669+0000", 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119349 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916037+0000", 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002367783 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95194 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:47.963 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 128.98678291100001, 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.013744424, 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95194 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:47.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902510+0000", 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902512+0000", 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902519+0000", 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8739999999999997e-06 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902531+0000", 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2306e-05 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902557+0000", 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6162000000000001e-05 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902688+0000", 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131123 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:38.902698+0000", 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0012e-05 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911517+0000", 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0088185080000001 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911553+0000", 2024-09-21T22:18:47.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6458999999999998e-05 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914085+0000", 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025319629999999999 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914175+0000", 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9464999999999998e-05 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914484+0000", 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030915700000000001 2024-09-21T22:18:47.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.915744+0000", 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00126056 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916130+0000", 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385652 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916165+0000", 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4888999999999997e-05 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916255+0000", 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9866999999999999e-05 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:95195 3.1a 3:5d2dd6ff:::rbd_header.1185af582f87:head [watch ping cookie 140355371111136 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 128.404312377, 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.431594494, 2024-09-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95195 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484981+0000", 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.82e-07 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484986+0000", 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5000000000000001e-06 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.484992+0000", 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1360000000000002e-06 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485001+0000", 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485071+0000", 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0492000000000002e-05 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.485081+0000", 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6509999999999996e-06 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911599+0000", 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.42651834 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for degraded object", 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.911628+0000", 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9218e-05 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914784+0000", 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031551109999999999 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.914856+0000", 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2228e-05 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916295+0000", 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014391059999999999 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916383+0000", 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8159999999999996e-05 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:39.916575+0000", 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000192325 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4206.0:7 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.685649436999995, 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68521989000000005, 2024-09-21T22:18:47.976 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4206", 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/1035316262", 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203644+0000", 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203646+0000", 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203651+0000", 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0139999999999998e-06 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203655+0000", 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2260000000000001e-06 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203693+0000", 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8655999999999997e-05 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.203701+0000", 2024-09-21T22:18:47.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.011e-06 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888850+0000", 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.68514881900000002 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:11.888864+0000", 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200487 3.4 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.718333669000003, 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070564014999999994, 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200487 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170960+0000", 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.170963+0000", 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5590000000000001e-06 2024-09-21T22:18:47.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178398+0000", 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074350709999999997 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178437+0000", 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026000000000002e-05 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178452+0000", 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5128e-05 2024-09-21T22:18:47.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178600+0000", 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014802700000000001 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.178942+0000", 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034162 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179139+0000", 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196672 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237616+0000", 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058477256999999998 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241380+0000", 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003763654 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241460+0000", 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0438999999999993e-05 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241524+0000", 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3561999999999999e-05 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:47.986 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:47.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:18:47.988 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-21T22:18:47.986+0000 7ff7232e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33207) UID: 0 2024-09-21T22:18:47.994 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:18:47.998 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is set 2024-09-21T22:18:48.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:18:48.093 INFO:teuthology.orchestra.run.smithi134.stdout:All operations completed A-OK! 2024-09-21T22:18:48.094 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-21T22:18:48.093+0000 7ff536a60640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 45850) UID: 0 2024-09-21T22:18:48.106 DEBUG:teuthology.parallel:result is None 2024-09-21T22:18:48.106 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-21T22:18:48.114 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-21T22:18:48.178 INFO:tasks.thrashosds:joining thrashosds 2024-09-21T22:18:48.179 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:48.179 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:48.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:18:48.323 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:48.323 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:48.323 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:48.323 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:48.323 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:48.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2346 3.0 e33/23 3:0276c258:::rbd_data.118555b0e245.0000000000000000:head v 33'7, mlcod=32'5)", 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 181.916680394, 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065387860000000004, 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.516474+0000", 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7399999999999999e-07 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517715+0000", 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001240372 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517732+0000", 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6821e-05 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517741+0000", 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1060000000000006e-06 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517811+0000", 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506999999999994e-05 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.517840+0000", 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8782e-05 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.522949+0000", 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051089999999999998 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.523013+0000", 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3924000000000007e-05 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:2364 3.0 e33/23 3:02f5e573:::rbd_data.118555b0e245.0000000000000003:head v 33'8, mlcod=32'6)", 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 181.90523395599999, 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067137739999999996, 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527921+0000", 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.527923+0000", 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0729999999999999e-06 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528417+0000", 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049397999999999998 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528433+0000", 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6061000000000001e-05 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528441+0000", 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6789999999999994e-06 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528502+0000", 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0995999999999997e-05 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.528521+0000", 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8417e-05 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534594+0000", 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060727120000000001 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:46.534634+0000", 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0856000000000003e-05 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:9323 3.9 e42/23 3:97c67b24:::rbd_data.1185acca6c1f.000000000000003a:head v 42'85, mlcod=42'83)", 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 171.35514672799999, 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054436989999999998, 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078008+0000", 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078009+0000", 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.296e-06 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078243+0000", 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233658 2024-09-21T22:18:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078258+0000", 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078266+0000", 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078324+0000", 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7673999999999997e-05 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.078348+0000", 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4026e-05 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083414+0000", 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005066447 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:57.083452+0000", 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132999999999998e-05 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:13497 3.0 e50/23 3:0473509e:::rbd_data.1185fc79843.000000000000009f:head v 50'229, mlcod=50'227)", 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 163.30005896500001, 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041759270000000003, 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133096+0000", 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133097+0000", 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.545e-06 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133305+0000", 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020783999999999999 2024-09-21T22:18:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133324+0000", 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9006000000000001e-05 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133333+0000", 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0380000000000005e-06 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133419+0000", 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5809000000000005e-05 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.133444+0000", 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5341e-05 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137219+0000", 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003774571 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:05.137272+0000", 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2777e-05 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16577 3.0 e51/23 3:06edeab1:::rbd_data.1185fc79843.0000000000000091:head v 51'237, mlcod=50'235)", 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 162.02896627600001, 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044270639999999997, 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404188+0000", 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404189+0000", 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8800000000000002e-07 2024-09-21T22:18:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404197+0000", 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.712e-06 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404210+0000", 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3626e-05 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404219+0000", 2024-09-21T22:18:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1600000000000004e-06 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404292+0000", 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2590999999999997e-05 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.404313+0000", 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1316000000000001e-05 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408581+0000", 2024-09-21T22:18:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042671790000000003 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.408615+0000", 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4792000000000002e-05 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16593 3.4 e51/23 3:2057880e:::rbd_data.1185fc79843.00000000000000a1:head v 51'57, mlcod=51'55)", 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 162.02405970199999, 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004597645, 2024-09-21T22:18:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409095+0000", 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409096+0000", 2024-09-21T22:18:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409101+0000", 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.13e-06 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409113+0000", 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2554999999999999e-05 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409120+0000", 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6209999999999998e-06 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409171+0000", 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1289000000000003e-05 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.409194+0000", 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2674999999999999e-05 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413647+0000", 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004453111 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.413692+0000", 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5596999999999997e-05 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16618 3.4 e51/23 3:2700607b:::rbd_data.1185fc79843.00000000000000c4:head v 51'58, mlcod=51'56)", 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 162.015827406, 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078997230000000009, 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417327+0000", 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417328+0000", 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417334+0000", 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417363+0000", 2024-09-21T22:18:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9907999999999999e-05 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417371+0000", 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4919999999999996e-06 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417428+0000", 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7398000000000002e-05 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.417454+0000", 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5381e-05 2024-09-21T22:18:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425172+0000", 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077184200000000001 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425227+0000", 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4725999999999997e-05 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:16625 3.9 e51/23 3:96211347:::rbd_data.1185fc79843.00000000000000cb:head v 51'93, mlcod=51'91)", 2024-09-21T22:18:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 162.013840074, 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059300710000000003, 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419314+0000", 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419315+0000", 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999995e-07 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419320+0000", 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.955e-06 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419330+0000", 2024-09-21T22:18:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7569999999999999e-06 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419335+0000", 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8330000000000001e-06 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419371+0000", 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6267999999999999e-05 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.419386+0000", 2024-09-21T22:18:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425203+0000", 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058173820000000003 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:06.425245+0000", 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1236999999999998e-05 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:38596 3.4 e67/23 3:2129282f:::rbd_data.11857b3387cc.0000000000000001:head v 67'151, mlcod=65'149)", 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 144.489986483, 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057812250000000001, 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.943168+0000", 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945313+0000", 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447969999999999 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945327+0000", 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307999999999999e-05 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945337+0000", 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945422+0000", 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5797000000000005e-05 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.945444+0000", 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1118e-05 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948903+0000", 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034594080000000002 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:23.948949+0000", 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6338000000000003e-05 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42361 3.9 e73/23 3:9453f19c:::rbd_object_map.11853a90904b.000000000000001c:head v 73'144, mlcod=73'140)", 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 138.44682487200001, 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041741130000000001, 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986330+0000", 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7999999999999995e-07 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986335+0000", 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:18:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986343+0000", 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4519999999999997e-06 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986348+0000", 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6600000000000003e-06 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986392+0000", 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.367e-05 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.986413+0000", 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990459+0000", 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040469199999999999 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.990504+0000", 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4335000000000002e-05 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:42372 3.16 e73/63 3:68ba2887:::rbd_data.11853a90904b.0000000000000000:head v 73'106, mlcod=71'104)", 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 138.44532413100001, 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042228580000000003, 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987830+0000", 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.987831+0000", 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8500000000000002e-07 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988861+0000", 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001030036 2024-09-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988873+0000", 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2631e-05 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988881+0000", 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5440000000000001e-06 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988971+0000", 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0322999999999996e-05 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.988993+0000", 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2144999999999999e-05 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992014+0000", 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030205940000000001 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:29.992053+0000", 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.93e-05 2024-09-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97246 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'418, mlcod=86'416)", 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 124.465637143, 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010193864, 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967517+0000", 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967519+0000", 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.897e-06 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967534+0000", 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4735e-05 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967562+0000", 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8228000000000001e-05 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967576+0000", 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3602e-05 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967656+0000", 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9876999999999994e-05 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.967684+0000", 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8189999999999999e-05 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977642+0000", 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099583399999999996 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.977711+0000", 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8994999999999999e-05 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97247 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'419, mlcod=86'416)", 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 124.460753067, 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063990139999999997, 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972401+0000", 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972403+0000", 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7880000000000001e-06 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972413+0000", 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105000000000001e-05 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972446+0000", 2024-09-21T22:18:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3056000000000003e-05 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972457+0000", 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972524+0000", 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6659e-05 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.972550+0000", 2024-09-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978741+0000", 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061914179999999997 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978800+0000", 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9156000000000001e-05 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97248 3.0 e86/23 3:0210426e:::rbd_object_map.11859a4b084.0000000000000020:head v 86'420, mlcod=86'416)", 2024-09-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 124.45996537000001, 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056444779999999996, 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973189+0000", 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973190+0000", 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5400000000000001e-07 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973197+0000", 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973209+0000", 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2703e-05 2024-09-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973217+0000", 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2150000000000004e-06 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973251+0000", 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4251000000000001e-05 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.973262+0000", 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1533e-05 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978804+0000", 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005541832 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.978834+0000", 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9521000000000001e-05 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:97249 3.4 e86/23 3:203f3b8d:::rbd_data.11859a4b084.000000000000000a:head v 86'186, mlcod=83'184)", 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 124.452957928, 2024-09-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009145874, 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980197+0000", 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.980198+0000", 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4470000000000001e-06 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981864+0000", 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016656220000000001 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981889+0000", 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4972000000000001e-05 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.981906+0000", 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7815000000000001e-05 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982005+0000", 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8462999999999996e-05 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.982031+0000", 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6290000000000001e-05 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989290+0000", 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007259115 2024-09-21T22:18:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:43.989342+0000", 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.215e-05 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:123983 3.4 e122/23 3:24c7b6bc:::rbd_data.1185d4b09229.0000000000000001:head v 122'381, mlcod=120'379)", 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 88.477033263999999, 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011663185, 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956121+0000", 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.956122+0000", 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2000000000000001e-07 2024-09-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958551+0000", 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024296890000000001 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958576+0000", 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4328000000000002e-05 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958585+0000", 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958651+0000", 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5777000000000004e-05 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.958675+0000", 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.338e-05 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967726+0000", 2024-09-21T22:18:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090510899999999995 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:19.967784+0000", 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860999999999998e-05 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:177005 3.9 e138/90 3:94e105f0:::rbd_object_map.11854343a755:head v 138'344, mlcod=138'340)", 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.359485965999994, 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045532130000000004, 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073669+0000", 2024-09-21T22:18:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2699999999999999e-07 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073673+0000", 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870000000000001e-06 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073680+0000", 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2019999999999998e-06 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073684+0000", 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9480000000000001e-06 2024-09-21T22:18:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073720+0000", 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5850999999999999e-05 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.073738+0000", 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8397e-05 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078182+0000", 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044436570000000002 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:38.078222+0000", 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9644000000000002e-05 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:192338 3.9 e153/90 3:91686995:::rbd_data.1185cbdbd00.0000000000000019:head v 153'371, mlcod=144'369)", 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.351371145000002, 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071372069999999996, 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081783+0000", 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.081784+0000", 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082349+0000", 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056494 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082362+0000", 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082371+0000", 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082435+0000", 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000007e-05 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.082461+0000", 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5678e-05 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088868+0000", 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064072590000000002 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:53.088921+0000", 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2417000000000003e-05 2024-09-21T22:18:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200481 3.9 e156/90 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head v 156'377, mlcod=155'375)", 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.260662099999998, 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069452704000000004, 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172492+0000", 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.172493+0000", 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.46e-07 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197250+0000", 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024756805999999999 2024-09-21T22:18:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197272+0000", 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2025999999999999e-05 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197285+0000", 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197371+0000", 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5525999999999994e-05 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.197397+0000", 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6491000000000001e-05 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241890+0000", 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044492459999999998 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241945+0000", 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5557999999999999e-05 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:200487 3.4 e156/23 3:206604cb:::rbd_data.1185b457050c.0000000000000002:head v 156'412, mlcod=154'410)", 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.253672381999998, 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057925425000000003, 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179482+0000", 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.179483+0000", 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.39e-07 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186401+0000", 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006918502 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186438+0000", 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7036000000000003e-05 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186459+0000", 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0738e-05 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186576+0000", 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011731900000000001 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.186615+0000", 2024-09-21T22:18:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8571000000000001e-05 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237335+0000", 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050720316000000001 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237408+0000", 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2503999999999996e-05 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:48.515 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:48.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:18:48.633 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:48.633 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:48.633 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:48.633 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:48.642 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:18:48.746 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:48.746 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:48.747 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:48.747 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:48.747 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:48.755 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:18:48.862 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:48.862 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:48.862 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:48.862 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:48.862 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.862 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:29849 3.14 3:2aaa555f:::rbd_data.1185b6e976dc.0000000000000006:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.66088469100001, 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023309987000000001, 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.863 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 29849 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.864 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198444+0000", 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198445+0000", 2024-09-21T22:18:48.865 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3099999999999997e-07 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198458+0000", 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2697999999999999e-05 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198468+0000", 2024-09-21T22:18:48.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0789e-05 2024-09-21T22:18:48.867 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.867 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.867 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.867 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198474+0000", 2024-09-21T22:18:48.867 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2020000000000003e-06 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198527+0000", 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3442000000000001e-05 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.868 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.198611+0000", 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4493000000000006e-05 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.203257+0000", 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0046451599999999997 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221649+0000", 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018392131999999999 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221666+0000", 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6993000000000001e-05 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221714+0000", 2024-09-21T22:18:48.870 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8208999999999999e-05 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221754+0000", 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0138000000000001e-05 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:29848 3.1c e59/23 3:3a62af9d:::rbd_data.1185b6e976dc.0000000000000005:head v 59'148, mlcod=59'146)", 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 153.65900880999999, 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021327828, 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200320+0000", 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200321+0000", 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.015e-06 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200342+0000", 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1409000000000001e-05 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200355+0000", 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2574e-05 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200363+0000", 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9109999999999993e-06 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200403+0000", 2024-09-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0552000000000001e-05 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.200419+0000", 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221609+0000", 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021190628 2024-09-21T22:18:48.876 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:15.221648+0000", 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8630000000000001e-05 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:97394 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 120.895683463, 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99456635999999998, 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 97394 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963645+0000", 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963647+0000", 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6360000000000001e-06 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963653+0000", 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0419999999999999e-06 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963666+0000", 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.323e-05 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963673+0000", 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6579999999999996e-06 2024-09-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963733+0000", 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0232000000000002e-05 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:47.963748+0000", 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4440999999999999e-05 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.957821+0000", 2024-09-21T22:18:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.99407293900000004 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958068+0000", 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024749499999999997 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:48.958212+0000", 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014368700000000001 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107710 3.14 3:298d59bb:::rbd_data.1185d88202be.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 107.043357671, 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.029161078, 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107710 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815971+0000", 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815972+0000", 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2e-07 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815975+0000", 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9660000000000001e-06 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815982+0000", 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1389999999999998e-06 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.815986+0000", 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4610000000000001e-06 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.886 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816029+0000", 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3092e-05 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.816111+0000", 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1586000000000001e-05 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.887 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 7", 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.821114+0000", 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050029269999999999 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844917+0000", 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023803120000000001 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.844979+0000", 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1556999999999994e-05 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845051+0000", 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2581000000000002e-05 2024-09-21T22:18:48.889 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:01.845132+0000", 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.890 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:107884 3.3 3:c6e8ee1c:::rbd_data.1185d88202be.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 106.767821056, 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021902583, 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 107884 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.891 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091508+0000", 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091510+0000", 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8959999999999999e-06 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.892 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091521+0000", 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.145e-05 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091555+0000", 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.379e-05 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091569+0000", 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3752e-05 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.893 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091682+0000", 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00011372200000000001 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.091821+0000", 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013819700000000001 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.095484+0000", 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003663515 2024-09-21T22:18:48.894 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113322+0000", 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017838000999999999 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113334+0000", 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2204999999999999e-05 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113371+0000", 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6619999999999998e-05 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.895 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:02.113410+0000", 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9434999999999998e-05 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:187775 3.1c 3:3cbed516:::rbd_data.1185235ecb6e.0000000000000009:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 61.436165412999998, 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028118744000000001, 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.896 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 187775 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.897 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423163+0000", 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423165+0000", 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2359999999999999e-06 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423171+0000", 2024-09-21T22:18:48.898 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5649999999999998e-06 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423185+0000", 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4018e-05 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423192+0000", 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4679999999999997e-06 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.899 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423244+0000", 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2476999999999999e-05 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.423301+0000", 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7290999999999997e-05 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.428352+0000", 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0050503980000000002 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451177+0000", 2024-09-21T22:18:48.900 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022825168 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451192+0000", 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5279000000000001e-05 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451229+0000", 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6684000000000003e-05 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.901 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:47.451282+0000", 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3159999999999999e-05 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190914 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 188416~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.931262631000003, 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014404689, 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.902 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190914 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928066+0000", 2024-09-21T22:18:48.903 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928067+0000", 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2e-07 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928069+0000", 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6929999999999999e-06 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.904 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928077+0000", 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4159999999999998e-06 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928082+0000", 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4720000000000003e-06 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942159+0000", 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014076643999999999 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942243+0000", 2024-09-21T22:18:48.905 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4141000000000006e-05 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942471+0000", 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000227903 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190915 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 335872~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.931237310999997, 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017603790000000001, 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.906 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190915 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:48.907 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928092+0000", 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1800000000000005e-07 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928095+0000", 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0639999999999998e-06 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928110+0000", 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4248e-05 2024-09-21T22:18:48.908 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928118+0000", 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0290000000000005e-06 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942504+0000", 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014386362999999999 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.942585+0000", 2024-09-21T22:18:48.909 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.0729999999999994e-05 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945695+0000", 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0031106380000000002 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190916 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 401408~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.931202782, 2024-09-21T22:18:48.910 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017894884999999999, 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190916 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.911 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928126+0000", 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928127+0000", 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928138+0000", 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1043000000000001e-05 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.912 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928153+0000", 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5437000000000001e-05 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928160+0000", 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6270000000000002e-06 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945745+0000", 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017585588999999999 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.945817+0000", 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2294999999999998e-05 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946021+0000", 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000203434 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.914 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190917 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 483328~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.931159223000002, 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020072329, 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190917 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.915 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928170+0000", 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2900000000000003e-07 2024-09-21T22:18:48.916 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928173+0000", 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0869999999999998e-06 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928181+0000", 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1300000000000001e-06 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928188+0000", 2024-09-21T22:18:48.917 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3520000000000003e-06 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946058+0000", 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017870370999999999 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.946150+0000", 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.1811000000000006e-05 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.918 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948242+0000", 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0020919490000000001 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190918 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 548864~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.931133760999998, 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020445840999999999, 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.919 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.920 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.920 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190918 2024-09-21T22:18:48.921 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.921 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928195+0000", 2024-09-21T22:18:48.922 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928198+0000", 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928205+0000", 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7000000000000002e-06 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928208+0000", 2024-09-21T22:18:48.923 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0489999999999999e-06 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948283+0000", 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02007519 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948369+0000", 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5935999999999998e-05 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948641+0000", 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027197000000000001 2024-09-21T22:18:48.924 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:190919 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 630784~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.931116553999999, 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020737907999999999, 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 190919 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.925 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928212+0000", 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928213+0000", 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:18:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928214+0000", 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.533e-06 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928218+0000", 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.737e-06 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.928222+0000", 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7919999999999999e-06 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.927 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948681+0000", 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.020459367999999999 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948739+0000", 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7833e-05 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.948950+0000", 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000211387 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.928 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191582 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 983040~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.861048470999997, 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014510238999999999, 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191582 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.929 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998280+0000", 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998281+0000", 2024-09-21T22:18:48.930 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998287+0000", 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.19e-06 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998293+0000", 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1410000000000002e-06 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998298+0000", 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5800000000000002e-06 2024-09-21T22:18:48.931 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012546+0000", 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014248728 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012608+0000", 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1509999999999999e-05 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012791+0000", 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00018269299999999999 2024-09-21T22:18:48.932 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191583 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1048576~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.861025089000002, 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014843303, 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.933 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191583 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.934 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998304+0000", 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.77e-07 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998306+0000", 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.148e-06 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998312+0000", 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1909999999999997e-06 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.935 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998317+0000", 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6330000000000004e-06 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012838+0000", 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014521035999999999 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.012929+0000", 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0585000000000001e-05 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013147+0000", 2024-09-21T22:18:48.936 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000218333 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191584 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1130496~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.861005319, 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015064866999999999, 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.937 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191584 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:48.938 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998324+0000", 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998326+0000", 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.995e-06 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.939 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998332+0000", 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1510000000000001e-06 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998337+0000", 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013173+0000", 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.014836146 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.940 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013219+0000", 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6211000000000002e-05 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013388+0000", 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000169483 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191585 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1196032~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.860986382999997, 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015365118000000001, 2024-09-21T22:18:48.941 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191585 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.942 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998342+0000", 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998343+0000", 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998345+0000", 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0040000000000002e-06 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.943 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998352+0000", 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998356+0000", 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5070000000000002e-06 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013421+0000", 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015065241 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.944 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013471+0000", 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9759000000000003e-05 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013708+0000", 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00023630999999999999 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:191586 3.1d 3:bb289bfa:::rbd_data.1185c5009733.0000000000000004:41 [read 1277952~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 55.860966439999999, 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015481798999999999, 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 191586 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998362+0000", 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998363+0000", 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8700000000000001e-07 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998365+0000", 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998373+0000", 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4660000000000002e-06 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:52.998378+0000", 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0649999999999998e-06 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.948 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013737+0000", 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015359101999999999 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013779+0000", 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2209999999999997e-05 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:53.013844+0000", 2024-09-21T22:18:48.949 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5147999999999994e-05 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200481 3.9 3:9667c384:::rbd_data.1185b457050c.0000000000000001:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 25198592~49152,zero 25280512~49152,zero 25362432~49152,zero 25444352~49152,zero 25526272~49152,zero 25608192~49152,zero 25690112~49152,zero 25772032~49152,zero 25853952~49152,zero 25935872~49152,zero 26017792~4991,write 26022783~41245 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.715626882000002, 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.098439029999999997, 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200481 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.951 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143702+0000", 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.143704+0000", 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.905e-06 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170819+0000", 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027115341000000001 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.952 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170849+0000", 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9683e-05 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170863+0000", 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3726e-05 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170946+0000", 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3282000000000007e-05 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.953 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.171080+0000", 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000134277 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 2", 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.172131+0000", 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001050924 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.190502+0000", 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018370633000000001 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242065+0000", 2024-09-21T22:18:48.954 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.051563645999999998 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242109+0000", 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3170000000000002e-05 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.242141+0000", 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2443000000000001e-05 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.955 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200488 3.1c 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.688420346000001, 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070823231, 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200488 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.956 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170908+0000", 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170910+0000", 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5319999999999999e-06 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.957 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187537+0000", 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016627152999999999 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187551+0000", 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.379e-05 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187560+0000", 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6670000000000002e-06 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187627+0000", 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7727999999999999e-05 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187755+0000", 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000127611 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 5", 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187861+0000", 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010563 2024-09-21T22:18:48.959 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241462+0000", 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053601647000000002 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241620+0000", 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00015777599999999999 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241684+0000", 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.3508000000000002e-05 2024-09-21T22:18:48.960 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241732+0000", 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8189000000000002e-05 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200486 3.e e156/87 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head v 156'280, mlcod=154'278)", 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 52.672053509999998, 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.054025460999999997, 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:48.961 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187275+0000", 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:48.962 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187276+0000", 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1899999999999999e-07 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194919+0000", 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0076438720000000003 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194942+0000", 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2898999999999999e-05 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194958+0000", 2024-09-21T22:18:48.963 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5353999999999999e-05 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106104 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195097+0000", 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3559999999999997e-05 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241243+0000", 2024-09-21T22:18:48.964 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046145822000000003 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241301+0000", 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7630999999999998e-05 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:48.965 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:48.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:18:49.000 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:18:49.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:18:49.071 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:49.071 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:49.071 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:49.071 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:49.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:18:49.184 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:49.184 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:49.184 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:49.184 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:49.185 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:49.193 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:18:49.298 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:49.298 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:49.298 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:49.298 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:49.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.298 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12172 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1654784~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.348971965, 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041050630999999997, 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12172 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.299 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947379+0000", 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.300 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947381+0000", 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947388+0000", 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947392+0000", 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.51e-06 2024-09-21T22:18:49.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988060+0000", 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.040667547999999998 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988150+0000", 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0270000000000001e-05 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.302 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988429+0000", 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027940099999999998 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12173 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1736704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.348952602, 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041395449000000001, 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.303 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12173 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947398+0000", 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.304 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947399+0000", 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947402+0000", 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2619999999999999e-06 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947409+0000", 2024-09-21T22:18:49.305 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.007e-06 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947423+0000", 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4133e-05 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988456+0000", 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041032796000000003 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988538+0000", 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2045000000000005e-05 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988794+0000", 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025581600000000002 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12174 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1818624~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.348919954, 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041673541000000001, 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12174 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947431+0000", 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947439+0000", 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5089999999999993e-06 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947442+0000", 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7999999999999999e-06 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947461+0000", 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8516999999999999e-05 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947466+0000", 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988833+0000", 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041366319999999998 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.988884+0000", 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1208999999999997e-05 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989104+0000", 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00022065299999999999 2024-09-21T22:18:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12197 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1081344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.34886878699999, 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042045794999999997, 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12197 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947482+0000", 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947483+0000", 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4000000000000001e-07 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947485+0000", 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7810000000000001e-06 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947493+0000", 2024-09-21T22:18:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9899999999999997e-06 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947500+0000", 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.844e-06 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989144+0000", 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.041643883999999999 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989231+0000", 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.6466999999999997e-05 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989528+0000", 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000297189 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12198 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1163264~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.348842115, 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042413525000000001, 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12198 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947509+0000", 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947511+0000", 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1509999999999998e-06 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947519+0000", 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9789999999999993e-06 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947526+0000", 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.297e-06 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.319 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989561+0000", 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042035718 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989647+0000", 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5364000000000005e-05 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989922+0000", 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027555400000000001 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12199 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1245184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.34881731600001, 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042777020999999998, 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12199 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.321 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947533+0000", 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947534+0000", 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.322 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947536+0000", 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9099999999999999e-06 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947544+0000", 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8890000000000002e-06 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947556+0000", 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2299e-05 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.323 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.989966+0000", 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042409932999999997 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990058+0000", 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2421000000000002e-05 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990310+0000", 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00025220599999999999 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12200 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1376256~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.34878636799999, 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043089702000000001, 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12200 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.325 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947564+0000", 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947565+0000", 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.326 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947567+0000", 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3659999999999999e-06 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947575+0000", 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6750000000000002e-06 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947580+0000", 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.169e-06 2024-09-21T22:18:49.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990345+0000", 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.042764901000000001 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990392+0000", 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7070999999999997e-05 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990654+0000", 2024-09-21T22:18:49.328 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00026204100000000002 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12201 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1458176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.34876215, 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429534999999998, 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.329 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12201 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947589+0000", 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.46e-07 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947591+0000", 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0150000000000002e-06 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.331 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947599+0000", 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2209999999999997e-06 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947606+0000", 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1809999999999998e-06 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990690+0000", 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043084448999999997 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.332 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.990741+0000", 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0729999999999997e-05 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991018+0000", 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00027749300000000002 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12202 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1540096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.333 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.348737798, 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043821381999999999, 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12202 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.334 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947613+0000", 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947614+0000", 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0900000000000002e-07 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.335 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947616+0000", 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947624+0000", 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6129999999999998e-06 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947630+0000", 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4699999999999999e-06 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.336 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991060+0000", 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043429936000000002 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991114+0000", 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4014999999999997e-05 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991434+0000", 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032037899999999998 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.337 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12203 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1589248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.34871355499999, 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044286947, 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12203 2024-09-21T22:18:49.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947637+0000", 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947638+0000", 2024-09-21T22:18:49.339 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947640+0000", 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8929999999999999e-06 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947646+0000", 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947661+0000", 2024-09-21T22:18:49.340 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4361e-05 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991495+0000", 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.043833921999999997 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991601+0000", 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000106718 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991924+0000", 2024-09-21T22:18:49.341 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00032280200000000002 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12204 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.34868381999999, 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044632787, 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.342 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12204 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.343 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947667+0000", 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.15e-07 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947669+0000", 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8840000000000001e-06 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947683+0000", 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3579e-05 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.344 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947694+0000", 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1430999999999999e-05 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.991958+0000", 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044264034000000001 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992018+0000", 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9985999999999998e-05 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.345 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992300+0000", 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000281458 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:12205 3.1c 3:3ddcd778:::rbd_data.11854f79dd7.0000000000000000:d [read 1753088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 164.34864834999999, 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044959170999999999, 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.346 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 12205 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947702+0000", 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947703+0000", 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947705+0000", 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.871e-06 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947718+0000", 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.274e-05 2024-09-21T22:18:49.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.947723+0000", 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5960000000000003e-06 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992331+0000", 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.044607516 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992381+0000", 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0739999999999999e-05 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:04.992662+0000", 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00028015599999999999 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.311117145, 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.92012185700000004, 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.350 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985234+0000", 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2500000000000005e-07 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985774+0000", 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00053949399999999995 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.352 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985785+0000", 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0851e-05 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985790+0000", 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9490000000000004e-06 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985858+0000", 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8666999999999998e-05 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:33.985868+0000", 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0200000000000001e-05 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905343+0000", 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.91947498299999997 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905356+0000", 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2088e-05 2024-09-21T22:18:49.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.118249486, 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72739245200000002, 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.355 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178101+0000", 2024-09-21T22:18:49.356 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178102+0000", 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6300000000000004e-07 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178708+0000", 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060567499999999996 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.357 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178715+0000", 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5700000000000004e-06 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.178722+0000", 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181797+0000", 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0030749950000000001 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.181805+0000", 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5650000000000002e-06 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905480+0000", 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72367446499999999 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905494+0000", 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3849000000000001e-05 2024-09-21T22:18:49.359 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.11288295400001, 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.72206761799999997, 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183468+0000", 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.183469+0000", 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0100000000000004e-07 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184162+0000", 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00069311500000000001 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184169+0000", 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:18:49.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.184174+0000", 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186886+0000", 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0027123830000000001 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.186894+0000", 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3459999999999994e-06 2024-09-21T22:18:49.363 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905528+0000", 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.71863398300000003 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905535+0000", 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1040000000000001e-06 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.364 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.09531816099999, 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70452237699999998, 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.365 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201033+0000", 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201646+0000", 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061251999999999997 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201654+0000", 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8159999999999994e-06 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.201659+0000", 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.899e-06 2024-09-21T22:18:49.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205507+0000", 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00384856 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.205512+0000", 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905547+0000", 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.70003539400000003 2024-09-21T22:18:49.368 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905555+0000", 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3.85b9e92d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.06293716799999, 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.67221228799999999, 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.369 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.370 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.233414+0000", 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.9599999999999999e-07 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234037+0000", 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00062244100000000005 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234044+0000", 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4410000000000004e-06 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.234049+0000", 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8489999999999997e-06 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238401+0000", 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0043514469999999996 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.372 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.238409+0000", 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8109999999999992e-06 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905620+0000", 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.66721067099999998 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905626+0000", 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9320000000000001e-06 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.373 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:52492 3.d 3:b4979da1:::rbd_data.1185af582f87.000000000000001d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e77)", 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 135.015133722, 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62666303899999998, 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 52492 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281217+0000", 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.375 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281218+0000", 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2900000000000002e-07 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281829+0000", 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00061102499999999996 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281838+0000", 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.9299999999999992e-06 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281844+0000", 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281894+0000", 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9534999999999999e-05 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.281898+0000", 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7820000000000001e-06 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.377 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905641+0000", 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.62374247500000002 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905767+0000", 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012586800000000001 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0,6", 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.905866+0000", 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9407000000000006e-05 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.378 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.906942+0000", 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0010757329999999999 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907442+0000", 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000500123 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907761+0000", 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00031940199999999999 2024-09-21T22:18:49.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907804+0000", 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2802000000000001e-05 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:34.907880+0000", 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5834000000000006e-05 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.380 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200488 3.1c e156/101 3:3ceb0b5b:::rbd_data.1185b457050c.0000000000000004:head v 156'679, mlcod=154'677)", 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.108316401000003, 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.053308873, 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.381 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188034+0000", 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.188035+0000", 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194865+0000", 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0068307749999999999 2024-09-21T22:18:49.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194937+0000", 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1907000000000001e-05 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.194959+0000", 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1931000000000001e-05 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195064+0000", 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000104546 2024-09-21T22:18:49.383 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195098+0000", 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3738000000000001e-05 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241216+0000", 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046118815000000001 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241343+0000", 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00012692700000000001 2024-09-21T22:18:49.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_repop(client.4485.0:200491 3.1f e156/23 3:fb71b694:::rbd_data.1185b457050c.0000000000000006:head v 156'1146, mlcod=154'1144)", 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.101233768999997, 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.046457489999999997, 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.385 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195117+0000", 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.195119+0000", 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9599999999999999e-06 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.386 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203969+0000", 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0088495880000000002 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.203988+0000", 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9485999999999999e-05 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204001+0000", 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2894999999999999e-05 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.387 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204073+0000", 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1983000000000005e-05 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.204094+0000", 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0990000000000001e-05 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241527+0000", 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.037433449000000001 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.388 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241575+0000", 2024-09-21T22:18:49.389 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7138999999999997e-05 2024-09-21T22:18:49.389 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.389 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.389 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.389 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.389 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.389 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:49.390 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:18:49.495 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:49.495 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:49.495 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:49.495 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:49.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:18:49.609 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:49.609 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:49.609 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:49.609 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:49.609 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:49.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:18:49.723 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:8815 3.10 3:08318639:::rbd_data.1185acca6c1f.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:18:49.723 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 173.20970583600001, 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019834496, 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 8815 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511415+0000", 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511416+0000", 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.373e-06 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511424+0000", 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8909999999999995e-06 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.725 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511440+0000", 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5835999999999999e-05 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511452+0000", 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2724999999999999e-05 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511517+0000", 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4461999999999994e-05 2024-09-21T22:18:49.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.511609+0000", 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.2126000000000005e-05 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.515576+0000", 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0039669589999999999 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531144+0000", 2024-09-21T22:18:49.727 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015567862999999999 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531156+0000", 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1693e-05 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531191+0000", 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4956000000000002e-05 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:15:56.531249+0000", 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8612000000000001e-05 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.728 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 168.80676353300001, 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.012038845, 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11583 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.729 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914357+0000", 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914359+0000", 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:18:49.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914366+0000", 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914382+0000", 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6133e-05 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.731 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914395+0000", 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2891000000000001e-05 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914482+0000", 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.7231999999999994e-05 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op must wait for map", 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914492+0000", 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0030000000000001e-05 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.732 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918199+0000", 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0037068180000000002 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918207+0000", 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9130000000000003e-06 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924633+0000", 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.006426327 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.733 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.924876+0000", 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00024261500000000001 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 3", 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925247+0000", 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00037101300000000001 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925846+0000", 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00059977499999999998 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.734 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926204+0000", 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00035754200000000003 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926265+0000", 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1526999999999996e-05 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926396+0000", 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000130388 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.735 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:11585 3.1e 3:7a00f061:::rbd_header.11854f79dd7:head [watch reconnect cookie 140355370774464 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 168.806700678, 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.013170331, 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 11585 2024-09-21T22:18:49.736 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914420+0000", 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914421+0000", 2024-09-21T22:18:49.737 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.3399999999999998e-07 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914425+0000", 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0080000000000004e-06 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914434+0000", 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.3500000000000003e-06 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.738 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914441+0000", 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7190000000000004e-06 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914571+0000", 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013016199999999999 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting_for_map not empty", 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.914578+0000", 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6539999999999999e-06 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.739 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918288+0000", 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.003709431 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:00.918298+0000", 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.9329999999999996e-06 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925706+0000", 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.007408181 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.740 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for rw locks", 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.925818+0000", 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000111698 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926424+0000", 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00060587200000000003 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.926521+0000", 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.7732999999999994e-05 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.741 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:01.927590+0000", 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001068856 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178579 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 458752~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679937839000004, 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016200811999999998, 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.742 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178579 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.743 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041183+0000", 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041185+0000", 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.08e-06 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.744 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041190+0000", 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041193+0000", 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.0319999999999999e-06 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.056950+0000", 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015756883999999999 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.745 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057000+0000", 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9651999999999998e-05 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057383+0000", 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000383872 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178580 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1376256~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.746 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679902748000003, 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016655463999999998, 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178580 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041218+0000", 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.5199999999999998e-07 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041220+0000", 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041224+0000", 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5369999999999999e-06 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041227+0000", 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.044e-06 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.749 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057412+0000", 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016184955000000001 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057481+0000", 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8596000000000005e-05 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057873+0000", 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00039217400000000002 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.750 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178581 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2293760~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679888309000006, 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017148084000000001, 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178581 2024-09-21T22:18:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041232+0000", 2024-09-21T22:18:49.752 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.41e-07 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041234+0000", 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.229e-06 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041237+0000", 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1429999999999998e-06 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.753 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041239+0000", 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4710000000000001e-06 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.057922+0000", 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016682847000000001 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058000+0000", 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7574e-05 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.754 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058380+0000", 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038057899999999998 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178582 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3211264~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679873650000005, 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017717362, 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.755 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178582 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.756 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041247+0000", 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.23e-07 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041248+0000", 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.3629999999999999e-06 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.757 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041252+0000", 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.4079999999999998e-06 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041254+0000", 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6570000000000001e-06 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058426+0000", 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017171565 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058531+0000", 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00010515500000000001 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058964+0000", 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043299099999999997 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.759 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178583 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 524288~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679860606999995, 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018177519999999999, 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178583 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:49.760 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041260+0000", 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041267+0000", 2024-09-21T22:18:49.761 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0779999999999998e-06 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041271+0000", 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7170000000000002e-06 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041274+0000", 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6579999999999998e-06 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.762 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.058999+0000", 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017725144000000002 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059053+0000", 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4020000000000001e-05 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059437+0000", 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00038466999999999999 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.763 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178584 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1441792~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679837117999995, 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018810679, 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178584 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.764 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041283+0000", 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041284+0000", 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.67e-07 2024-09-21T22:18:49.765 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041285+0000", 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.6640000000000001e-06 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041290+0000", 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.668e-06 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041293+0000", 2024-09-21T22:18:49.766 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7209999999999999e-06 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059486+0000", 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.018193755999999998 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.059630+0000", 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00014355699999999999 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060094+0000", 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00046404600000000002 2024-09-21T22:18:49.767 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178585 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2359296~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679823979999995, 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019281118, 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.768 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178585 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041296+0000", 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.769 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041297+0000", 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.34e-07 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041298+0000", 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2049999999999999e-06 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041301+0000", 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1860000000000001e-06 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.770 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041303+0000", 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3379999999999999e-06 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060135+0000", 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.01883139 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060209+0000", 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.4474999999999994e-05 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060578+0000", 2024-09-21T22:18:49.771 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00036829000000000001 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178586 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3276800~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679813844999998, 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021968970000000001, 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.772 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178586 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041307+0000", 2024-09-21T22:18:49.773 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.17e-07 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041308+0000", 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.192e-06 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041311+0000", 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1379999999999999e-06 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041314+0000", 2024-09-21T22:18:49.774 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.712e-06 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060614+0000", 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.019300287999999999 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.060660+0000", 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5411999999999998e-05 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063276+0000", 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0026160110000000001 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.775 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178587 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 589824~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679713323000001, 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022396137999999999, 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178587 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041407+0000", 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041408+0000", 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041410+0000", 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.216e-06 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041414+0000", 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4819999999999996e-06 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041418+0000", 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.162e-06 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.778 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063314+0000", 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.021896374999999999 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063370+0000", 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6146000000000001e-05 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063803+0000", 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00043324200000000002 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.779 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178588 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 1507328~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679695530000004, 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022915337000000001, 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178588 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.780 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041425+0000", 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2700000000000001e-07 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.781 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041429+0000", 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.206e-06 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041436+0000", 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.024e-06 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041440+0000", 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0840000000000002e-06 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.782 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063842+0000", 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022401655999999999 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.063924+0000", 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.1717000000000004e-05 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064340+0000", 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00041642300000000002 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.783 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178589 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 2424832~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679675009999997, 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023452173999999999, 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178589 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041445+0000", 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041452+0000", 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.708e-06 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.785 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041454+0000", 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.592e-06 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041459+0000", 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0209999999999999e-06 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041462+0000", 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7970000000000001e-06 2024-09-21T22:18:49.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064372+0000", 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022910248000000001 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064454+0000", 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.2176999999999996e-05 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064898+0000", 2024-09-21T22:18:49.787 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00044363099999999999 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178590 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3342336~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.679653009000006, 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023920075999999998, 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.788 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178590 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041467+0000", 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.789 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041468+0000", 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6e-07 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041469+0000", 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041473+0000", 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.25e-06 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.790 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.041480+0000", 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.5060000000000001e-06 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064934+0000", 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.023453743999999999 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.064998+0000", 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4553000000000003e-05 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065388+0000", 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000389353 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178595 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.671679080999994, 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.016145494, 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.792 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178595 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049441+0000", 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049442+0000", 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.5000000000000001e-07 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049451+0000", 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049470+0000", 2024-09-21T22:18:49.794 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.9298000000000001e-05 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.049478+0000", 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.089e-06 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065422+0000", 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015943867 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065498+0000", 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6030000000000002e-05 2024-09-21T22:18:49.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.065587+0000", 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8948000000000003e-05 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178646 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3801088~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.654276770999999, 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017281662, 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.796 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178646 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.797 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066844+0000", 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066845+0000", 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.4799999999999997e-07 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066849+0000", 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.605e-06 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066861+0000", 2024-09-21T22:18:49.798 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1728e-05 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066868+0000", 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082574+0000", 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015706194 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.082665+0000", 2024-09-21T22:18:49.799 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0290000000000005e-05 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084125+0000", 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0014607120000000001 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178650 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:3b [sparse-read 3866624~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.654134674000005, 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017705882999999999, 2024-09-21T22:18:49.800 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178650 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.801 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066986+0000", 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066987+0000", 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.0100000000000003e-07 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.066992+0000", 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0030000000000002e-06 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067002+0000", 2024-09-21T22:18:49.802 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.0599e-05 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067009+0000", 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.6780000000000003e-06 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084163+0000", 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017153561000000001 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084241+0000", 2024-09-21T22:18:49.803 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.8427e-05 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084692+0000", 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00045071400000000001 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:178654 3.10 3:0ada403c:::rbd_data.1185bfc0be28.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e143)", 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 66.653738789000002, 2024-09-21T22:18:49.804 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017492983, 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 178654 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067382+0000", 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067383+0000", 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8899999999999998e-07 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067388+0000", 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4500000000000003e-06 2024-09-21T22:18:49.806 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067400+0000", 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1866e-05 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.067407+0000", 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.1289999999999998e-06 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084736+0000", 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.017329315000000001 2024-09-21T22:18:49.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084787+0000", 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0216000000000002e-05 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:43.084875+0000", 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.8117999999999999e-05 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:212530 3.15 3.b8de775 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e188)", 2024-09-21T22:18:49.808 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 20.569088175000001, 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.88748263100000002, 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "reached pg", 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 212530 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152032+0000", 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152033+0000", 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4799999999999998e-07 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152037+0000", 2024-09-21T22:18:49.810 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.6030000000000001e-06 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152044+0000", 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.5399999999999998e-06 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152049+0000", 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152089+0000", 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0169000000000001e-05 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for peered", 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:29.152095+0000", 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9000000000000003e-06 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:30.039503+0000", 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.887408325 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:30.039515+0000", 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1433999999999999e-05 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.812 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.813 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:49.813 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:49.813 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:49.814 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:18:49.917 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:49.917 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:49.918 INFO:teuthology.orchestra.run.smithi149.stdout: "num_ops": 0 2024-09-21T22:18:49.918 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:49.926 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:18:49.998 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:18:50.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:18:50.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:18:50.033 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:50.033 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [], 2024-09-21T22:18:50.033 INFO:teuthology.orchestra.run.smithi149.stdout: "complaint_time": 30, 2024-09-21T22:18:50.033 INFO:teuthology.orchestra.run.smithi149.stdout: "num_blocked_ops": 0 2024-09-21T22:18:50.033 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:50.042 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:18:50.147 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T22:18:50.147 INFO:teuthology.orchestra.run.smithi149.stdout: "size": 20, 2024-09-21T22:18:50.147 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 600, 2024-09-21T22:18:50.147 INFO:teuthology.orchestra.run.smithi149.stdout: "ops": [ 2024-09-21T22:18:50.147 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.147 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64126 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1603584~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.745489429, 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026643908000000001, 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64126 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.148 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400101+0000", 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400102+0000", 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.149 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400104+0000", 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400108+0000", 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0090000000000001e-06 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400111+0000", 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8430000000000001e-06 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.150 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426635+0000", 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026524505 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426684+0000", 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8628000000000003e-05 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426745+0000", 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1322999999999995e-05 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64127 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1632256~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74544255199999, 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026779404999999999, 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64127 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.152 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400148+0000", 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400149+0000", 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.153 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400151+0000", 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2809999999999998e-06 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400157+0000", 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.2750000000000001e-06 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400161+0000", 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7459999999999998e-06 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.154 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426778+0000", 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026616474000000001 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426857+0000", 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.9793e-05 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426928+0000", 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.0277999999999994e-05 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64128 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1660928~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74537781199999, 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026836035000000001, 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64128 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400213+0000", 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.157 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400216+0000", 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.4600000000000002e-06 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400221+0000", 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.9409999999999998e-06 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400224+0000", 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9220000000000001e-06 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.158 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426948+0000", 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026724349000000001 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.426995+0000", 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6471999999999998e-05 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427049+0000", 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4481000000000002e-05 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64129 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1689600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.745341583, 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026961882, 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64129 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.160 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400249+0000", 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400250+0000", 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.161 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400252+0000", 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.255e-06 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400257+0000", 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400260+0000", 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.2669999999999998e-06 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.162 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427079+0000", 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026819167000000001 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427151+0000", 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.2119999999999994e-05 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427211+0000", 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9760999999999999e-05 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64130 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1718272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.745247656, 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026998234999999999, 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64130 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.164 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400343+0000", 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400344+0000", 2024-09-21T22:18:50.165 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6199999999999998e-07 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400346+0000", 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0480000000000001e-06 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400350+0000", 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7219999999999999e-06 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.166 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400353+0000", 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9809999999999999e-06 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427240+0000", 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026886063000000002 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427282+0000", 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2549999999999997e-05 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.167 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427341+0000", 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.9409e-05 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64131 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1746944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.745223888, 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027138153000000002, 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64131 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.169 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400367+0000", 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400370+0000", 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:18:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400374+0000", 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9509999999999999e-06 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400376+0000", 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7250000000000002e-06 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427373+0000", 2024-09-21T22:18:50.171 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.026996292000000002 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427437+0000", 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4472000000000002e-05 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427505+0000", 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.8141999999999999e-05 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.172 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64132 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1775616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74515901699999, 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027206457999999999, 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64132 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.173 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400432+0000", 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.174 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400434+0000", 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400438+0000", 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7850000000000002e-06 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400441+0000", 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6989999999999999e-06 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427534+0000", 2024-09-21T22:18:50.175 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027093261 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427581+0000", 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7311000000000002e-05 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427638+0000", 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6968000000000001e-05 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.176 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64133 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1804288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74512139399999, 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027295772999999999, 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64133 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:50.177 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400470+0000", 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400472+0000", 2024-09-21T22:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400478+0000", 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8340000000000004e-06 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400481+0000", 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3210000000000001e-06 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427664+0000", 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027182599000000002 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427708+0000", 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.4722000000000003e-05 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427765+0000", 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7040999999999998e-05 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.180 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64134 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1832960~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74508060100001, 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027380213, 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64134 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.181 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400510+0000", 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400511+0000", 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400513+0000", 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.193e-06 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400517+0000", 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0119999999999999e-06 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400520+0000", 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7159999999999999e-06 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.183 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427793+0000", 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027273483000000001 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427836+0000", 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3339e-05 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427891+0000", 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4088000000000001e-05 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.184 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64135 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1861632~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74500513999999, 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027429324000000001, 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64135 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.185 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400586+0000", 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.186 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400588+0000", 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2129999999999998e-06 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400598+0000", 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 9.662e-06 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400603+0000", 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.259e-06 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.187 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427914+0000", 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027310600000000001 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.427958+0000", 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3637000000000003e-05 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428015+0000", 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.7433999999999999e-05 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64136 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1890304~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74493476699999, 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027482586999999999, 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64136 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.189 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400656+0000", 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400657+0000", 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:50.190 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400659+0000", 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.187e-06 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400663+0000", 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1230000000000002e-06 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400666+0000", 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.7369999999999998e-06 2024-09-21T22:18:50.191 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428043+0000", 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027377094000000001 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428083+0000", 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.0750000000000001e-05 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428139+0000", 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5297000000000003e-05 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.192 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64137 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1918976~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74490109199999, 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027574189999999998, 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.193 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64137 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.194 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400690+0000", 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2499999999999995e-07 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400693+0000", 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.3140000000000002e-06 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400697+0000", 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400700+0000", 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.9780000000000001e-06 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428162+0000", 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.02746175 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428206+0000", 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3917e-05 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428264+0000", 2024-09-21T22:18:50.196 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8041999999999998e-05 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64138 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1947648~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74483233999999, 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027658742, 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.197 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64138 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.198 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400759+0000", 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400761+0000", 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.142e-06 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400765+0000", 2024-09-21T22:18:50.199 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9029999999999997e-06 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400769+0000", 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.7749999999999999e-06 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428281+0000", 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027511785 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428334+0000", 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.3263000000000001e-05 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428417+0000", 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 8.3418999999999995e-05 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64139 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 1976320~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.744787944, 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027754369000000001, 2024-09-21T22:18:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64139 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.202 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400803+0000", 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400804+0000", 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.5799999999999999e-07 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400806+0000", 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400810+0000", 2024-09-21T22:18:50.203 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400813+0000", 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1200000000000002e-06 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428445+0000", 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027631126999999998 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428493+0000", 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.8554999999999998e-05 2024-09-21T22:18:50.204 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428557+0000", 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.4173999999999999e-05 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64140 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2004992~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74469699599999, 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027790885000000001, 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.205 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64140 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.206 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400894+0000", 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.1e-07 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400896+0000", 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.815e-06 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400904+0000", 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.7300000000000005e-06 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400908+0000", 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5879999999999999e-06 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428580+0000", 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027671952 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428628+0000", 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.7958999999999999e-05 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.208 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428685+0000", 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6530999999999998e-05 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64141 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2033664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.744668472, 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027881843, 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.209 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64141 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400922+0000", 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.210 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400923+0000", 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.34e-07 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400925+0000", 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.6400000000000001e-06 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400930+0000", 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3320000000000002e-06 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400932+0000", 2024-09-21T22:18:50.211 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.638e-06 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428708+0000", 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027775614000000001 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428750+0000", 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.2184000000000001e-05 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428804+0000", 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4101000000000003e-05 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.212 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64142 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2062336~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.74463617800001, 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027972279999999999, 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64142 2024-09-21T22:18:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.214 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400955+0000", 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400958+0000", 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.2929999999999999e-06 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400962+0000", 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.5229999999999997e-06 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400966+0000", 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.641e-06 2024-09-21T22:18:50.215 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428829+0000", 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027863743 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428873+0000", 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.3137999999999999e-05 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428927+0000", 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4422999999999997e-05 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:64143 3.13 3:ce66c15b:::rbd_data.11853a90904b.0000000000000005:1d [read 2091008~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 134.744598045, 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.028051195000000001, 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "started", 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 64143 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.217 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400993+0000", 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8200000000000001e-07 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.218 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400995+0000", 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.5379999999999999e-06 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.400999+0000", 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9750000000000001e-06 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.401001+0000", 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.8030000000000001e-06 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428950+0000", 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027948226 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.428992+0000", 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:16:35.429044+0000", 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.2539e-05 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:200486 3.e 3:758625f2:::rbd_data.1185b457050c.0000000000000003:head [write 0~8388608 [fadvise_sequential+fadvise_nocache],zero 10510336~8192,zero 10592256~8192,zero 10674176~8192,zero 10756096~8192,zero 10838016~8192,zero 10919936~8192,zero 11001856~8192,zero 11083776~8192,zero 11165696~8192,zero 11247616~8192,zero 11329536~8192,zero 11411456~8192,zero 11493376~8192,zero 11575296~2336,write 11577632~829 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 53.974870944000003, 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.070878686999999996, 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 200486 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170720+0000", 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.170722+0000", 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185743+0000", 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.015021085 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185760+0000", 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.7010000000000001e-05 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185772+0000", 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.2187999999999999e-05 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185840+0000", 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.7806999999999996e-05 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.185976+0000", 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.00013587199999999999 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 4", 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.187046+0000", 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.001069878 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.237822+0000", 2024-09-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.050776122 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241485+0000", 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0036632219999999998 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241537+0000", 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.1616000000000002e-05 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:17:56.241599+0000", 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 6.1706999999999997e-05 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "description": "osd_op(client.4485.0:203615 3.12 3:49f39d24:::rbd_data.11854e90025e.0000000000000107:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "initiated_at": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "age": 49.148890469000001, 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.027231178000000002, 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "continuous": false, 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "type_data": { 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_info": { 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client": "client.4485", 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "tid": 203615 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi149.stdout: "events": [ 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "initiated", 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "header_read", 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996700+0000", 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "throttled", 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996702+0000", 2024-09-21T22:18:50.227 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.4449999999999999e-06 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "all_read", 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996710+0000", 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 7.6809999999999998e-06 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "dispatched", 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996721+0000", 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 1.1826e-05 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996727+0000", 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.4879999999999998e-06 2024-09-21T22:18:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "reached_pg", 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996783+0000", 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.6371e-05 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "started", 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:00.996907+0000", 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.000124141 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.001788+0000", 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.0048802259999999997 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "op_commit", 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023801+0000", 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 0.022013451999999999 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023834+0000", 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.3107e-05 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "commit_sent", 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023873+0000", 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 3.9198e-05 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T22:18:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: { 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "event": "done", 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "time": "2024-09-21T22:18:01.023932+0000", 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "duration": 5.8242999999999998e-05 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T22:18:50.231 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T22:18:50.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:18:50.339 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:50.339 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:50.339 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T22:18:50.339 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:50.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:18:50.451 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:50.451 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T22:18:50.451 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T22:18:50.451 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T22:18:50.451 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:50.460 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11582 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 170.65196563000001, 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.003837774, 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11582 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910184+0000", 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910185+0000", 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2550000000000001e-06 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910191+0000", 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2260000000000002e-06 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910201+0000", 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0929999999999992e-06 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910208+0000", 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1910000000000003e-06 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910274+0000", 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6007999999999995e-05 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.910279+0000", 2024-09-21T22:18:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1710000000000001e-06 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915483+0000", 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052042520000000004 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915492+0000", 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6070000000000008e-06 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914008+0000", 2024-09-21T22:18:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99851600699999998 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914022+0000", 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3964e-05 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:11583 3.1e 3.860f005e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 170.64934355700001, 2024-09-21T22:18:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.001260383, 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11583 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912806+0000", 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912808+0000", 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912815+0000", 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6179999999999997e-06 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912827+0000", 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2004000000000001e-05 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.912838+0000", 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0614999999999999e-05 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915933+0000", 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030947629999999999 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:15:59.915941+0000", 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914054+0000", 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.99811355300000004 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:16:00.914066+0000", 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2084e-05 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:158936 3.8 3:11b1e2a7:::rbd_data.11854343a755.0000000000000075:head [write 0~262144 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.666638359000004, 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059314601000000002, 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158936 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895511+0000", 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895512+0000", 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-07 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895640+0000", 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128312 2024-09-21T22:18:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895650+0000", 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7729999999999994e-06 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895656+0000", 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895709+0000", 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3297000000000001e-05 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.895867+0000", 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015832699999999999 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.896042+0000", 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000174227 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.897938+0000", 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018962339999999999 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952404+0000", 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054466277 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.952460+0000", 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6164e-05 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.954826+0000", 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023654290000000001 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160301 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5451776~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.617352507999996, 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059101312000000003, 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160301 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944797+0000", 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944799+0000", 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944805+0000", 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.944809+0000", 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2050000000000004e-06 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999676+0000", 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.054866777999999998 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.999860+0000", 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018494599999999999 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.003898+0000", 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037934 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160325 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5648384~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.615101817999999, 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057551422999999997, 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160325 2024-09-21T22:18:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947048+0000", 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947121+0000", 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3657000000000003e-05 2024-09-21T22:18:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947125+0000", 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.41e-06 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947133+0000", 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947140+0000", 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4960000000000001e-06 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004460+0000", 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057320019 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004524+0000", 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3959000000000002e-05 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004599+0000", 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5226000000000001e-05 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160326 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5656576~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.614999667000006, 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059014807000000002, 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160326 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947150+0000", 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947459+0000", 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030934400000000003 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947464+0000", 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T22:18:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947474+0000", 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.947481+0000", 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004625+0000", 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057144199 2024-09-21T22:18:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.004693+0000", 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7427000000000003e-05 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.006165+0000", 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001471972 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160338 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5746688~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.611179390999993, 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057470902999999997, 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160338 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950970+0000", 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950971+0000", 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950973+0000", 2024-09-21T22:18:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9769999999999999e-06 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950979+0000", 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.37e-06 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950984+0000", 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008172+0000", 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057187963000000001 2024-09-21T22:18:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008239+0000", 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7211000000000004e-05 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008441+0000", 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201733 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160339 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5754880~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.611159252999997, 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057671935000000001, 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160339 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950990+0000", 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950991+0000", 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950993+0000", 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2280000000000001e-06 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.950999+0000", 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5830000000000003e-06 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951004+0000", 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008469+0000", 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057464882000000002 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008534+0000", 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4593999999999999e-05 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008662+0000", 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012831299999999999 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160340 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5763072~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.611138734999997, 2024-09-21T22:18:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057879799000000003, 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160340 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951011+0000", 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951013+0000", 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951020+0000", 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1299999999999998e-06 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.951025+0000", 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9620000000000001e-06 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008692+0000", 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057667909000000003 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008759+0000", 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6345000000000003e-05 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.008891+0000", 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131841 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160855 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5724160~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.583212191000001, 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05759968, 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160855 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978937+0000", 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978938+0000", 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.84e-07 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978940+0000", 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0219999999999999e-06 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978946+0000", 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978951+0000", 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036340+0000", 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057389377999999998 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036414+0000", 2024-09-21T22:18:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4103000000000005e-05 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036537+0000", 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012262800000000001 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160856 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5732352~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.583192620999995, 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057883850000000001, 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160856 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978957+0000", 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978959+0000", 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978965+0000", 2024-09-21T22:18:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8560000000000003e-06 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978970+0000", 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3499999999999999e-06 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036665+0000", 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057694954 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036733+0000", 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8829000000000001e-05 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036841+0000", 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160857 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5740544~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.583174029999995, 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058083719999999998, 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160857 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978976+0000", 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978978+0000", 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978985+0000", 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5270000000000004e-06 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978989+0000", 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.741e-06 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036882+0000", 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057892389000000002 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.036961+0000", 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9089000000000001e-05 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037059+0000", 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8412000000000006e-05 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160858 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5748736~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.583154350000001, 2024-09-21T22:18:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058419275, 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160858 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978995+0000", 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.978996+0000", 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979005+0000", 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0210000000000005e-06 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979012+0000", 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979017+0000", 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037124+0000", 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058106882999999998 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037208+0000", 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3986000000000005e-05 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037415+0000", 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020672400000000001 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160859 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5756928~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.583125989999999, 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058506565000000003, 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160859 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979024+0000", 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-07 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979026+0000", 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979033+0000", 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979038+0000", 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037368+0000", 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058329802 2024-09-21T22:18:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037441+0000", 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3433e-05 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037530+0000", 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8793000000000002e-05 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:160860 3.5 3:a3a9f523:::rbd_data.11859234a8c3.0000000000000000:37 [read 5765120~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e135)", 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.583104448, 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058668241000000003, 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160860 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979045+0000", 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979046+0000", 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979048+0000", 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.198e-06 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979054+0000", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3709999999999996e-06 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:34.979059+0000", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0409999999999997e-06 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037557+0000", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058498106000000001 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037628+0000", 2024-09-21T22:18:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0932999999999993e-05 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:35.037713+0000", 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5204000000000006e-05 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190908 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 303104~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.633208529000001, 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057426265999999997, 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190908 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928941+0000", 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928944+0000", 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2010000000000002e-06 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928951+0000", 2024-09-21T22:18:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0740000000000004e-06 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928956+0000", 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1030000000000001e-06 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986168+0000", 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057212363000000002 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986213+0000", 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5142999999999998e-05 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986367+0000", 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190909 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 385024~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.633187421000002, 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057618427999999999, 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190909 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928962+0000", 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928963+0000", 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928965+0000", 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2110000000000001e-06 2024-09-21T22:18:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928972+0000", 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5610000000000001e-06 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928977+0000", 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986391+0000", 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057413929000000002 2024-09-21T22:18:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986434+0000", 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2582e-05 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986581+0000", 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014685300000000001 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190910 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 450560~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.633165595000001, 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057841218, 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190910 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928984+0000", 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928987+0000", 2024-09-21T22:18:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6740000000000001e-06 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.928993+0000", 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929000+0000", 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6159999999999998e-06 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986611+0000", 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057611258999999998 2024-09-21T22:18:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986651+0000", 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0303999999999999e-05 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986825+0000", 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173847 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190911 3.5 3:a0ea4971:::rbd_data.1185c5009733.0000000000000003:41 [read 598016~8192 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.633144340999998, 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058186806000000001, 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190911 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929005+0000", 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5499999999999999e-07 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929007+0000", 2024-09-21T22:18:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.53e-06 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929012+0000", 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.929015+0000", 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986859+0000", 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057844049000000002 2024-09-21T22:18:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.986940+0000", 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1265000000000002e-05 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:52.987192+0000", 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175700000000002 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:200490 3.b 3:d36e58d9:::rbd_data.1185b457050c.0000000000000005:head [write 0~8388608 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.387727013000003, 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067382992000000003, 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2405613410", 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200490 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174423+0000", 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.174426+0000", 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3400000000000002e-06 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183430+0000", 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090044610000000001 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183473+0000", 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2531000000000003e-05 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183494+0000", 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0939999999999999e-05 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183619+0000", 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125334 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T22:18:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.183864+0000", 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000244536 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.184078+0000", 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021405400000000001 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.237365+0000", 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053287147999999999 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241686+0000", 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043208910000000003 2024-09-21T22:18:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241753+0000", 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7396000000000003e-05 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T22:17:56.241806+0000", 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2361000000000002e-05 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T22:18:50.647 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:18:51.016 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:18:51.022 INFO:teuthology.orchestra.run.smithi134.stderr:noscrub is unset 2024-09-21T22:18:51.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T22:18:51.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:18:51.908 INFO:teuthology.orchestra.run.smithi134.stderr:nodeep-scrub is unset 2024-09-21T22:18:51.912 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T22:18:51.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:18:53.018 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:18:53.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:18:54.027 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:18:54.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:18:54.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:18:54.326 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:18:54.327 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:18:54.339 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-21T22:18:54.027182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216133,"num_read_kb":1301151,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1718,"num_bytes_recovered":166781105,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":459032,"kb_used_data":20812,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754515688,"statfs":{"total":773094113280,"available":772624064512,"internally_reserved":0,"allocated":21311488,"data_stored":11135395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11743407,"num_objects":-10,"num_object_clones":0,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028081"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27866,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.031737+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:18:48.031737+0000","last_peered":"2024-09-21T22:18:48.031737+0000","last_clean":"2024-09-21T22:18:48.031737+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:18:48.031737+0000","last_undegraded":"2024-09-21T22:18:48.031737+0000","last_fullsized":"2024-09-21T22:18:48.031737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:15.615057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1e","version":"207'807","reported_seq":4652,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026944+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:18:53.026944+0000","last_peered":"2024-09-21T22:18:53.026944+0000","last_clean":"2024-09-21T22:18:53.026944+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:18:53.026944+0000","last_undegraded":"2024-09-21T22:18:53.026944+0000","last_fullsized":"2024-09-21T22:18:53.026944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.1d","version":"207'464","reported_seq":8616,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.999545+0000","last_change":"2024-09-21T22:18:47.999545+0000","last_active":"2024-09-21T22:18:47.999545+0000","last_peered":"2024-09-21T22:18:47.999545+0000","last_clean":"2024-09-21T22:18:47.999545+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:18:47.999545+0000","last_undegraded":"2024-09-21T22:18:47.999545+0000","last_fullsized":"2024-09-21T22:18:47.999545+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:03:28.660207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1c","version":"207'919","reported_seq":3857,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.038376+0000","last_change":"2024-09-21T22:18:47.999208+0000","last_active":"2024-09-21T22:18:48.038376+0000","last_peered":"2024-09-21T22:18:48.038376+0000","last_clean":"2024-09-21T22:18:48.038376+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:18:48.038376+0000","last_undegraded":"2024-09-21T22:18:48.038376+0000","last_fullsized":"2024-09-21T22:18:48.038376+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:58:04.165946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4695,"num_read_kb":35496,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1b","version":"206'513","reported_seq":11135,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.030931+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:18:48.030931+0000","last_peered":"2024-09-21T22:18:48.030931+0000","last_clean":"2024-09-21T22:18:48.030931+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:18:48.030931+0000","last_undegraded":"2024-09-21T22:18:48.030931+0000","last_fullsized":"2024-09-21T22:18:48.030931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:19.092862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1a","version":"198'362","reported_seq":3287,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.041410+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:18:48.041410+0000","last_peered":"2024-09-21T22:18:48.041410+0000","last_clean":"2024-09-21T22:18:48.041410+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:18:48.041410+0000","last_undegraded":"2024-09-21T22:18:48.041410+0000","last_fullsized":"2024-09-21T22:18:48.041410+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.19","version":"206'814","reported_seq":4081,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000736+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:18:50.000736+0000","last_peered":"2024-09-21T22:18:50.000736+0000","last_clean":"2024-09-21T22:18:50.000736+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:18:50.000736+0000","last_undegraded":"2024-09-21T22:18:50.000736+0000","last_fullsized":"2024-09-21T22:18:50.000736+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.18","version":"204'840","reported_seq":2807,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026780+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:18:53.026780+0000","last_peered":"2024-09-21T22:18:53.026780+0000","last_clean":"2024-09-21T22:18:53.026780+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:18:53.026780+0000","last_undegraded":"2024-09-21T22:18:53.026780+0000","last_fullsized":"2024-09-21T22:18:53.026780+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.17","version":"206'1170","reported_seq":4013,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.031220+0000","last_change":"2024-09-21T22:18:48.031440+0000","last_active":"2024-09-21T22:18:48.031220+0000","last_peered":"2024-09-21T22:18:48.031220+0000","last_clean":"2024-09-21T22:18:48.031220+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:18:48.031220+0000","last_undegraded":"2024-09-21T22:18:48.031220+0000","last_fullsized":"2024-09-21T22:18:48.031220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:05.561479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.16","version":"207'318","reported_seq":14449,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000787+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:18:50.000787+0000","last_peered":"2024-09-21T22:18:50.000787+0000","last_clean":"2024-09-21T22:18:50.000787+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:18:50.000787+0000","last_undegraded":"2024-09-21T22:18:50.000787+0000","last_fullsized":"2024-09-21T22:18:50.000787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.15","version":"207'898","reported_seq":3817,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068436+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:18:49.068436+0000","last_peered":"2024-09-21T22:18:49.068436+0000","last_clean":"2024-09-21T22:18:49.068436+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:18:49.068436+0000","last_undegraded":"2024-09-21T22:18:49.068436+0000","last_fullsized":"2024-09-21T22:18:49.068436+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.14","version":"205'1008","reported_seq":5104,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.999360+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:18:47.999360+0000","last_peered":"2024-09-21T22:18:47.999360+0000","last_clean":"2024-09-21T22:18:47.999360+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:18:47.999360+0000","last_undegraded":"2024-09-21T22:18:47.999360+0000","last_fullsized":"2024-09-21T22:18:47.999360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":395,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068416+0000","last_change":"2024-09-21T22:18:41.913952+0000","last_active":"2024-09-21T22:18:49.068416+0000","last_peered":"2024-09-21T22:18:49.068416+0000","last_clean":"2024-09-21T22:18:49.068416+0000","last_became_active":"2024-09-21T22:18:41.913749+0000","last_became_peered":"2024-09-21T22:18:41.913749+0000","last_unstale":"2024-09-21T22:18:49.068416+0000","last_undegraded":"2024-09-21T22:18:49.068416+0000","last_fullsized":"2024-09-21T22:18:49.068416+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:16.706157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4177,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.031413+0000","last_change":"2024-09-21T22:18:48.031413+0000","last_active":"2024-09-21T22:18:48.031413+0000","last_peered":"2024-09-21T22:18:48.031413+0000","last_clean":"2024-09-21T22:18:48.031413+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:18:48.031413+0000","last_undegraded":"2024-09-21T22:18:48.031413+0000","last_fullsized":"2024-09-21T22:18:48.031413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:52.106117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":396,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000903+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:18:50.000903+0000","last_peered":"2024-09-21T22:18:50.000903+0000","last_clean":"2024-09-21T22:18:50.000903+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:18:50.000903+0000","last_undegraded":"2024-09-21T22:18:50.000903+0000","last_fullsized":"2024-09-21T22:18:50.000903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11216,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026945+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:18:53.026945+0000","last_peered":"2024-09-21T22:18:53.026945+0000","last_clean":"2024-09-21T22:18:53.026945+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:18:53.026945+0000","last_undegraded":"2024-09-21T22:18:53.026945+0000","last_fullsized":"2024-09-21T22:18:53.026945+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":390,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.076127+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:18:48.076127+0000","last_peered":"2024-09-21T22:18:48.076127+0000","last_clean":"2024-09-21T22:18:48.076127+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:18:48.076127+0000","last_undegraded":"2024-09-21T22:18:48.076127+0000","last_fullsized":"2024-09-21T22:18:48.076127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10251,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000663+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:18:50.000663+0000","last_peered":"2024-09-21T22:18:50.000663+0000","last_clean":"2024-09-21T22:18:50.000663+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:18:50.000663+0000","last_undegraded":"2024-09-21T22:18:50.000663+0000","last_fullsized":"2024-09-21T22:18:50.000663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":396,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000664+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:18:50.000664+0000","last_peered":"2024-09-21T22:18:50.000664+0000","last_clean":"2024-09-21T22:18:50.000664+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:18:50.000664+0000","last_undegraded":"2024-09-21T22:18:50.000664+0000","last_fullsized":"2024-09-21T22:18:50.000664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14482,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026914+0000","last_change":"2024-09-21T22:18:47.999393+0000","last_active":"2024-09-21T22:18:53.026914+0000","last_peered":"2024-09-21T22:18:53.026914+0000","last_clean":"2024-09-21T22:18:53.026914+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:18:53.026914+0000","last_undegraded":"2024-09-21T22:18:53.026914+0000","last_fullsized":"2024-09-21T22:18:53.026914+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:40:09.820571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020106640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.3","version":"207'770","reported_seq":4320,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.093057+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:18:48.093057+0000","last_peered":"2024-09-21T22:18:48.093057+0000","last_clean":"2024-09-21T22:18:48.093057+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:18:48.093057+0000","last_undegraded":"2024-09-21T22:18:48.093057+0000","last_fullsized":"2024-09-21T22:18:48.093057+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":242,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000623+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:18:50.000623+0000","last_peered":"2024-09-21T22:18:50.000623+0000","last_clean":"2024-09-21T22:18:50.000623+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:18:50.000623+0000","last_undegraded":"2024-09-21T22:18:50.000623+0000","last_fullsized":"2024-09-21T22:18:50.000623+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18449,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000464+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:18:50.000464+0000","last_peered":"2024-09-21T22:18:50.000464+0000","last_clean":"2024-09-21T22:18:50.000464+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:18:50.000464+0000","last_undegraded":"2024-09-21T22:18:50.000464+0000","last_fullsized":"2024-09-21T22:18:50.000464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026817+0000","last_change":"2024-09-21T22:18:35.932527+0000","last_active":"2024-09-21T22:18:53.026817+0000","last_peered":"2024-09-21T22:18:53.026817+0000","last_clean":"2024-09-21T22:18:53.026817+0000","last_became_active":"2024-09-21T22:18:35.932243+0000","last_became_peered":"2024-09-21T22:18:35.932243+0000","last_unstale":"2024-09-21T22:18:53.026817+0000","last_undegraded":"2024-09-21T22:18:53.026817+0000","last_fullsized":"2024-09-21T22:18:53.026817+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:58:43.493417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2573,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.030832+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:18:48.030832+0000","last_peered":"2024-09-21T22:18:48.030832+0000","last_clean":"2024-09-21T22:18:48.030832+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:18:48.030832+0000","last_undegraded":"2024-09-21T22:18:48.030832+0000","last_fullsized":"2024-09-21T22:18:48.030832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:45.211773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":390,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.076059+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:18:48.076059+0000","last_peered":"2024-09-21T22:18:48.076059+0000","last_clean":"2024-09-21T22:18:48.076059+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:18:48.076059+0000","last_undegraded":"2024-09-21T22:18:48.076059+0000","last_fullsized":"2024-09-21T22:18:48.076059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1801,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.027599+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:18:53.027599+0000","last_peered":"2024-09-21T22:18:53.027599+0000","last_clean":"2024-09-21T22:18:53.027599+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:18:53.027599+0000","last_undegraded":"2024-09-21T22:18:53.027599+0000","last_fullsized":"2024-09-21T22:18:53.027599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":213,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.001647+0000","last_change":"2024-09-21T22:18:35.931550+0000","last_active":"2024-09-21T22:18:49.001647+0000","last_peered":"2024-09-21T22:18:49.001647+0000","last_clean":"2024-09-21T22:18:49.001647+0000","last_became_active":"2024-09-21T22:18:35.931311+0000","last_became_peered":"2024-09-21T22:18:35.931311+0000","last_unstale":"2024-09-21T22:18:49.001647+0000","last_undegraded":"2024-09-21T22:18:49.001647+0000","last_fullsized":"2024-09-21T22:18:49.001647+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:43:29.354593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.030523+0000","last_change":"2024-09-21T22:18:44.977346+0000","last_active":"2024-09-21T22:18:48.030523+0000","last_peered":"2024-09-21T22:18:48.030523+0000","last_clean":"2024-09-21T22:18:48.030523+0000","last_became_active":"2024-09-21T22:18:44.976938+0000","last_became_peered":"2024-09-21T22:18:44.976938+0000","last_unstale":"2024-09-21T22:18:48.030523+0000","last_undegraded":"2024-09-21T22:18:48.030523+0000","last_fullsized":"2024-09-21T22:18:48.030523+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:42:59.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2329,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026801+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:18:53.026801+0000","last_peered":"2024-09-21T22:18:53.026801+0000","last_clean":"2024-09-21T22:18:53.026801+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:18:53.026801+0000","last_undegraded":"2024-09-21T22:18:53.026801+0000","last_fullsized":"2024-09-21T22:18:53.026801+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.9","version":"207'563","reported_seq":4525,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.087412+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:18:48.087412+0000","last_peered":"2024-09-21T22:18:48.087412+0000","last_clean":"2024-09-21T22:18:48.087412+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:18:48.087412+0000","last_undegraded":"2024-09-21T22:18:48.087412+0000","last_fullsized":"2024-09-21T22:18:48.087412+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.a","version":"199'839","reported_seq":3457,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068358+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:18:49.068358+0000","last_peered":"2024-09-21T22:18:49.068358+0000","last_clean":"2024-09-21T22:18:49.068358+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:18:49.068358+0000","last_undegraded":"2024-09-21T22:18:49.068358+0000","last_fullsized":"2024-09-21T22:18:49.068358+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.b","version":"206'863","reported_seq":3075,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026876+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:18:53.026876+0000","last_peered":"2024-09-21T22:18:53.026876+0000","last_clean":"2024-09-21T22:18:53.026876+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:18:53.026876+0000","last_undegraded":"2024-09-21T22:18:53.026876+0000","last_fullsized":"2024-09-21T22:18:53.026876+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.c","version":"206'503","reported_seq":1975,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.027063+0000","last_change":"2024-09-21T22:18:47.999979+0000","last_active":"2024-09-21T22:18:53.027063+0000","last_peered":"2024-09-21T22:18:53.027063+0000","last_clean":"2024-09-21T22:18:53.027063+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:18:53.027063+0000","last_undegraded":"2024-09-21T22:18:53.027063+0000","last_fullsized":"2024-09-21T22:18:53.027063+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:52.247660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012439009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1734,"num_read_kb":37997,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.d","version":"204'655","reported_seq":2790,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068439+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:18:49.068439+0000","last_peered":"2024-09-21T22:18:49.068439+0000","last_clean":"2024-09-21T22:18:49.068439+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:18:49.068439+0000","last_undegraded":"2024-09-21T22:18:49.068439+0000","last_fullsized":"2024-09-21T22:18:49.068439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.e","version":"207'677","reported_seq":2251,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.078362+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:18:48.078362+0000","last_peered":"2024-09-21T22:18:48.078362+0000","last_clean":"2024-09-21T22:18:48.078362+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:18:48.078362+0000","last_undegraded":"2024-09-21T22:18:48.078362+0000","last_fullsized":"2024-09-21T22:18:48.078362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.f","version":"204'616","reported_seq":2980,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.998669+0000","last_change":"2024-09-21T22:18:47.998883+0000","last_active":"2024-09-21T22:18:47.998669+0000","last_peered":"2024-09-21T22:18:47.998669+0000","last_clean":"2024-09-21T22:18:47.998669+0000","last_became_active":"2024-09-21T22:18:44.980349+0000","last_became_peered":"2024-09-21T22:18:44.980349+0000","last_unstale":"2024-09-21T22:18:47.998669+0000","last_undegraded":"2024-09-21T22:18:47.998669+0000","last_fullsized":"2024-09-21T22:18:47.998669+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:47.965656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.10","version":"204'395","reported_seq":2562,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068367+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:18:49.068367+0000","last_peered":"2024-09-21T22:18:49.068367+0000","last_clean":"2024-09-21T22:18:49.068367+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:18:49.068367+0000","last_undegraded":"2024-09-21T22:18:49.068367+0000","last_fullsized":"2024-09-21T22:18:49.068367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.11","version":"207'713","reported_seq":2459,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.077511+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:18:48.077511+0000","last_peered":"2024-09-21T22:18:48.077511+0000","last_clean":"2024-09-21T22:18:48.077511+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:18:48.077511+0000","last_undegraded":"2024-09-21T22:18:48.077511+0000","last_fullsized":"2024-09-21T22:18:48.077511+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.12","version":"204'591","reported_seq":7227,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.997785+0000","last_change":"2024-09-21T22:18:47.997785+0000","last_active":"2024-09-21T22:18:47.997785+0000","last_peered":"2024-09-21T22:18:47.997785+0000","last_clean":"2024-09-21T22:18:47.997785+0000","last_became_active":"2024-09-21T22:18:44.977470+0000","last_became_peered":"2024-09-21T22:18:44.977470+0000","last_unstale":"2024-09-21T22:18:47.997785+0000","last_undegraded":"2024-09-21T22:18:47.997785+0000","last_fullsized":"2024-09-21T22:18:47.997785+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:10:17.156018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051455299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.13","version":"207'699","reported_seq":12541,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.078502+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:18:48.078502+0000","last_peered":"2024-09-21T22:18:48.078502+0000","last_clean":"2024-09-21T22:18:48.078502+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:18:48.078502+0000","last_undegraded":"2024-09-21T22:18:48.078502+0000","last_fullsized":"2024-09-21T22:18:48.078502+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216017,"num_read_kb":1301051,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1716,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78056,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293784,"statfs":{"total":96636764160,"available":96556834816,"internally_reserved":0,"allocated":2502656,"data_stored":1239027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30156,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341684,"statfs":{"total":96636764160,"available":96605884416,"internally_reserved":0,"allocated":3096576,"data_stored":1829395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74004,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297836,"statfs":{"total":96636764160,"available":96560984064,"internally_reserved":0,"allocated":2506752,"data_stored":1239046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73900,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297940,"statfs":{"total":96636764160,"available":96561090560,"internally_reserved":0,"allocated":2506752,"data_stored":1239046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528356,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56988,"kb_used_data":2504,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314852,"statfs":{"total":96636764160,"available":96578408448,"internally_reserved":0,"allocated":2564096,"data_stored":1269320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2514944,"data_stored":1245064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33652,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338188,"statfs":{"total":96636764160,"available":96602304512,"internally_reserved":0,"allocated":2523136,"data_stored":1245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70312,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301528,"statfs":{"total":96636764160,"available":96564764672,"internally_reserved":0,"allocated":3096576,"data_stored":1829395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:18:54.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:18:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:18:54.616 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:18:54.629 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-21T22:18:54.027182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216133,"num_read_kb":1301151,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1718,"num_bytes_recovered":166781105,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":459032,"kb_used_data":20812,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754515688,"statfs":{"total":773094113280,"available":772624064512,"internally_reserved":0,"allocated":21311488,"data_stored":11135395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11743407,"num_objects":-10,"num_object_clones":0,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028081"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27866,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.031737+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:18:48.031737+0000","last_peered":"2024-09-21T22:18:48.031737+0000","last_clean":"2024-09-21T22:18:48.031737+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:18:48.031737+0000","last_undegraded":"2024-09-21T22:18:48.031737+0000","last_fullsized":"2024-09-21T22:18:48.031737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:15.615057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1e","version":"207'807","reported_seq":4652,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026944+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:18:53.026944+0000","last_peered":"2024-09-21T22:18:53.026944+0000","last_clean":"2024-09-21T22:18:53.026944+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:18:53.026944+0000","last_undegraded":"2024-09-21T22:18:53.026944+0000","last_fullsized":"2024-09-21T22:18:53.026944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.1d","version":"207'464","reported_seq":8616,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.999545+0000","last_change":"2024-09-21T22:18:47.999545+0000","last_active":"2024-09-21T22:18:47.999545+0000","last_peered":"2024-09-21T22:18:47.999545+0000","last_clean":"2024-09-21T22:18:47.999545+0000","last_became_active":"2024-09-21T22:17:00.003306+0000","last_became_peered":"2024-09-21T22:17:00.003306+0000","last_unstale":"2024-09-21T22:18:47.999545+0000","last_undegraded":"2024-09-21T22:18:47.999545+0000","last_fullsized":"2024-09-21T22:18:47.999545+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:03:28.660207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1c","version":"207'919","reported_seq":3857,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.038376+0000","last_change":"2024-09-21T22:18:47.999208+0000","last_active":"2024-09-21T22:18:48.038376+0000","last_peered":"2024-09-21T22:18:48.038376+0000","last_clean":"2024-09-21T22:18:48.038376+0000","last_became_active":"2024-09-21T22:17:00.003295+0000","last_became_peered":"2024-09-21T22:17:00.003295+0000","last_unstale":"2024-09-21T22:18:48.038376+0000","last_undegraded":"2024-09-21T22:18:48.038376+0000","last_fullsized":"2024-09-21T22:18:48.038376+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:58:04.165946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4695,"num_read_kb":35496,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1b","version":"206'513","reported_seq":11135,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.030931+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:18:48.030931+0000","last_peered":"2024-09-21T22:18:48.030931+0000","last_clean":"2024-09-21T22:18:48.030931+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:18:48.030931+0000","last_undegraded":"2024-09-21T22:18:48.030931+0000","last_fullsized":"2024-09-21T22:18:48.030931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:19.092862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.1a","version":"198'362","reported_seq":3287,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.041410+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:18:48.041410+0000","last_peered":"2024-09-21T22:18:48.041410+0000","last_clean":"2024-09-21T22:18:48.041410+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:18:48.041410+0000","last_undegraded":"2024-09-21T22:18:48.041410+0000","last_fullsized":"2024-09-21T22:18:48.041410+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.19","version":"206'814","reported_seq":4081,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000736+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:18:50.000736+0000","last_peered":"2024-09-21T22:18:50.000736+0000","last_clean":"2024-09-21T22:18:50.000736+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:18:50.000736+0000","last_undegraded":"2024-09-21T22:18:50.000736+0000","last_fullsized":"2024-09-21T22:18:50.000736+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.18","version":"204'840","reported_seq":2807,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026780+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:18:53.026780+0000","last_peered":"2024-09-21T22:18:53.026780+0000","last_clean":"2024-09-21T22:18:53.026780+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:18:53.026780+0000","last_undegraded":"2024-09-21T22:18:53.026780+0000","last_fullsized":"2024-09-21T22:18:53.026780+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.17","version":"206'1170","reported_seq":4013,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.031220+0000","last_change":"2024-09-21T22:18:48.031440+0000","last_active":"2024-09-21T22:18:48.031220+0000","last_peered":"2024-09-21T22:18:48.031220+0000","last_clean":"2024-09-21T22:18:48.031220+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:18:48.031220+0000","last_undegraded":"2024-09-21T22:18:48.031220+0000","last_fullsized":"2024-09-21T22:18:48.031220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:05.561479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.16","version":"207'318","reported_seq":14449,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000787+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:18:50.000787+0000","last_peered":"2024-09-21T22:18:50.000787+0000","last_clean":"2024-09-21T22:18:50.000787+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:18:50.000787+0000","last_undegraded":"2024-09-21T22:18:50.000787+0000","last_fullsized":"2024-09-21T22:18:50.000787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.15","version":"207'898","reported_seq":3817,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068436+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:18:49.068436+0000","last_peered":"2024-09-21T22:18:49.068436+0000","last_clean":"2024-09-21T22:18:49.068436+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:18:49.068436+0000","last_undegraded":"2024-09-21T22:18:49.068436+0000","last_fullsized":"2024-09-21T22:18:49.068436+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.14","version":"205'1008","reported_seq":5104,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.999360+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:18:47.999360+0000","last_peered":"2024-09-21T22:18:47.999360+0000","last_clean":"2024-09-21T22:18:47.999360+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:18:47.999360+0000","last_undegraded":"2024-09-21T22:18:47.999360+0000","last_fullsized":"2024-09-21T22:18:47.999360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":395,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068416+0000","last_change":"2024-09-21T22:18:41.913952+0000","last_active":"2024-09-21T22:18:49.068416+0000","last_peered":"2024-09-21T22:18:49.068416+0000","last_clean":"2024-09-21T22:18:49.068416+0000","last_became_active":"2024-09-21T22:18:41.913749+0000","last_became_peered":"2024-09-21T22:18:41.913749+0000","last_unstale":"2024-09-21T22:18:49.068416+0000","last_undegraded":"2024-09-21T22:18:49.068416+0000","last_fullsized":"2024-09-21T22:18:49.068416+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:16.706157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4177,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.031413+0000","last_change":"2024-09-21T22:18:48.031413+0000","last_active":"2024-09-21T22:18:48.031413+0000","last_peered":"2024-09-21T22:18:48.031413+0000","last_clean":"2024-09-21T22:18:48.031413+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:18:48.031413+0000","last_undegraded":"2024-09-21T22:18:48.031413+0000","last_fullsized":"2024-09-21T22:18:48.031413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:52.106117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":396,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000903+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:18:50.000903+0000","last_peered":"2024-09-21T22:18:50.000903+0000","last_clean":"2024-09-21T22:18:50.000903+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:18:50.000903+0000","last_undegraded":"2024-09-21T22:18:50.000903+0000","last_fullsized":"2024-09-21T22:18:50.000903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11216,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026945+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:18:53.026945+0000","last_peered":"2024-09-21T22:18:53.026945+0000","last_clean":"2024-09-21T22:18:53.026945+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:18:53.026945+0000","last_undegraded":"2024-09-21T22:18:53.026945+0000","last_fullsized":"2024-09-21T22:18:53.026945+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":390,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.076127+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:18:48.076127+0000","last_peered":"2024-09-21T22:18:48.076127+0000","last_clean":"2024-09-21T22:18:48.076127+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:18:48.076127+0000","last_undegraded":"2024-09-21T22:18:48.076127+0000","last_fullsized":"2024-09-21T22:18:48.076127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10251,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000663+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:18:50.000663+0000","last_peered":"2024-09-21T22:18:50.000663+0000","last_clean":"2024-09-21T22:18:50.000663+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:18:50.000663+0000","last_undegraded":"2024-09-21T22:18:50.000663+0000","last_fullsized":"2024-09-21T22:18:50.000663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":396,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000664+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:18:50.000664+0000","last_peered":"2024-09-21T22:18:50.000664+0000","last_clean":"2024-09-21T22:18:50.000664+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:18:50.000664+0000","last_undegraded":"2024-09-21T22:18:50.000664+0000","last_fullsized":"2024-09-21T22:18:50.000664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14482,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026914+0000","last_change":"2024-09-21T22:18:47.999393+0000","last_active":"2024-09-21T22:18:53.026914+0000","last_peered":"2024-09-21T22:18:53.026914+0000","last_clean":"2024-09-21T22:18:53.026914+0000","last_became_active":"2024-09-21T22:17:00.000005+0000","last_became_peered":"2024-09-21T22:17:00.000005+0000","last_unstale":"2024-09-21T22:18:53.026914+0000","last_undegraded":"2024-09-21T22:18:53.026914+0000","last_fullsized":"2024-09-21T22:18:53.026914+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:40:09.820571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020106640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.3","version":"207'770","reported_seq":4320,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.093057+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:18:48.093057+0000","last_peered":"2024-09-21T22:18:48.093057+0000","last_clean":"2024-09-21T22:18:48.093057+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:18:48.093057+0000","last_undegraded":"2024-09-21T22:18:48.093057+0000","last_fullsized":"2024-09-21T22:18:48.093057+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":242,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000623+0000","last_change":"2024-09-21T22:17:00.004142+0000","last_active":"2024-09-21T22:18:50.000623+0000","last_peered":"2024-09-21T22:18:50.000623+0000","last_clean":"2024-09-21T22:18:50.000623+0000","last_became_active":"2024-09-21T22:17:00.003425+0000","last_became_peered":"2024-09-21T22:17:00.003425+0000","last_unstale":"2024-09-21T22:18:50.000623+0000","last_undegraded":"2024-09-21T22:18:50.000623+0000","last_fullsized":"2024-09-21T22:18:50.000623+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:13:48.877676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18449,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-21T22:18:50.000464+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:18:50.000464+0000","last_peered":"2024-09-21T22:18:50.000464+0000","last_clean":"2024-09-21T22:18:50.000464+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:18:50.000464+0000","last_undegraded":"2024-09-21T22:18:50.000464+0000","last_fullsized":"2024-09-21T22:18:50.000464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026817+0000","last_change":"2024-09-21T22:18:35.932527+0000","last_active":"2024-09-21T22:18:53.026817+0000","last_peered":"2024-09-21T22:18:53.026817+0000","last_clean":"2024-09-21T22:18:53.026817+0000","last_became_active":"2024-09-21T22:18:35.932243+0000","last_became_peered":"2024-09-21T22:18:35.932243+0000","last_unstale":"2024-09-21T22:18:53.026817+0000","last_undegraded":"2024-09-21T22:18:53.026817+0000","last_fullsized":"2024-09-21T22:18:53.026817+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:58:43.493417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2573,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.030832+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:18:48.030832+0000","last_peered":"2024-09-21T22:18:48.030832+0000","last_clean":"2024-09-21T22:18:48.030832+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:18:48.030832+0000","last_undegraded":"2024-09-21T22:18:48.030832+0000","last_fullsized":"2024-09-21T22:18:48.030832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:45.211773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":390,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.076059+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:18:48.076059+0000","last_peered":"2024-09-21T22:18:48.076059+0000","last_clean":"2024-09-21T22:18:48.076059+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:18:48.076059+0000","last_undegraded":"2024-09-21T22:18:48.076059+0000","last_fullsized":"2024-09-21T22:18:48.076059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1801,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.027599+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:18:53.027599+0000","last_peered":"2024-09-21T22:18:53.027599+0000","last_clean":"2024-09-21T22:18:53.027599+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:18:53.027599+0000","last_undegraded":"2024-09-21T22:18:53.027599+0000","last_fullsized":"2024-09-21T22:18:53.027599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":213,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.001647+0000","last_change":"2024-09-21T22:18:35.931550+0000","last_active":"2024-09-21T22:18:49.001647+0000","last_peered":"2024-09-21T22:18:49.001647+0000","last_clean":"2024-09-21T22:18:49.001647+0000","last_became_active":"2024-09-21T22:18:35.931311+0000","last_became_peered":"2024-09-21T22:18:35.931311+0000","last_unstale":"2024-09-21T22:18:49.001647+0000","last_undegraded":"2024-09-21T22:18:49.001647+0000","last_fullsized":"2024-09-21T22:18:49.001647+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:43:29.354593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.030523+0000","last_change":"2024-09-21T22:18:44.977346+0000","last_active":"2024-09-21T22:18:48.030523+0000","last_peered":"2024-09-21T22:18:48.030523+0000","last_clean":"2024-09-21T22:18:48.030523+0000","last_became_active":"2024-09-21T22:18:44.976938+0000","last_became_peered":"2024-09-21T22:18:44.976938+0000","last_unstale":"2024-09-21T22:18:48.030523+0000","last_undegraded":"2024-09-21T22:18:48.030523+0000","last_fullsized":"2024-09-21T22:18:48.030523+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:42:59.969179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2329,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026801+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:18:53.026801+0000","last_peered":"2024-09-21T22:18:53.026801+0000","last_clean":"2024-09-21T22:18:53.026801+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:18:53.026801+0000","last_undegraded":"2024-09-21T22:18:53.026801+0000","last_fullsized":"2024-09-21T22:18:53.026801+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.9","version":"207'563","reported_seq":4525,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.087412+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:18:48.087412+0000","last_peered":"2024-09-21T22:18:48.087412+0000","last_clean":"2024-09-21T22:18:48.087412+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:18:48.087412+0000","last_undegraded":"2024-09-21T22:18:48.087412+0000","last_fullsized":"2024-09-21T22:18:48.087412+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.a","version":"199'839","reported_seq":3457,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068358+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:18:49.068358+0000","last_peered":"2024-09-21T22:18:49.068358+0000","last_clean":"2024-09-21T22:18:49.068358+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:18:49.068358+0000","last_undegraded":"2024-09-21T22:18:49.068358+0000","last_fullsized":"2024-09-21T22:18:49.068358+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.b","version":"206'863","reported_seq":3075,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.026876+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:18:53.026876+0000","last_peered":"2024-09-21T22:18:53.026876+0000","last_clean":"2024-09-21T22:18:53.026876+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:18:53.026876+0000","last_undegraded":"2024-09-21T22:18:53.026876+0000","last_fullsized":"2024-09-21T22:18:53.026876+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.c","version":"206'503","reported_seq":1975,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-21T22:18:53.027063+0000","last_change":"2024-09-21T22:18:47.999979+0000","last_active":"2024-09-21T22:18:53.027063+0000","last_peered":"2024-09-21T22:18:53.027063+0000","last_clean":"2024-09-21T22:18:53.027063+0000","last_became_active":"2024-09-21T22:17:00.003070+0000","last_became_peered":"2024-09-21T22:17:00.003070+0000","last_unstale":"2024-09-21T22:18:53.027063+0000","last_undegraded":"2024-09-21T22:18:53.027063+0000","last_fullsized":"2024-09-21T22:18:53.027063+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:52.247660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012439009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1734,"num_read_kb":37997,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.d","version":"204'655","reported_seq":2790,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068439+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:18:49.068439+0000","last_peered":"2024-09-21T22:18:49.068439+0000","last_clean":"2024-09-21T22:18:49.068439+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:18:49.068439+0000","last_undegraded":"2024-09-21T22:18:49.068439+0000","last_fullsized":"2024-09-21T22:18:49.068439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.e","version":"207'677","reported_seq":2251,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.078362+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:18:48.078362+0000","last_peered":"2024-09-21T22:18:48.078362+0000","last_clean":"2024-09-21T22:18:48.078362+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:18:48.078362+0000","last_undegraded":"2024-09-21T22:18:48.078362+0000","last_fullsized":"2024-09-21T22:18:48.078362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.f","version":"204'616","reported_seq":2980,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.998669+0000","last_change":"2024-09-21T22:18:47.998883+0000","last_active":"2024-09-21T22:18:47.998669+0000","last_peered":"2024-09-21T22:18:47.998669+0000","last_clean":"2024-09-21T22:18:47.998669+0000","last_became_active":"2024-09-21T22:18:44.980349+0000","last_became_peered":"2024-09-21T22:18:44.980349+0000","last_unstale":"2024-09-21T22:18:47.998669+0000","last_undegraded":"2024-09-21T22:18:47.998669+0000","last_fullsized":"2024-09-21T22:18:47.998669+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:47.965656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.10","version":"204'395","reported_seq":2562,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-09-21T22:18:49.068367+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:18:49.068367+0000","last_peered":"2024-09-21T22:18:49.068367+0000","last_clean":"2024-09-21T22:18:49.068367+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:18:49.068367+0000","last_undegraded":"2024-09-21T22:18:49.068367+0000","last_fullsized":"2024-09-21T22:18:49.068367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.11","version":"207'713","reported_seq":2459,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.077511+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:18:48.077511+0000","last_peered":"2024-09-21T22:18:48.077511+0000","last_clean":"2024-09-21T22:18:48.077511+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:18:48.077511+0000","last_undegraded":"2024-09-21T22:18:48.077511+0000","last_fullsized":"2024-09-21T22:18:48.077511+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.12","version":"204'591","reported_seq":7227,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:47.997785+0000","last_change":"2024-09-21T22:18:47.997785+0000","last_active":"2024-09-21T22:18:47.997785+0000","last_peered":"2024-09-21T22:18:47.997785+0000","last_clean":"2024-09-21T22:18:47.997785+0000","last_became_active":"2024-09-21T22:18:44.977470+0000","last_became_peered":"2024-09-21T22:18:44.977470+0000","last_unstale":"2024-09-21T22:18:47.997785+0000","last_undegraded":"2024-09-21T22:18:47.997785+0000","last_fullsized":"2024-09-21T22:18:47.997785+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:10:17.156018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051455299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.13","version":"207'699","reported_seq":12541,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-21T22:18:48.078502+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:18:48.078502+0000","last_peered":"2024-09-21T22:18:48.078502+0000","last_clean":"2024-09-21T22:18:48.078502+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:18:48.078502+0000","last_undegraded":"2024-09-21T22:18:48.078502+0000","last_fullsized":"2024-09-21T22:18:48.078502+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"},{"start":"7","length":"1"},{"start":"9","length":"1"},{"start":"b","length":"1"},{"start":"d","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216017,"num_read_kb":1301051,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1716,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78056,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293784,"statfs":{"total":96636764160,"available":96556834816,"internally_reserved":0,"allocated":2502656,"data_stored":1239027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30156,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341684,"statfs":{"total":96636764160,"available":96605884416,"internally_reserved":0,"allocated":3096576,"data_stored":1829395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74004,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297836,"statfs":{"total":96636764160,"available":96560984064,"internally_reserved":0,"allocated":2506752,"data_stored":1239046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73900,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297940,"statfs":{"total":96636764160,"available":96561090560,"internally_reserved":0,"allocated":2506752,"data_stored":1239046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528356,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56988,"kb_used_data":2504,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314852,"statfs":{"total":96636764160,"available":96578408448,"internally_reserved":0,"allocated":2564096,"data_stored":1269320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2514944,"data_stored":1245064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33652,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338188,"statfs":{"total":96636764160,"available":96602304512,"internally_reserved":0,"allocated":2523136,"data_stored":1245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70312,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301528,"statfs":{"total":96636764160,"available":96564764672,"internally_reserved":0,"allocated":3096576,"data_stored":1829395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:18:54.631 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:18:54.631 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:18:54.631 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T22:18:54.631 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.000000 2024-09-21T22:18:54.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0 2024-09-21T22:18:55.028 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.5 primary-affinity to 0 (802) 2024-09-21T22:19:00.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-21T22:19:00.172 INFO:teuthology.orchestra.run.smithi134.stdout:mon.a: {} 2024-09-21T22:19:00.172 INFO:teuthology.orchestra.run.smithi134.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:19:00.182 INFO:teuthology.orchestra.run.smithi134.stdout:mon.b: {} 2024-09-21T22:19:00.182 INFO:teuthology.orchestra.run.smithi134.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:19:00.190 INFO:teuthology.orchestra.run.smithi134.stdout:mon.c: {} 2024-09-21T22:19:00.190 INFO:teuthology.orchestra.run.smithi134.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:19:00.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:19:01.051 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:19:01.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-21T22:19:02.058 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-21T22:19:02.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:19:03.059 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:19:03.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-21T22:19:04.083 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-21T22:19:04.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:19:05.077 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:19:05.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-21T22:19:06.087 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-21T22:19:06.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:19:07.089 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:19:07.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-21T22:19:08.107 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-21T22:19:08.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:19:09.114 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:19:09.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-21T22:19:10.121 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-21T22:19:10.138 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T22:19:11.122 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T22:19:11.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-21T22:19:12.136 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-21T22:19:12.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:19:13.141 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:19:13.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-21T22:19:14.144 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-21T22:19:14.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:19:15.149 INFO:teuthology.orchestra.run.smithi134.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:19:15.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-21T22:19:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-21T22:19:16.178 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-21T22:19:16.179 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-21T22:19:16.179 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-21T22:19:16.179 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-21T22:19:16.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T22:19:16.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:19:16.460 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:16.461 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":232,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:19:16.154230+0000","last_up_change":"2024-09-21T22:15:59.900683+0000","last_in_change":"2024-09-21T22:16:44.923178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:15:21.204402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:15:25.020799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T22:15:34.502611+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":72,"snap_epoch":207,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":218,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6817","nonce":1738784974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6819","nonce":1738784974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6823","nonce":1738784974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6821","nonce":1738784974}]},"public_addr":"172.21.15.134:6817/1738784974","cluster_addr":"172.21.15.134:6819/1738784974","heartbeat_back_addr":"172.21.15.134:6823/1738784974","heartbeat_front_addr":"172.21.15.134:6821/1738784974","state":["exists","up"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6825","nonce":3328015815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6827","nonce":3328015815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6831","nonce":3328015815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6829","nonce":3328015815}]},"public_addr":"172.21.15.134:6825/3328015815","cluster_addr":"172.21.15.134:6827/3328015815","heartbeat_back_addr":"172.21.15.134:6831/3328015815","heartbeat_front_addr":"172.21.15.134:6829/3328015815","state":["exists","up"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":222,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6801","nonce":1987494452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6803","nonce":1987494452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6807","nonce":1987494452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6805","nonce":1987494452}]},"public_addr":"172.21.15.134:6801/1987494452","cluster_addr":"172.21.15.134:6803/1987494452","heartbeat_back_addr":"172.21.15.134:6807/1987494452","heartbeat_front_addr":"172.21.15.134:6805/1987494452","state":["exists","up"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":26,"up_from":45,"up_thru":203,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6809","nonce":704257458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6811","nonce":704257458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6815","nonce":704257458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6813","nonce":704257458}]},"public_addr":"172.21.15.134:6809/704257458","cluster_addr":"172.21.15.134:6811/704257458","heartbeat_back_addr":"172.21.15.134:6815/704257458","heartbeat_front_addr":"172.21.15.134:6813/704257458","state":["exists","up"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6801","nonce":1724687038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6803","nonce":1724687038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6807","nonce":1724687038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6805","nonce":1724687038}]},"public_addr":"172.21.15.149:6801/1724687038","cluster_addr":"172.21.15.149:6803/1724687038","heartbeat_back_addr":"172.21.15.149:6807/1724687038","heartbeat_front_addr":"172.21.15.149:6805/1724687038","state":["exists","up"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":226,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6809","nonce":497583447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6811","nonce":497583447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6815","nonce":497583447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6813","nonce":497583447}]},"public_addr":"172.21.15.149:6809/497583447","cluster_addr":"172.21.15.149:6811/497583447","heartbeat_back_addr":"172.21.15.149:6815/497583447","heartbeat_front_addr":"172.21.15.149:6813/497583447","state":["exists","up"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":212,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6825","nonce":1853322645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6827","nonce":1853322645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6831","nonce":1853322645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6829","nonce":1853322645}]},"public_addr":"172.21.15.149:6825/1853322645","cluster_addr":"172.21.15.149:6827/1853322645","heartbeat_back_addr":"172.21.15.149:6831/1853322645","heartbeat_front_addr":"172.21.15.149:6829/1853322645","state":["exists","up"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":215,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6817","nonce":1872776196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6819","nonce":1872776196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6823","nonce":1872776196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6821","nonce":1872776196}]},"public_addr":"172.21.15.149:6817/1872776196","cluster_addr":"172.21.15.149:6819/1872776196","heartbeat_back_addr":"172.21.15.149:6823/1872776196","heartbeat_front_addr":"172.21.15.149:6821/1872776196","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.845585+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.467598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.110690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.614040+0000","dead_epoch":27},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.594902+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.591315+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.191972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.510686+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1","osds":[0,1]},{"pgid":"3.d","osds":[6,0]},{"pgid":"3.15","osds":[6,5]},{"pgid":"3.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:19:16.474 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T22:19:16.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:19:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:16.751 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":232,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:19:16.154230+0000","last_up_change":"2024-09-21T22:15:59.900683+0000","last_in_change":"2024-09-21T22:16:44.923178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:15:21.204402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:15:25.020799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T22:15:34.502611+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":72,"snap_epoch":207,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":218,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6817","nonce":1738784974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6819","nonce":1738784974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6823","nonce":1738784974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6821","nonce":1738784974}]},"public_addr":"172.21.15.134:6817/1738784974","cluster_addr":"172.21.15.134:6819/1738784974","heartbeat_back_addr":"172.21.15.134:6823/1738784974","heartbeat_front_addr":"172.21.15.134:6821/1738784974","state":["exists","up"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6825","nonce":3328015815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6827","nonce":3328015815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6831","nonce":3328015815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6829","nonce":3328015815}]},"public_addr":"172.21.15.134:6825/3328015815","cluster_addr":"172.21.15.134:6827/3328015815","heartbeat_back_addr":"172.21.15.134:6831/3328015815","heartbeat_front_addr":"172.21.15.134:6829/3328015815","state":["exists","up"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":222,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6801","nonce":1987494452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6803","nonce":1987494452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6807","nonce":1987494452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6805","nonce":1987494452}]},"public_addr":"172.21.15.134:6801/1987494452","cluster_addr":"172.21.15.134:6803/1987494452","heartbeat_back_addr":"172.21.15.134:6807/1987494452","heartbeat_front_addr":"172.21.15.134:6805/1987494452","state":["exists","up"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":26,"up_from":45,"up_thru":203,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6809","nonce":704257458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6811","nonce":704257458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6815","nonce":704257458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6813","nonce":704257458}]},"public_addr":"172.21.15.134:6809/704257458","cluster_addr":"172.21.15.134:6811/704257458","heartbeat_back_addr":"172.21.15.134:6815/704257458","heartbeat_front_addr":"172.21.15.134:6813/704257458","state":["exists","up"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6801","nonce":1724687038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6803","nonce":1724687038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6807","nonce":1724687038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6805","nonce":1724687038}]},"public_addr":"172.21.15.149:6801/1724687038","cluster_addr":"172.21.15.149:6803/1724687038","heartbeat_back_addr":"172.21.15.149:6807/1724687038","heartbeat_front_addr":"172.21.15.149:6805/1724687038","state":["exists","up"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":226,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6809","nonce":497583447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6811","nonce":497583447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6815","nonce":497583447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6813","nonce":497583447}]},"public_addr":"172.21.15.149:6809/497583447","cluster_addr":"172.21.15.149:6811/497583447","heartbeat_back_addr":"172.21.15.149:6815/497583447","heartbeat_front_addr":"172.21.15.149:6813/497583447","state":["exists","up"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":212,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6825","nonce":1853322645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6827","nonce":1853322645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6831","nonce":1853322645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6829","nonce":1853322645}]},"public_addr":"172.21.15.149:6825/1853322645","cluster_addr":"172.21.15.149:6827/1853322645","heartbeat_back_addr":"172.21.15.149:6831/1853322645","heartbeat_front_addr":"172.21.15.149:6829/1853322645","state":["exists","up"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":215,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6817","nonce":1872776196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6819","nonce":1872776196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6823","nonce":1872776196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6821","nonce":1872776196}]},"public_addr":"172.21.15.149:6817/1872776196","cluster_addr":"172.21.15.149:6819/1872776196","heartbeat_back_addr":"172.21.15.149:6823/1872776196","heartbeat_front_addr":"172.21.15.149:6821/1872776196","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.845585+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.467598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.110690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.614040+0000","dead_epoch":27},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.594902+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.591315+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.191972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.510686+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1","osds":[0,1]},{"pgid":"3.d","osds":[6,0]},{"pgid":"3.15","osds":[6,5]},{"pgid":"3.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:19:16.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T22:19:16.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T22:19:16.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T22:19:16.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T22:19:16.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T22:19:16.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T22:19:16.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T22:19:16.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T22:19:17.011 INFO:teuthology.orchestra.run.smithi134.stdout:55834574898 2024-09-21T22:19:17.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:19:17.012 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:17.012 INFO:teuthology.orchestra.run.smithi134.stdout:55834574902 2024-09-21T22:19:17.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:19:17.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:19:17.014 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:17.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:19:17.015 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:17.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:19:17.016 INFO:teuthology.orchestra.run.smithi134.stdout:55834574900 2024-09-21T22:19:17.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:19:17.017 INFO:teuthology.orchestra.run.smithi134.stdout:193273528361 2024-09-21T22:19:17.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:19:17.018 INFO:teuthology.orchestra.run.smithi134.stdout:55834574900 2024-09-21T22:19:17.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:19:17.645 INFO:teuthology.orchestra.run.smithi134.stdout:55834574901 2024-09-21T22:19:17.646 INFO:teuthology.orchestra.run.smithi134.stdout:55834574898 2024-09-21T22:19:17.646 INFO:teuthology.orchestra.run.smithi134.stdout:55834574896 2024-09-21T22:19:17.652 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:17.655 INFO:teuthology.orchestra.run.smithi134.stdout:55834574898 2024-09-21T22:19:17.655 INFO:teuthology.orchestra.run.smithi134.stdout:55834574897 2024-09-21T22:19:17.664 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:17.666 INFO:teuthology.orchestra.run.smithi134.stdout:193273528360 2024-09-21T22:19:17.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574898 for osd.7 2024-09-21T22:19:17.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574896 for osd.1 2024-09-21T22:19:17.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574901 for osd.6 2024-09-21T22:19:17.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.5 2024-09-21T22:19:17.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574897 for osd.2 2024-09-21T22:19:17.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574898 for osd.4 2024-09-21T22:19:17.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.0 2024-09-21T22:19:17.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 193273528361 got 193273528360 for osd.3 2024-09-21T22:19:18.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:19:18.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:19:18.676 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:19:18.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:19:18.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:19:18.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:19:18.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:19:18.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:19:19.253 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:19.260 INFO:teuthology.orchestra.run.smithi134.stdout:55834574898 2024-09-21T22:19:19.260 INFO:teuthology.orchestra.run.smithi134.stdout:55834574902 2024-09-21T22:19:19.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574899 for osd.7 2024-09-21T22:19:19.277 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574898 for osd.1 2024-09-21T22:19:19.281 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574902 for osd.6 2024-09-21T22:19:19.282 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.296 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:19.298 INFO:teuthology.orchestra.run.smithi134.stdout:193273528362 2024-09-21T22:19:19.305 INFO:teuthology.orchestra.run.smithi134.stdout:55834574900 2024-09-21T22:19:19.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574899 for osd.2 2024-09-21T22:19:19.313 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 193273528361 got 193273528362 for osd.3 2024-09-21T22:19:19.315 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.318 INFO:teuthology.orchestra.run.smithi134.stdout:55834574899 2024-09-21T22:19:19.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.5 2024-09-21T22:19:19.319 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.328 INFO:teuthology.orchestra.run.smithi134.stdout:55834574900 2024-09-21T22:19:19.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574899 for osd.4 2024-09-21T22:19:19.335 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.0 2024-09-21T22:19:19.343 DEBUG:teuthology.parallel:result is None 2024-09-21T22:19:19.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:19:19.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:19:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:19.660 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:19:19.672 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-21T22:19:19.213018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216128,"num_read_kb":1301147,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1913,"num_bytes_recovered":167371473,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461132,"kb_used_data":23128,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754513588,"statfs":{"total":773094113280,"available":772621914112,"internally_reserved":0,"allocated":23683072,"data_stored":12290476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000996"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27916,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327991+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:19:16.327991+0000","last_peered":"2024-09-21T22:19:16.327991+0000","last_clean":"2024-09-21T22:19:16.327991+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:19:16.327991+0000","last_undegraded":"2024-09-21T22:19:16.327991+0000","last_fullsized":"2024-09-21T22:19:16.327991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:15.615057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"207'807","reported_seq":4691,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328121+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:19:16.328121+0000","last_peered":"2024-09-21T22:19:16.328121+0000","last_clean":"2024-09-21T22:19:16.328121+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:19:16.328121+0000","last_undegraded":"2024-09-21T22:19:16.328121+0000","last_fullsized":"2024-09-21T22:19:16.328121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"207'464","reported_seq":8635,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328173+0000","last_change":"2024-09-21T22:19:11.128355+0000","last_active":"2024-09-21T22:19:16.328173+0000","last_peered":"2024-09-21T22:19:16.328173+0000","last_clean":"2024-09-21T22:19:16.328173+0000","last_became_active":"2024-09-21T22:19:11.126877+0000","last_became_peered":"2024-09-21T22:19:11.126877+0000","last_unstale":"2024-09-21T22:19:16.328173+0000","last_undegraded":"2024-09-21T22:19:16.328173+0000","last_fullsized":"2024-09-21T22:19:16.328173+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:53.817301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"207'919","reported_seq":3876,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328434+0000","last_change":"2024-09-21T22:19:11.128365+0000","last_active":"2024-09-21T22:19:16.328434+0000","last_peered":"2024-09-21T22:19:16.328434+0000","last_clean":"2024-09-21T22:19:16.328434+0000","last_became_active":"2024-09-21T22:19:11.127057+0000","last_became_peered":"2024-09-21T22:19:11.127057+0000","last_unstale":"2024-09-21T22:19:16.328434+0000","last_undegraded":"2024-09-21T22:19:16.328434+0000","last_fullsized":"2024-09-21T22:19:16.328434+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:53.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4692,"num_read_kb":35493,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"206'513","reported_seq":11185,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327840+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:19:16.327840+0000","last_peered":"2024-09-21T22:19:16.327840+0000","last_clean":"2024-09-21T22:19:16.327840+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:19:16.327840+0000","last_undegraded":"2024-09-21T22:19:16.327840+0000","last_fullsized":"2024-09-21T22:19:16.327840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:19.092862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'362","reported_seq":3334,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166318+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:19:16.166318+0000","last_peered":"2024-09-21T22:19:16.166318+0000","last_clean":"2024-09-21T22:19:16.166318+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:19:16.166318+0000","last_undegraded":"2024-09-21T22:19:16.166318+0000","last_fullsized":"2024-09-21T22:19:16.166318+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"206'814","reported_seq":4125,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165522+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:19:16.165522+0000","last_peered":"2024-09-21T22:19:16.165522+0000","last_clean":"2024-09-21T22:19:16.165522+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:19:16.165522+0000","last_undegraded":"2024-09-21T22:19:16.165522+0000","last_fullsized":"2024-09-21T22:19:16.165522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"204'840","reported_seq":2846,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327609+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:19:16.327609+0000","last_peered":"2024-09-21T22:19:16.327609+0000","last_clean":"2024-09-21T22:19:16.327609+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:19:16.327609+0000","last_undegraded":"2024-09-21T22:19:16.327609+0000","last_fullsized":"2024-09-21T22:19:16.327609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"206'1170","reported_seq":4063,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328041+0000","last_change":"2024-09-21T22:18:48.031440+0000","last_active":"2024-09-21T22:19:16.328041+0000","last_peered":"2024-09-21T22:19:16.328041+0000","last_clean":"2024-09-21T22:19:16.328041+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:19:16.328041+0000","last_undegraded":"2024-09-21T22:19:16.328041+0000","last_fullsized":"2024-09-21T22:19:16.328041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:05.561479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"207'318","reported_seq":14493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165615+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:19:16.165615+0000","last_peered":"2024-09-21T22:19:16.165615+0000","last_clean":"2024-09-21T22:19:16.165615+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:19:16.165615+0000","last_undegraded":"2024-09-21T22:19:16.165615+0000","last_fullsized":"2024-09-21T22:19:16.165615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"207'898","reported_seq":3862,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327916+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:19:16.327916+0000","last_peered":"2024-09-21T22:19:16.327916+0000","last_clean":"2024-09-21T22:19:16.327916+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:19:16.327916+0000","last_undegraded":"2024-09-21T22:19:16.327916+0000","last_fullsized":"2024-09-21T22:19:16.327916+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"205'1008","reported_seq":5151,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166510+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:19:16.166510+0000","last_peered":"2024-09-21T22:19:16.166510+0000","last_clean":"2024-09-21T22:19:16.166510+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:19:16.166510+0000","last_undegraded":"2024-09-21T22:19:16.166510+0000","last_fullsized":"2024-09-21T22:19:16.166510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":445,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328029+0000","last_change":"2024-09-21T22:18:54.034627+0000","last_active":"2024-09-21T22:19:16.328029+0000","last_peered":"2024-09-21T22:19:16.328029+0000","last_clean":"2024-09-21T22:19:16.328029+0000","last_became_active":"2024-09-21T22:18:54.034243+0000","last_became_peered":"2024-09-21T22:18:54.034243+0000","last_unstale":"2024-09-21T22:19:16.328029+0000","last_undegraded":"2024-09-21T22:19:16.328029+0000","last_fullsized":"2024-09-21T22:19:16.328029+0000","mapping_epoch":212,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:11:55.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4227,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327895+0000","last_change":"2024-09-21T22:18:48.031413+0000","last_active":"2024-09-21T22:19:16.327895+0000","last_peered":"2024-09-21T22:19:16.327895+0000","last_clean":"2024-09-21T22:19:16.327895+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:19:16.327895+0000","last_undegraded":"2024-09-21T22:19:16.327895+0000","last_fullsized":"2024-09-21T22:19:16.327895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:52.106117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165706+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:19:16.165706+0000","last_peered":"2024-09-21T22:19:16.165706+0000","last_clean":"2024-09-21T22:19:16.165706+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:19:16.165706+0000","last_undegraded":"2024-09-21T22:19:16.165706+0000","last_fullsized":"2024-09-21T22:19:16.165706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11255,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327866+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:19:16.327866+0000","last_peered":"2024-09-21T22:19:16.327866+0000","last_clean":"2024-09-21T22:19:16.327866+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:19:16.327866+0000","last_undegraded":"2024-09-21T22:19:16.327866+0000","last_fullsized":"2024-09-21T22:19:16.327866+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328305+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:19:16.328305+0000","last_peered":"2024-09-21T22:19:16.328305+0000","last_clean":"2024-09-21T22:19:16.328305+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:19:16.328305+0000","last_undegraded":"2024-09-21T22:19:16.328305+0000","last_fullsized":"2024-09-21T22:19:16.328305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10295,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165605+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:19:16.165605+0000","last_peered":"2024-09-21T22:19:16.165605+0000","last_clean":"2024-09-21T22:19:16.165605+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:19:16.165605+0000","last_undegraded":"2024-09-21T22:19:16.165605+0000","last_fullsized":"2024-09-21T22:19:16.165605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165602+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:19:16.165602+0000","last_peered":"2024-09-21T22:19:16.165602+0000","last_clean":"2024-09-21T22:19:16.165602+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:19:16.165602+0000","last_undegraded":"2024-09-21T22:19:16.165602+0000","last_fullsized":"2024-09-21T22:19:16.165602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14477,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.131577+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130054+0000","last_became_peered":"2024-09-21T22:19:11.130054+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:46:55.850653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021147060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"207'770","reported_seq":4367,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166492+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:19:16.166492+0000","last_peered":"2024-09-21T22:19:16.166492+0000","last_clean":"2024-09-21T22:19:16.166492+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:19:16.166492+0000","last_undegraded":"2024-09-21T22:19:16.166492+0000","last_fullsized":"2024-09-21T22:19:16.166492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":198,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327952+0000","last_change":"2024-09-21T22:19:11.127849+0000","last_active":"2024-09-21T22:19:16.327952+0000","last_peered":"2024-09-21T22:19:16.327952+0000","last_clean":"2024-09-21T22:19:16.327952+0000","last_became_active":"2024-09-21T22:19:11.127479+0000","last_became_peered":"2024-09-21T22:19:11.127479+0000","last_unstale":"2024-09-21T22:19:16.327952+0000","last_undegraded":"2024-09-21T22:19:16.327952+0000","last_fullsized":"2024-09-21T22:19:16.327952+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:49.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165471+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:19:16.165471+0000","last_peered":"2024-09-21T22:19:16.165471+0000","last_clean":"2024-09-21T22:19:16.165471+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:19:16.165471+0000","last_undegraded":"2024-09-21T22:19:16.165471+0000","last_fullsized":"2024-09-21T22:19:16.165471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":394,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.167402+0000","last_change":"2024-09-21T22:19:07.095338+0000","last_active":"2024-09-21T22:19:16.167402+0000","last_peered":"2024-09-21T22:19:16.167402+0000","last_clean":"2024-09-21T22:19:16.167402+0000","last_became_active":"2024-09-21T22:19:07.095030+0000","last_became_peered":"2024-09-21T22:19:07.095030+0000","last_unstale":"2024-09-21T22:19:16.167402+0000","last_undegraded":"2024-09-21T22:19:16.167402+0000","last_fullsized":"2024-09-21T22:19:16.167402+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:55.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2623,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327719+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:19:16.327719+0000","last_peered":"2024-09-21T22:19:16.327719+0000","last_clean":"2024-09-21T22:19:16.327719+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:19:16.327719+0000","last_undegraded":"2024-09-21T22:19:16.327719+0000","last_fullsized":"2024-09-21T22:19:16.327719+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:45.211773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328201+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:19:16.328201+0000","last_peered":"2024-09-21T22:19:16.328201+0000","last_clean":"2024-09-21T22:19:16.328201+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:19:16.328201+0000","last_undegraded":"2024-09-21T22:19:16.328201+0000","last_fullsized":"2024-09-21T22:19:16.328201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1840,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327990+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:19:16.327990+0000","last_peered":"2024-09-21T22:19:16.327990+0000","last_clean":"2024-09-21T22:19:16.327990+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:19:16.327990+0000","last_undegraded":"2024-09-21T22:19:16.327990+0000","last_fullsized":"2024-09-21T22:19:16.327990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":256,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.130435+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130057+0000","last_became_peered":"2024-09-21T22:19:11.130057+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:32.125867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328122+0000","last_change":"2024-09-21T22:18:56.918903+0000","last_active":"2024-09-21T22:19:16.328122+0000","last_peered":"2024-09-21T22:19:16.328122+0000","last_clean":"2024-09-21T22:19:16.328122+0000","last_became_active":"2024-09-21T22:18:56.918614+0000","last_became_peered":"2024-09-21T22:18:56.918614+0000","last_unstale":"2024-09-21T22:19:16.328122+0000","last_undegraded":"2024-09-21T22:19:16.328122+0000","last_fullsized":"2024-09-21T22:19:16.328122+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:34.257530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2368,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327723+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:19:16.327723+0000","last_peered":"2024-09-21T22:19:16.327723+0000","last_clean":"2024-09-21T22:19:16.327723+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:19:16.327723+0000","last_undegraded":"2024-09-21T22:19:16.327723+0000","last_fullsized":"2024-09-21T22:19:16.327723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"207'563","reported_seq":4572,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166221+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:19:16.166221+0000","last_peered":"2024-09-21T22:19:16.166221+0000","last_clean":"2024-09-21T22:19:16.166221+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:19:16.166221+0000","last_undegraded":"2024-09-21T22:19:16.166221+0000","last_fullsized":"2024-09-21T22:19:16.166221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"199'839","reported_seq":3502,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328095+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:19:16.328095+0000","last_peered":"2024-09-21T22:19:16.328095+0000","last_clean":"2024-09-21T22:19:16.328095+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:19:16.328095+0000","last_undegraded":"2024-09-21T22:19:16.328095+0000","last_fullsized":"2024-09-21T22:19:16.328095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"206'863","reported_seq":3114,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327984+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:19:16.327984+0000","last_peered":"2024-09-21T22:19:16.327984+0000","last_clean":"2024-09-21T22:19:16.327984+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:19:16.327984+0000","last_undegraded":"2024-09-21T22:19:16.327984+0000","last_fullsized":"2024-09-21T22:19:16.327984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"206'503","reported_seq":1977,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328437+0000","last_change":"2024-09-21T22:19:11.131326+0000","last_active":"2024-09-21T22:19:16.328437+0000","last_peered":"2024-09-21T22:19:16.328437+0000","last_clean":"2024-09-21T22:19:16.328437+0000","last_became_active":"2024-09-21T22:19:11.130432+0000","last_became_peered":"2024-09-21T22:19:11.130432+0000","last_unstale":"2024-09-21T22:19:16.328437+0000","last_undegraded":"2024-09-21T22:19:16.328437+0000","last_fullsized":"2024-09-21T22:19:16.328437+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:34.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017990440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1732,"num_read_kb":37996,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"204'655","reported_seq":2836,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328101+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:19:16.328101+0000","last_peered":"2024-09-21T22:19:16.328101+0000","last_clean":"2024-09-21T22:19:16.328101+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:19:16.328101+0000","last_undegraded":"2024-09-21T22:19:16.328101+0000","last_fullsized":"2024-09-21T22:19:16.328101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"207'677","reported_seq":2301,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328226+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:19:16.328226+0000","last_peered":"2024-09-21T22:19:16.328226+0000","last_clean":"2024-09-21T22:19:16.328226+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:19:16.328226+0000","last_undegraded":"2024-09-21T22:19:16.328226+0000","last_fullsized":"2024-09-21T22:19:16.328226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"204'616","reported_seq":3004,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328411+0000","last_change":"2024-09-21T22:18:56.917619+0000","last_active":"2024-09-21T22:19:16.328411+0000","last_peered":"2024-09-21T22:19:16.328411+0000","last_clean":"2024-09-21T22:19:16.328411+0000","last_became_active":"2024-09-21T22:18:56.916154+0000","last_became_peered":"2024-09-21T22:18:56.916154+0000","last_unstale":"2024-09-21T22:19:16.328411+0000","last_undegraded":"2024-09-21T22:19:16.328411+0000","last_fullsized":"2024-09-21T22:19:16.328411+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:01:54.099402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"204'395","reported_seq":2607,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327871+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:19:16.327871+0000","last_peered":"2024-09-21T22:19:16.327871+0000","last_clean":"2024-09-21T22:19:16.327871+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:19:16.327871+0000","last_undegraded":"2024-09-21T22:19:16.327871+0000","last_fullsized":"2024-09-21T22:19:16.327871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"207'713","reported_seq":2509,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328215+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:19:16.328215+0000","last_peered":"2024-09-21T22:19:16.328215+0000","last_clean":"2024-09-21T22:19:16.328215+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:19:16.328215+0000","last_undegraded":"2024-09-21T22:19:16.328215+0000","last_fullsized":"2024-09-21T22:19:16.328215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"204'591","reported_seq":7439,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327708+0000","last_change":"2024-09-21T22:19:03.071739+0000","last_active":"2024-09-21T22:19:16.327708+0000","last_peered":"2024-09-21T22:19:16.327708+0000","last_clean":"2024-09-21T22:19:16.327708+0000","last_became_active":"2024-09-21T22:19:03.070891+0000","last_became_peered":"2024-09-21T22:19:03.070891+0000","last_unstale":"2024-09-21T22:19:16.327708+0000","last_undegraded":"2024-09-21T22:19:16.327708+0000","last_fullsized":"2024-09-21T22:19:16.327708+0000","mapping_epoch":218,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":219,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:52:13.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011971970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"207'699","reported_seq":12591,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328405+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:19:16.328405+0000","last_peered":"2024-09-21T22:19:16.328405+0000","last_clean":"2024-09-21T22:19:16.328405+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:19:16.328405+0000","last_undegraded":"2024-09-21T22:19:16.328405+0000","last_fullsized":"2024-09-21T22:19:16.328405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216012,"num_read_kb":1301047,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1909,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78928,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292912,"statfs":{"total":96636764160,"available":96555941888,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29776,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342064,"statfs":{"total":96636764160,"available":96606273536,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74196,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297644,"statfs":{"total":96636764160,"available":96560787456,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74192,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297648,"statfs":{"total":96636764160,"available":96560791552,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528362,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57228,"kb_used_data":2744,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314612,"statfs":{"total":96636764160,"available":96578162688,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42252,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329588,"statfs":{"total":96636764160,"available":96593498112,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33940,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337900,"statfs":{"total":96636764160,"available":96602009600,"internally_reserved":0,"allocated":2818048,"data_stored":1388746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70620,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301220,"statfs":{"total":96636764160,"available":96564449280,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:19:19.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:19:19.950 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:19.951 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:19:19.963 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-21T22:19:19.213018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216128,"num_read_kb":1301147,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1913,"num_bytes_recovered":167371473,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461132,"kb_used_data":23128,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754513588,"statfs":{"total":773094113280,"available":772621914112,"internally_reserved":0,"allocated":23683072,"data_stored":12290476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000996"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27916,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327991+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:19:16.327991+0000","last_peered":"2024-09-21T22:19:16.327991+0000","last_clean":"2024-09-21T22:19:16.327991+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:19:16.327991+0000","last_undegraded":"2024-09-21T22:19:16.327991+0000","last_fullsized":"2024-09-21T22:19:16.327991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:15.615057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"207'807","reported_seq":4691,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328121+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:19:16.328121+0000","last_peered":"2024-09-21T22:19:16.328121+0000","last_clean":"2024-09-21T22:19:16.328121+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:19:16.328121+0000","last_undegraded":"2024-09-21T22:19:16.328121+0000","last_fullsized":"2024-09-21T22:19:16.328121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"207'464","reported_seq":8635,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328173+0000","last_change":"2024-09-21T22:19:11.128355+0000","last_active":"2024-09-21T22:19:16.328173+0000","last_peered":"2024-09-21T22:19:16.328173+0000","last_clean":"2024-09-21T22:19:16.328173+0000","last_became_active":"2024-09-21T22:19:11.126877+0000","last_became_peered":"2024-09-21T22:19:11.126877+0000","last_unstale":"2024-09-21T22:19:16.328173+0000","last_undegraded":"2024-09-21T22:19:16.328173+0000","last_fullsized":"2024-09-21T22:19:16.328173+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:53.817301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"207'919","reported_seq":3876,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328434+0000","last_change":"2024-09-21T22:19:11.128365+0000","last_active":"2024-09-21T22:19:16.328434+0000","last_peered":"2024-09-21T22:19:16.328434+0000","last_clean":"2024-09-21T22:19:16.328434+0000","last_became_active":"2024-09-21T22:19:11.127057+0000","last_became_peered":"2024-09-21T22:19:11.127057+0000","last_unstale":"2024-09-21T22:19:16.328434+0000","last_undegraded":"2024-09-21T22:19:16.328434+0000","last_fullsized":"2024-09-21T22:19:16.328434+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:53.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4692,"num_read_kb":35493,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"206'513","reported_seq":11185,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327840+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:19:16.327840+0000","last_peered":"2024-09-21T22:19:16.327840+0000","last_clean":"2024-09-21T22:19:16.327840+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:19:16.327840+0000","last_undegraded":"2024-09-21T22:19:16.327840+0000","last_fullsized":"2024-09-21T22:19:16.327840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:19.092862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'362","reported_seq":3334,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166318+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:19:16.166318+0000","last_peered":"2024-09-21T22:19:16.166318+0000","last_clean":"2024-09-21T22:19:16.166318+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:19:16.166318+0000","last_undegraded":"2024-09-21T22:19:16.166318+0000","last_fullsized":"2024-09-21T22:19:16.166318+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"206'814","reported_seq":4125,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165522+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:19:16.165522+0000","last_peered":"2024-09-21T22:19:16.165522+0000","last_clean":"2024-09-21T22:19:16.165522+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:19:16.165522+0000","last_undegraded":"2024-09-21T22:19:16.165522+0000","last_fullsized":"2024-09-21T22:19:16.165522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"204'840","reported_seq":2846,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327609+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:19:16.327609+0000","last_peered":"2024-09-21T22:19:16.327609+0000","last_clean":"2024-09-21T22:19:16.327609+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:19:16.327609+0000","last_undegraded":"2024-09-21T22:19:16.327609+0000","last_fullsized":"2024-09-21T22:19:16.327609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"206'1170","reported_seq":4063,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328041+0000","last_change":"2024-09-21T22:18:48.031440+0000","last_active":"2024-09-21T22:19:16.328041+0000","last_peered":"2024-09-21T22:19:16.328041+0000","last_clean":"2024-09-21T22:19:16.328041+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:19:16.328041+0000","last_undegraded":"2024-09-21T22:19:16.328041+0000","last_fullsized":"2024-09-21T22:19:16.328041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:05.561479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"207'318","reported_seq":14493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165615+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:19:16.165615+0000","last_peered":"2024-09-21T22:19:16.165615+0000","last_clean":"2024-09-21T22:19:16.165615+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:19:16.165615+0000","last_undegraded":"2024-09-21T22:19:16.165615+0000","last_fullsized":"2024-09-21T22:19:16.165615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"207'898","reported_seq":3862,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327916+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:19:16.327916+0000","last_peered":"2024-09-21T22:19:16.327916+0000","last_clean":"2024-09-21T22:19:16.327916+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:19:16.327916+0000","last_undegraded":"2024-09-21T22:19:16.327916+0000","last_fullsized":"2024-09-21T22:19:16.327916+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"205'1008","reported_seq":5151,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166510+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:19:16.166510+0000","last_peered":"2024-09-21T22:19:16.166510+0000","last_clean":"2024-09-21T22:19:16.166510+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:19:16.166510+0000","last_undegraded":"2024-09-21T22:19:16.166510+0000","last_fullsized":"2024-09-21T22:19:16.166510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":445,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328029+0000","last_change":"2024-09-21T22:18:54.034627+0000","last_active":"2024-09-21T22:19:16.328029+0000","last_peered":"2024-09-21T22:19:16.328029+0000","last_clean":"2024-09-21T22:19:16.328029+0000","last_became_active":"2024-09-21T22:18:54.034243+0000","last_became_peered":"2024-09-21T22:18:54.034243+0000","last_unstale":"2024-09-21T22:19:16.328029+0000","last_undegraded":"2024-09-21T22:19:16.328029+0000","last_fullsized":"2024-09-21T22:19:16.328029+0000","mapping_epoch":212,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:11:55.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4227,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327895+0000","last_change":"2024-09-21T22:18:48.031413+0000","last_active":"2024-09-21T22:19:16.327895+0000","last_peered":"2024-09-21T22:19:16.327895+0000","last_clean":"2024-09-21T22:19:16.327895+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:19:16.327895+0000","last_undegraded":"2024-09-21T22:19:16.327895+0000","last_fullsized":"2024-09-21T22:19:16.327895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:52.106117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165706+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:19:16.165706+0000","last_peered":"2024-09-21T22:19:16.165706+0000","last_clean":"2024-09-21T22:19:16.165706+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:19:16.165706+0000","last_undegraded":"2024-09-21T22:19:16.165706+0000","last_fullsized":"2024-09-21T22:19:16.165706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11255,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327866+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:19:16.327866+0000","last_peered":"2024-09-21T22:19:16.327866+0000","last_clean":"2024-09-21T22:19:16.327866+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:19:16.327866+0000","last_undegraded":"2024-09-21T22:19:16.327866+0000","last_fullsized":"2024-09-21T22:19:16.327866+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328305+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:19:16.328305+0000","last_peered":"2024-09-21T22:19:16.328305+0000","last_clean":"2024-09-21T22:19:16.328305+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:19:16.328305+0000","last_undegraded":"2024-09-21T22:19:16.328305+0000","last_fullsized":"2024-09-21T22:19:16.328305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10295,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165605+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:19:16.165605+0000","last_peered":"2024-09-21T22:19:16.165605+0000","last_clean":"2024-09-21T22:19:16.165605+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:19:16.165605+0000","last_undegraded":"2024-09-21T22:19:16.165605+0000","last_fullsized":"2024-09-21T22:19:16.165605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165602+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:19:16.165602+0000","last_peered":"2024-09-21T22:19:16.165602+0000","last_clean":"2024-09-21T22:19:16.165602+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:19:16.165602+0000","last_undegraded":"2024-09-21T22:19:16.165602+0000","last_fullsized":"2024-09-21T22:19:16.165602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14477,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.131577+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130054+0000","last_became_peered":"2024-09-21T22:19:11.130054+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:46:55.850653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021147060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"207'770","reported_seq":4367,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166492+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:19:16.166492+0000","last_peered":"2024-09-21T22:19:16.166492+0000","last_clean":"2024-09-21T22:19:16.166492+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:19:16.166492+0000","last_undegraded":"2024-09-21T22:19:16.166492+0000","last_fullsized":"2024-09-21T22:19:16.166492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":198,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327952+0000","last_change":"2024-09-21T22:19:11.127849+0000","last_active":"2024-09-21T22:19:16.327952+0000","last_peered":"2024-09-21T22:19:16.327952+0000","last_clean":"2024-09-21T22:19:16.327952+0000","last_became_active":"2024-09-21T22:19:11.127479+0000","last_became_peered":"2024-09-21T22:19:11.127479+0000","last_unstale":"2024-09-21T22:19:16.327952+0000","last_undegraded":"2024-09-21T22:19:16.327952+0000","last_fullsized":"2024-09-21T22:19:16.327952+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:49.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165471+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:19:16.165471+0000","last_peered":"2024-09-21T22:19:16.165471+0000","last_clean":"2024-09-21T22:19:16.165471+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:19:16.165471+0000","last_undegraded":"2024-09-21T22:19:16.165471+0000","last_fullsized":"2024-09-21T22:19:16.165471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":394,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.167402+0000","last_change":"2024-09-21T22:19:07.095338+0000","last_active":"2024-09-21T22:19:16.167402+0000","last_peered":"2024-09-21T22:19:16.167402+0000","last_clean":"2024-09-21T22:19:16.167402+0000","last_became_active":"2024-09-21T22:19:07.095030+0000","last_became_peered":"2024-09-21T22:19:07.095030+0000","last_unstale":"2024-09-21T22:19:16.167402+0000","last_undegraded":"2024-09-21T22:19:16.167402+0000","last_fullsized":"2024-09-21T22:19:16.167402+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:55.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2623,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327719+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:19:16.327719+0000","last_peered":"2024-09-21T22:19:16.327719+0000","last_clean":"2024-09-21T22:19:16.327719+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:19:16.327719+0000","last_undegraded":"2024-09-21T22:19:16.327719+0000","last_fullsized":"2024-09-21T22:19:16.327719+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:45.211773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328201+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:19:16.328201+0000","last_peered":"2024-09-21T22:19:16.328201+0000","last_clean":"2024-09-21T22:19:16.328201+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:19:16.328201+0000","last_undegraded":"2024-09-21T22:19:16.328201+0000","last_fullsized":"2024-09-21T22:19:16.328201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1840,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327990+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:19:16.327990+0000","last_peered":"2024-09-21T22:19:16.327990+0000","last_clean":"2024-09-21T22:19:16.327990+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:19:16.327990+0000","last_undegraded":"2024-09-21T22:19:16.327990+0000","last_fullsized":"2024-09-21T22:19:16.327990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":256,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.130435+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130057+0000","last_became_peered":"2024-09-21T22:19:11.130057+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:32.125867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328122+0000","last_change":"2024-09-21T22:18:56.918903+0000","last_active":"2024-09-21T22:19:16.328122+0000","last_peered":"2024-09-21T22:19:16.328122+0000","last_clean":"2024-09-21T22:19:16.328122+0000","last_became_active":"2024-09-21T22:18:56.918614+0000","last_became_peered":"2024-09-21T22:18:56.918614+0000","last_unstale":"2024-09-21T22:19:16.328122+0000","last_undegraded":"2024-09-21T22:19:16.328122+0000","last_fullsized":"2024-09-21T22:19:16.328122+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:34.257530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2368,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327723+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:19:16.327723+0000","last_peered":"2024-09-21T22:19:16.327723+0000","last_clean":"2024-09-21T22:19:16.327723+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:19:16.327723+0000","last_undegraded":"2024-09-21T22:19:16.327723+0000","last_fullsized":"2024-09-21T22:19:16.327723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"207'563","reported_seq":4572,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166221+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:19:16.166221+0000","last_peered":"2024-09-21T22:19:16.166221+0000","last_clean":"2024-09-21T22:19:16.166221+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:19:16.166221+0000","last_undegraded":"2024-09-21T22:19:16.166221+0000","last_fullsized":"2024-09-21T22:19:16.166221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"199'839","reported_seq":3502,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328095+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:19:16.328095+0000","last_peered":"2024-09-21T22:19:16.328095+0000","last_clean":"2024-09-21T22:19:16.328095+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:19:16.328095+0000","last_undegraded":"2024-09-21T22:19:16.328095+0000","last_fullsized":"2024-09-21T22:19:16.328095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"206'863","reported_seq":3114,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327984+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:19:16.327984+0000","last_peered":"2024-09-21T22:19:16.327984+0000","last_clean":"2024-09-21T22:19:16.327984+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:19:16.327984+0000","last_undegraded":"2024-09-21T22:19:16.327984+0000","last_fullsized":"2024-09-21T22:19:16.327984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"206'503","reported_seq":1977,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328437+0000","last_change":"2024-09-21T22:19:11.131326+0000","last_active":"2024-09-21T22:19:16.328437+0000","last_peered":"2024-09-21T22:19:16.328437+0000","last_clean":"2024-09-21T22:19:16.328437+0000","last_became_active":"2024-09-21T22:19:11.130432+0000","last_became_peered":"2024-09-21T22:19:11.130432+0000","last_unstale":"2024-09-21T22:19:16.328437+0000","last_undegraded":"2024-09-21T22:19:16.328437+0000","last_fullsized":"2024-09-21T22:19:16.328437+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:34.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017990440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1732,"num_read_kb":37996,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"204'655","reported_seq":2836,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328101+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:19:16.328101+0000","last_peered":"2024-09-21T22:19:16.328101+0000","last_clean":"2024-09-21T22:19:16.328101+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:19:16.328101+0000","last_undegraded":"2024-09-21T22:19:16.328101+0000","last_fullsized":"2024-09-21T22:19:16.328101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"207'677","reported_seq":2301,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328226+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:19:16.328226+0000","last_peered":"2024-09-21T22:19:16.328226+0000","last_clean":"2024-09-21T22:19:16.328226+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:19:16.328226+0000","last_undegraded":"2024-09-21T22:19:16.328226+0000","last_fullsized":"2024-09-21T22:19:16.328226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"204'616","reported_seq":3004,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328411+0000","last_change":"2024-09-21T22:18:56.917619+0000","last_active":"2024-09-21T22:19:16.328411+0000","last_peered":"2024-09-21T22:19:16.328411+0000","last_clean":"2024-09-21T22:19:16.328411+0000","last_became_active":"2024-09-21T22:18:56.916154+0000","last_became_peered":"2024-09-21T22:18:56.916154+0000","last_unstale":"2024-09-21T22:19:16.328411+0000","last_undegraded":"2024-09-21T22:19:16.328411+0000","last_fullsized":"2024-09-21T22:19:16.328411+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:01:54.099402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"204'395","reported_seq":2607,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327871+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:19:16.327871+0000","last_peered":"2024-09-21T22:19:16.327871+0000","last_clean":"2024-09-21T22:19:16.327871+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:19:16.327871+0000","last_undegraded":"2024-09-21T22:19:16.327871+0000","last_fullsized":"2024-09-21T22:19:16.327871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"207'713","reported_seq":2509,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328215+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:19:16.328215+0000","last_peered":"2024-09-21T22:19:16.328215+0000","last_clean":"2024-09-21T22:19:16.328215+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:19:16.328215+0000","last_undegraded":"2024-09-21T22:19:16.328215+0000","last_fullsized":"2024-09-21T22:19:16.328215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"204'591","reported_seq":7439,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327708+0000","last_change":"2024-09-21T22:19:03.071739+0000","last_active":"2024-09-21T22:19:16.327708+0000","last_peered":"2024-09-21T22:19:16.327708+0000","last_clean":"2024-09-21T22:19:16.327708+0000","last_became_active":"2024-09-21T22:19:03.070891+0000","last_became_peered":"2024-09-21T22:19:03.070891+0000","last_unstale":"2024-09-21T22:19:16.327708+0000","last_undegraded":"2024-09-21T22:19:16.327708+0000","last_fullsized":"2024-09-21T22:19:16.327708+0000","mapping_epoch":218,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":219,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:52:13.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011971970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"207'699","reported_seq":12591,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328405+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:19:16.328405+0000","last_peered":"2024-09-21T22:19:16.328405+0000","last_clean":"2024-09-21T22:19:16.328405+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:19:16.328405+0000","last_undegraded":"2024-09-21T22:19:16.328405+0000","last_fullsized":"2024-09-21T22:19:16.328405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216012,"num_read_kb":1301047,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1909,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78928,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292912,"statfs":{"total":96636764160,"available":96555941888,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29776,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342064,"statfs":{"total":96636764160,"available":96606273536,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74196,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297644,"statfs":{"total":96636764160,"available":96560787456,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74192,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297648,"statfs":{"total":96636764160,"available":96560791552,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528362,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57228,"kb_used_data":2744,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314612,"statfs":{"total":96636764160,"available":96578162688,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42252,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329588,"statfs":{"total":96636764160,"available":96593498112,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33940,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337900,"statfs":{"total":96636764160,"available":96602009600,"internally_reserved":0,"allocated":2818048,"data_stored":1388746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70620,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301220,"statfs":{"total":96636764160,"available":96564449280,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:19:19.965 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:19:19.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-21T22:19:20.261 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T22:19:20.270 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T22:19:20.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:19:20.548 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:20.549 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:19:20.561 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-21T22:19:19.213018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216128,"num_read_kb":1301147,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1913,"num_bytes_recovered":167371473,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461132,"kb_used_data":23128,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754513588,"statfs":{"total":773094113280,"available":772621914112,"internally_reserved":0,"allocated":23683072,"data_stored":12290476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000996"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27916,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327991+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:19:16.327991+0000","last_peered":"2024-09-21T22:19:16.327991+0000","last_clean":"2024-09-21T22:19:16.327991+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:19:16.327991+0000","last_undegraded":"2024-09-21T22:19:16.327991+0000","last_fullsized":"2024-09-21T22:19:16.327991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:15.615057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"207'807","reported_seq":4691,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328121+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:19:16.328121+0000","last_peered":"2024-09-21T22:19:16.328121+0000","last_clean":"2024-09-21T22:19:16.328121+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:19:16.328121+0000","last_undegraded":"2024-09-21T22:19:16.328121+0000","last_fullsized":"2024-09-21T22:19:16.328121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"207'464","reported_seq":8635,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328173+0000","last_change":"2024-09-21T22:19:11.128355+0000","last_active":"2024-09-21T22:19:16.328173+0000","last_peered":"2024-09-21T22:19:16.328173+0000","last_clean":"2024-09-21T22:19:16.328173+0000","last_became_active":"2024-09-21T22:19:11.126877+0000","last_became_peered":"2024-09-21T22:19:11.126877+0000","last_unstale":"2024-09-21T22:19:16.328173+0000","last_undegraded":"2024-09-21T22:19:16.328173+0000","last_fullsized":"2024-09-21T22:19:16.328173+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:53.817301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"207'919","reported_seq":3876,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328434+0000","last_change":"2024-09-21T22:19:11.128365+0000","last_active":"2024-09-21T22:19:16.328434+0000","last_peered":"2024-09-21T22:19:16.328434+0000","last_clean":"2024-09-21T22:19:16.328434+0000","last_became_active":"2024-09-21T22:19:11.127057+0000","last_became_peered":"2024-09-21T22:19:11.127057+0000","last_unstale":"2024-09-21T22:19:16.328434+0000","last_undegraded":"2024-09-21T22:19:16.328434+0000","last_fullsized":"2024-09-21T22:19:16.328434+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:53.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4692,"num_read_kb":35493,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"206'513","reported_seq":11185,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327840+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:19:16.327840+0000","last_peered":"2024-09-21T22:19:16.327840+0000","last_clean":"2024-09-21T22:19:16.327840+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:19:16.327840+0000","last_undegraded":"2024-09-21T22:19:16.327840+0000","last_fullsized":"2024-09-21T22:19:16.327840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:19.092862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'362","reported_seq":3334,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166318+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:19:16.166318+0000","last_peered":"2024-09-21T22:19:16.166318+0000","last_clean":"2024-09-21T22:19:16.166318+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:19:16.166318+0000","last_undegraded":"2024-09-21T22:19:16.166318+0000","last_fullsized":"2024-09-21T22:19:16.166318+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"206'814","reported_seq":4125,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165522+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:19:16.165522+0000","last_peered":"2024-09-21T22:19:16.165522+0000","last_clean":"2024-09-21T22:19:16.165522+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:19:16.165522+0000","last_undegraded":"2024-09-21T22:19:16.165522+0000","last_fullsized":"2024-09-21T22:19:16.165522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"204'840","reported_seq":2846,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327609+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:19:16.327609+0000","last_peered":"2024-09-21T22:19:16.327609+0000","last_clean":"2024-09-21T22:19:16.327609+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:19:16.327609+0000","last_undegraded":"2024-09-21T22:19:16.327609+0000","last_fullsized":"2024-09-21T22:19:16.327609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"206'1170","reported_seq":4063,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328041+0000","last_change":"2024-09-21T22:18:48.031440+0000","last_active":"2024-09-21T22:19:16.328041+0000","last_peered":"2024-09-21T22:19:16.328041+0000","last_clean":"2024-09-21T22:19:16.328041+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:19:16.328041+0000","last_undegraded":"2024-09-21T22:19:16.328041+0000","last_fullsized":"2024-09-21T22:19:16.328041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:05.561479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"207'318","reported_seq":14493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165615+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:19:16.165615+0000","last_peered":"2024-09-21T22:19:16.165615+0000","last_clean":"2024-09-21T22:19:16.165615+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:19:16.165615+0000","last_undegraded":"2024-09-21T22:19:16.165615+0000","last_fullsized":"2024-09-21T22:19:16.165615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"207'898","reported_seq":3862,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327916+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:19:16.327916+0000","last_peered":"2024-09-21T22:19:16.327916+0000","last_clean":"2024-09-21T22:19:16.327916+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:19:16.327916+0000","last_undegraded":"2024-09-21T22:19:16.327916+0000","last_fullsized":"2024-09-21T22:19:16.327916+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"205'1008","reported_seq":5151,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166510+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:19:16.166510+0000","last_peered":"2024-09-21T22:19:16.166510+0000","last_clean":"2024-09-21T22:19:16.166510+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:19:16.166510+0000","last_undegraded":"2024-09-21T22:19:16.166510+0000","last_fullsized":"2024-09-21T22:19:16.166510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":445,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328029+0000","last_change":"2024-09-21T22:18:54.034627+0000","last_active":"2024-09-21T22:19:16.328029+0000","last_peered":"2024-09-21T22:19:16.328029+0000","last_clean":"2024-09-21T22:19:16.328029+0000","last_became_active":"2024-09-21T22:18:54.034243+0000","last_became_peered":"2024-09-21T22:18:54.034243+0000","last_unstale":"2024-09-21T22:19:16.328029+0000","last_undegraded":"2024-09-21T22:19:16.328029+0000","last_fullsized":"2024-09-21T22:19:16.328029+0000","mapping_epoch":212,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:11:55.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4227,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327895+0000","last_change":"2024-09-21T22:18:48.031413+0000","last_active":"2024-09-21T22:19:16.327895+0000","last_peered":"2024-09-21T22:19:16.327895+0000","last_clean":"2024-09-21T22:19:16.327895+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:19:16.327895+0000","last_undegraded":"2024-09-21T22:19:16.327895+0000","last_fullsized":"2024-09-21T22:19:16.327895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:52.106117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165706+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:19:16.165706+0000","last_peered":"2024-09-21T22:19:16.165706+0000","last_clean":"2024-09-21T22:19:16.165706+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:19:16.165706+0000","last_undegraded":"2024-09-21T22:19:16.165706+0000","last_fullsized":"2024-09-21T22:19:16.165706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11255,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327866+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:19:16.327866+0000","last_peered":"2024-09-21T22:19:16.327866+0000","last_clean":"2024-09-21T22:19:16.327866+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:19:16.327866+0000","last_undegraded":"2024-09-21T22:19:16.327866+0000","last_fullsized":"2024-09-21T22:19:16.327866+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328305+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:19:16.328305+0000","last_peered":"2024-09-21T22:19:16.328305+0000","last_clean":"2024-09-21T22:19:16.328305+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:19:16.328305+0000","last_undegraded":"2024-09-21T22:19:16.328305+0000","last_fullsized":"2024-09-21T22:19:16.328305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10295,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165605+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:19:16.165605+0000","last_peered":"2024-09-21T22:19:16.165605+0000","last_clean":"2024-09-21T22:19:16.165605+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:19:16.165605+0000","last_undegraded":"2024-09-21T22:19:16.165605+0000","last_fullsized":"2024-09-21T22:19:16.165605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165602+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:19:16.165602+0000","last_peered":"2024-09-21T22:19:16.165602+0000","last_clean":"2024-09-21T22:19:16.165602+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:19:16.165602+0000","last_undegraded":"2024-09-21T22:19:16.165602+0000","last_fullsized":"2024-09-21T22:19:16.165602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14477,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.131577+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130054+0000","last_became_peered":"2024-09-21T22:19:11.130054+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:46:55.850653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021147060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"207'770","reported_seq":4367,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166492+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:19:16.166492+0000","last_peered":"2024-09-21T22:19:16.166492+0000","last_clean":"2024-09-21T22:19:16.166492+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:19:16.166492+0000","last_undegraded":"2024-09-21T22:19:16.166492+0000","last_fullsized":"2024-09-21T22:19:16.166492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":198,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327952+0000","last_change":"2024-09-21T22:19:11.127849+0000","last_active":"2024-09-21T22:19:16.327952+0000","last_peered":"2024-09-21T22:19:16.327952+0000","last_clean":"2024-09-21T22:19:16.327952+0000","last_became_active":"2024-09-21T22:19:11.127479+0000","last_became_peered":"2024-09-21T22:19:11.127479+0000","last_unstale":"2024-09-21T22:19:16.327952+0000","last_undegraded":"2024-09-21T22:19:16.327952+0000","last_fullsized":"2024-09-21T22:19:16.327952+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:49.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165471+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:19:16.165471+0000","last_peered":"2024-09-21T22:19:16.165471+0000","last_clean":"2024-09-21T22:19:16.165471+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:19:16.165471+0000","last_undegraded":"2024-09-21T22:19:16.165471+0000","last_fullsized":"2024-09-21T22:19:16.165471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":394,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.167402+0000","last_change":"2024-09-21T22:19:07.095338+0000","last_active":"2024-09-21T22:19:16.167402+0000","last_peered":"2024-09-21T22:19:16.167402+0000","last_clean":"2024-09-21T22:19:16.167402+0000","last_became_active":"2024-09-21T22:19:07.095030+0000","last_became_peered":"2024-09-21T22:19:07.095030+0000","last_unstale":"2024-09-21T22:19:16.167402+0000","last_undegraded":"2024-09-21T22:19:16.167402+0000","last_fullsized":"2024-09-21T22:19:16.167402+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:55.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2623,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327719+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:19:16.327719+0000","last_peered":"2024-09-21T22:19:16.327719+0000","last_clean":"2024-09-21T22:19:16.327719+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:19:16.327719+0000","last_undegraded":"2024-09-21T22:19:16.327719+0000","last_fullsized":"2024-09-21T22:19:16.327719+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:45.211773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328201+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:19:16.328201+0000","last_peered":"2024-09-21T22:19:16.328201+0000","last_clean":"2024-09-21T22:19:16.328201+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:19:16.328201+0000","last_undegraded":"2024-09-21T22:19:16.328201+0000","last_fullsized":"2024-09-21T22:19:16.328201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1840,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327990+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:19:16.327990+0000","last_peered":"2024-09-21T22:19:16.327990+0000","last_clean":"2024-09-21T22:19:16.327990+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:19:16.327990+0000","last_undegraded":"2024-09-21T22:19:16.327990+0000","last_fullsized":"2024-09-21T22:19:16.327990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":256,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.130435+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130057+0000","last_became_peered":"2024-09-21T22:19:11.130057+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:32.125867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328122+0000","last_change":"2024-09-21T22:18:56.918903+0000","last_active":"2024-09-21T22:19:16.328122+0000","last_peered":"2024-09-21T22:19:16.328122+0000","last_clean":"2024-09-21T22:19:16.328122+0000","last_became_active":"2024-09-21T22:18:56.918614+0000","last_became_peered":"2024-09-21T22:18:56.918614+0000","last_unstale":"2024-09-21T22:19:16.328122+0000","last_undegraded":"2024-09-21T22:19:16.328122+0000","last_fullsized":"2024-09-21T22:19:16.328122+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:34.257530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2368,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327723+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:19:16.327723+0000","last_peered":"2024-09-21T22:19:16.327723+0000","last_clean":"2024-09-21T22:19:16.327723+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:19:16.327723+0000","last_undegraded":"2024-09-21T22:19:16.327723+0000","last_fullsized":"2024-09-21T22:19:16.327723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"207'563","reported_seq":4572,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166221+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:19:16.166221+0000","last_peered":"2024-09-21T22:19:16.166221+0000","last_clean":"2024-09-21T22:19:16.166221+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:19:16.166221+0000","last_undegraded":"2024-09-21T22:19:16.166221+0000","last_fullsized":"2024-09-21T22:19:16.166221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"199'839","reported_seq":3502,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328095+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:19:16.328095+0000","last_peered":"2024-09-21T22:19:16.328095+0000","last_clean":"2024-09-21T22:19:16.328095+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:19:16.328095+0000","last_undegraded":"2024-09-21T22:19:16.328095+0000","last_fullsized":"2024-09-21T22:19:16.328095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"206'863","reported_seq":3114,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327984+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:19:16.327984+0000","last_peered":"2024-09-21T22:19:16.327984+0000","last_clean":"2024-09-21T22:19:16.327984+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:19:16.327984+0000","last_undegraded":"2024-09-21T22:19:16.327984+0000","last_fullsized":"2024-09-21T22:19:16.327984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"206'503","reported_seq":1977,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328437+0000","last_change":"2024-09-21T22:19:11.131326+0000","last_active":"2024-09-21T22:19:16.328437+0000","last_peered":"2024-09-21T22:19:16.328437+0000","last_clean":"2024-09-21T22:19:16.328437+0000","last_became_active":"2024-09-21T22:19:11.130432+0000","last_became_peered":"2024-09-21T22:19:11.130432+0000","last_unstale":"2024-09-21T22:19:16.328437+0000","last_undegraded":"2024-09-21T22:19:16.328437+0000","last_fullsized":"2024-09-21T22:19:16.328437+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:34.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017990440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1732,"num_read_kb":37996,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"204'655","reported_seq":2836,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328101+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:19:16.328101+0000","last_peered":"2024-09-21T22:19:16.328101+0000","last_clean":"2024-09-21T22:19:16.328101+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:19:16.328101+0000","last_undegraded":"2024-09-21T22:19:16.328101+0000","last_fullsized":"2024-09-21T22:19:16.328101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"207'677","reported_seq":2301,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328226+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:19:16.328226+0000","last_peered":"2024-09-21T22:19:16.328226+0000","last_clean":"2024-09-21T22:19:16.328226+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:19:16.328226+0000","last_undegraded":"2024-09-21T22:19:16.328226+0000","last_fullsized":"2024-09-21T22:19:16.328226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"204'616","reported_seq":3004,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328411+0000","last_change":"2024-09-21T22:18:56.917619+0000","last_active":"2024-09-21T22:19:16.328411+0000","last_peered":"2024-09-21T22:19:16.328411+0000","last_clean":"2024-09-21T22:19:16.328411+0000","last_became_active":"2024-09-21T22:18:56.916154+0000","last_became_peered":"2024-09-21T22:18:56.916154+0000","last_unstale":"2024-09-21T22:19:16.328411+0000","last_undegraded":"2024-09-21T22:19:16.328411+0000","last_fullsized":"2024-09-21T22:19:16.328411+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:01:54.099402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"204'395","reported_seq":2607,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327871+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:19:16.327871+0000","last_peered":"2024-09-21T22:19:16.327871+0000","last_clean":"2024-09-21T22:19:16.327871+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:19:16.327871+0000","last_undegraded":"2024-09-21T22:19:16.327871+0000","last_fullsized":"2024-09-21T22:19:16.327871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"207'713","reported_seq":2509,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328215+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:19:16.328215+0000","last_peered":"2024-09-21T22:19:16.328215+0000","last_clean":"2024-09-21T22:19:16.328215+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:19:16.328215+0000","last_undegraded":"2024-09-21T22:19:16.328215+0000","last_fullsized":"2024-09-21T22:19:16.328215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"204'591","reported_seq":7439,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327708+0000","last_change":"2024-09-21T22:19:03.071739+0000","last_active":"2024-09-21T22:19:16.327708+0000","last_peered":"2024-09-21T22:19:16.327708+0000","last_clean":"2024-09-21T22:19:16.327708+0000","last_became_active":"2024-09-21T22:19:03.070891+0000","last_became_peered":"2024-09-21T22:19:03.070891+0000","last_unstale":"2024-09-21T22:19:16.327708+0000","last_undegraded":"2024-09-21T22:19:16.327708+0000","last_fullsized":"2024-09-21T22:19:16.327708+0000","mapping_epoch":218,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":219,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:52:13.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011971970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"207'699","reported_seq":12591,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328405+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:19:16.328405+0000","last_peered":"2024-09-21T22:19:16.328405+0000","last_clean":"2024-09-21T22:19:16.328405+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:19:16.328405+0000","last_undegraded":"2024-09-21T22:19:16.328405+0000","last_fullsized":"2024-09-21T22:19:16.328405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216012,"num_read_kb":1301047,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1909,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78928,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292912,"statfs":{"total":96636764160,"available":96555941888,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29776,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342064,"statfs":{"total":96636764160,"available":96606273536,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74196,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297644,"statfs":{"total":96636764160,"available":96560787456,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74192,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297648,"statfs":{"total":96636764160,"available":96560791552,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528362,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57228,"kb_used_data":2744,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314612,"statfs":{"total":96636764160,"available":96578162688,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42252,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329588,"statfs":{"total":96636764160,"available":96593498112,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33940,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337900,"statfs":{"total":96636764160,"available":96602009600,"internally_reserved":0,"allocated":2818048,"data_stored":1388746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70620,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301220,"statfs":{"total":96636764160,"available":96564449280,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:19:20.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:19:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:20.839 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:19:20.851 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-21T22:19:19.213018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216128,"num_read_kb":1301147,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1913,"num_bytes_recovered":167371473,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461132,"kb_used_data":23128,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754513588,"statfs":{"total":773094113280,"available":772621914112,"internally_reserved":0,"allocated":23683072,"data_stored":12290476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000996"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27916,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327991+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:19:16.327991+0000","last_peered":"2024-09-21T22:19:16.327991+0000","last_clean":"2024-09-21T22:19:16.327991+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:19:16.327991+0000","last_undegraded":"2024-09-21T22:19:16.327991+0000","last_fullsized":"2024-09-21T22:19:16.327991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:15.615057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"207'807","reported_seq":4691,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328121+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:19:16.328121+0000","last_peered":"2024-09-21T22:19:16.328121+0000","last_clean":"2024-09-21T22:19:16.328121+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:19:16.328121+0000","last_undegraded":"2024-09-21T22:19:16.328121+0000","last_fullsized":"2024-09-21T22:19:16.328121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"207'464","reported_seq":8635,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328173+0000","last_change":"2024-09-21T22:19:11.128355+0000","last_active":"2024-09-21T22:19:16.328173+0000","last_peered":"2024-09-21T22:19:16.328173+0000","last_clean":"2024-09-21T22:19:16.328173+0000","last_became_active":"2024-09-21T22:19:11.126877+0000","last_became_peered":"2024-09-21T22:19:11.126877+0000","last_unstale":"2024-09-21T22:19:16.328173+0000","last_undegraded":"2024-09-21T22:19:16.328173+0000","last_fullsized":"2024-09-21T22:19:16.328173+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:53.817301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"207'919","reported_seq":3876,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328434+0000","last_change":"2024-09-21T22:19:11.128365+0000","last_active":"2024-09-21T22:19:16.328434+0000","last_peered":"2024-09-21T22:19:16.328434+0000","last_clean":"2024-09-21T22:19:16.328434+0000","last_became_active":"2024-09-21T22:19:11.127057+0000","last_became_peered":"2024-09-21T22:19:11.127057+0000","last_unstale":"2024-09-21T22:19:16.328434+0000","last_undegraded":"2024-09-21T22:19:16.328434+0000","last_fullsized":"2024-09-21T22:19:16.328434+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:53.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4692,"num_read_kb":35493,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"206'513","reported_seq":11185,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327840+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:19:16.327840+0000","last_peered":"2024-09-21T22:19:16.327840+0000","last_clean":"2024-09-21T22:19:16.327840+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:19:16.327840+0000","last_undegraded":"2024-09-21T22:19:16.327840+0000","last_fullsized":"2024-09-21T22:19:16.327840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:19.092862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'362","reported_seq":3334,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166318+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:19:16.166318+0000","last_peered":"2024-09-21T22:19:16.166318+0000","last_clean":"2024-09-21T22:19:16.166318+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:19:16.166318+0000","last_undegraded":"2024-09-21T22:19:16.166318+0000","last_fullsized":"2024-09-21T22:19:16.166318+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"206'814","reported_seq":4125,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165522+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:19:16.165522+0000","last_peered":"2024-09-21T22:19:16.165522+0000","last_clean":"2024-09-21T22:19:16.165522+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:19:16.165522+0000","last_undegraded":"2024-09-21T22:19:16.165522+0000","last_fullsized":"2024-09-21T22:19:16.165522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"204'840","reported_seq":2846,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327609+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:19:16.327609+0000","last_peered":"2024-09-21T22:19:16.327609+0000","last_clean":"2024-09-21T22:19:16.327609+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:19:16.327609+0000","last_undegraded":"2024-09-21T22:19:16.327609+0000","last_fullsized":"2024-09-21T22:19:16.327609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"206'1170","reported_seq":4063,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328041+0000","last_change":"2024-09-21T22:18:48.031440+0000","last_active":"2024-09-21T22:19:16.328041+0000","last_peered":"2024-09-21T22:19:16.328041+0000","last_clean":"2024-09-21T22:19:16.328041+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:19:16.328041+0000","last_undegraded":"2024-09-21T22:19:16.328041+0000","last_fullsized":"2024-09-21T22:19:16.328041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:05.561479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"207'318","reported_seq":14493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165615+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:19:16.165615+0000","last_peered":"2024-09-21T22:19:16.165615+0000","last_clean":"2024-09-21T22:19:16.165615+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:19:16.165615+0000","last_undegraded":"2024-09-21T22:19:16.165615+0000","last_fullsized":"2024-09-21T22:19:16.165615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"207'898","reported_seq":3862,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327916+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:19:16.327916+0000","last_peered":"2024-09-21T22:19:16.327916+0000","last_clean":"2024-09-21T22:19:16.327916+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:19:16.327916+0000","last_undegraded":"2024-09-21T22:19:16.327916+0000","last_fullsized":"2024-09-21T22:19:16.327916+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"205'1008","reported_seq":5151,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166510+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:19:16.166510+0000","last_peered":"2024-09-21T22:19:16.166510+0000","last_clean":"2024-09-21T22:19:16.166510+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:19:16.166510+0000","last_undegraded":"2024-09-21T22:19:16.166510+0000","last_fullsized":"2024-09-21T22:19:16.166510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":445,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328029+0000","last_change":"2024-09-21T22:18:54.034627+0000","last_active":"2024-09-21T22:19:16.328029+0000","last_peered":"2024-09-21T22:19:16.328029+0000","last_clean":"2024-09-21T22:19:16.328029+0000","last_became_active":"2024-09-21T22:18:54.034243+0000","last_became_peered":"2024-09-21T22:18:54.034243+0000","last_unstale":"2024-09-21T22:19:16.328029+0000","last_undegraded":"2024-09-21T22:19:16.328029+0000","last_fullsized":"2024-09-21T22:19:16.328029+0000","mapping_epoch":212,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:11:55.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4227,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327895+0000","last_change":"2024-09-21T22:18:48.031413+0000","last_active":"2024-09-21T22:19:16.327895+0000","last_peered":"2024-09-21T22:19:16.327895+0000","last_clean":"2024-09-21T22:19:16.327895+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:19:16.327895+0000","last_undegraded":"2024-09-21T22:19:16.327895+0000","last_fullsized":"2024-09-21T22:19:16.327895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:52.106117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165706+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:19:16.165706+0000","last_peered":"2024-09-21T22:19:16.165706+0000","last_clean":"2024-09-21T22:19:16.165706+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:19:16.165706+0000","last_undegraded":"2024-09-21T22:19:16.165706+0000","last_fullsized":"2024-09-21T22:19:16.165706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11255,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327866+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:19:16.327866+0000","last_peered":"2024-09-21T22:19:16.327866+0000","last_clean":"2024-09-21T22:19:16.327866+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:19:16.327866+0000","last_undegraded":"2024-09-21T22:19:16.327866+0000","last_fullsized":"2024-09-21T22:19:16.327866+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328305+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:19:16.328305+0000","last_peered":"2024-09-21T22:19:16.328305+0000","last_clean":"2024-09-21T22:19:16.328305+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:19:16.328305+0000","last_undegraded":"2024-09-21T22:19:16.328305+0000","last_fullsized":"2024-09-21T22:19:16.328305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10295,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165605+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:19:16.165605+0000","last_peered":"2024-09-21T22:19:16.165605+0000","last_clean":"2024-09-21T22:19:16.165605+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:19:16.165605+0000","last_undegraded":"2024-09-21T22:19:16.165605+0000","last_fullsized":"2024-09-21T22:19:16.165605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165602+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:19:16.165602+0000","last_peered":"2024-09-21T22:19:16.165602+0000","last_clean":"2024-09-21T22:19:16.165602+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:19:16.165602+0000","last_undegraded":"2024-09-21T22:19:16.165602+0000","last_fullsized":"2024-09-21T22:19:16.165602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14477,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.131577+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130054+0000","last_became_peered":"2024-09-21T22:19:11.130054+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:46:55.850653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021147060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"207'770","reported_seq":4367,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166492+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:19:16.166492+0000","last_peered":"2024-09-21T22:19:16.166492+0000","last_clean":"2024-09-21T22:19:16.166492+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:19:16.166492+0000","last_undegraded":"2024-09-21T22:19:16.166492+0000","last_fullsized":"2024-09-21T22:19:16.166492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":198,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327952+0000","last_change":"2024-09-21T22:19:11.127849+0000","last_active":"2024-09-21T22:19:16.327952+0000","last_peered":"2024-09-21T22:19:16.327952+0000","last_clean":"2024-09-21T22:19:16.327952+0000","last_became_active":"2024-09-21T22:19:11.127479+0000","last_became_peered":"2024-09-21T22:19:11.127479+0000","last_unstale":"2024-09-21T22:19:16.327952+0000","last_undegraded":"2024-09-21T22:19:16.327952+0000","last_fullsized":"2024-09-21T22:19:16.327952+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:49.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165471+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:19:16.165471+0000","last_peered":"2024-09-21T22:19:16.165471+0000","last_clean":"2024-09-21T22:19:16.165471+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:19:16.165471+0000","last_undegraded":"2024-09-21T22:19:16.165471+0000","last_fullsized":"2024-09-21T22:19:16.165471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":394,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.167402+0000","last_change":"2024-09-21T22:19:07.095338+0000","last_active":"2024-09-21T22:19:16.167402+0000","last_peered":"2024-09-21T22:19:16.167402+0000","last_clean":"2024-09-21T22:19:16.167402+0000","last_became_active":"2024-09-21T22:19:07.095030+0000","last_became_peered":"2024-09-21T22:19:07.095030+0000","last_unstale":"2024-09-21T22:19:16.167402+0000","last_undegraded":"2024-09-21T22:19:16.167402+0000","last_fullsized":"2024-09-21T22:19:16.167402+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:55.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2623,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327719+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:19:16.327719+0000","last_peered":"2024-09-21T22:19:16.327719+0000","last_clean":"2024-09-21T22:19:16.327719+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:19:16.327719+0000","last_undegraded":"2024-09-21T22:19:16.327719+0000","last_fullsized":"2024-09-21T22:19:16.327719+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:45.211773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328201+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:19:16.328201+0000","last_peered":"2024-09-21T22:19:16.328201+0000","last_clean":"2024-09-21T22:19:16.328201+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:19:16.328201+0000","last_undegraded":"2024-09-21T22:19:16.328201+0000","last_fullsized":"2024-09-21T22:19:16.328201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1840,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327990+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:19:16.327990+0000","last_peered":"2024-09-21T22:19:16.327990+0000","last_clean":"2024-09-21T22:19:16.327990+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:19:16.327990+0000","last_undegraded":"2024-09-21T22:19:16.327990+0000","last_fullsized":"2024-09-21T22:19:16.327990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":256,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.130435+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130057+0000","last_became_peered":"2024-09-21T22:19:11.130057+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:32.125867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328122+0000","last_change":"2024-09-21T22:18:56.918903+0000","last_active":"2024-09-21T22:19:16.328122+0000","last_peered":"2024-09-21T22:19:16.328122+0000","last_clean":"2024-09-21T22:19:16.328122+0000","last_became_active":"2024-09-21T22:18:56.918614+0000","last_became_peered":"2024-09-21T22:18:56.918614+0000","last_unstale":"2024-09-21T22:19:16.328122+0000","last_undegraded":"2024-09-21T22:19:16.328122+0000","last_fullsized":"2024-09-21T22:19:16.328122+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:34.257530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2368,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327723+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:19:16.327723+0000","last_peered":"2024-09-21T22:19:16.327723+0000","last_clean":"2024-09-21T22:19:16.327723+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:19:16.327723+0000","last_undegraded":"2024-09-21T22:19:16.327723+0000","last_fullsized":"2024-09-21T22:19:16.327723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"207'563","reported_seq":4572,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166221+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:19:16.166221+0000","last_peered":"2024-09-21T22:19:16.166221+0000","last_clean":"2024-09-21T22:19:16.166221+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:19:16.166221+0000","last_undegraded":"2024-09-21T22:19:16.166221+0000","last_fullsized":"2024-09-21T22:19:16.166221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"199'839","reported_seq":3502,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328095+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:19:16.328095+0000","last_peered":"2024-09-21T22:19:16.328095+0000","last_clean":"2024-09-21T22:19:16.328095+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:19:16.328095+0000","last_undegraded":"2024-09-21T22:19:16.328095+0000","last_fullsized":"2024-09-21T22:19:16.328095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"206'863","reported_seq":3114,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327984+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:19:16.327984+0000","last_peered":"2024-09-21T22:19:16.327984+0000","last_clean":"2024-09-21T22:19:16.327984+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:19:16.327984+0000","last_undegraded":"2024-09-21T22:19:16.327984+0000","last_fullsized":"2024-09-21T22:19:16.327984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"206'503","reported_seq":1977,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328437+0000","last_change":"2024-09-21T22:19:11.131326+0000","last_active":"2024-09-21T22:19:16.328437+0000","last_peered":"2024-09-21T22:19:16.328437+0000","last_clean":"2024-09-21T22:19:16.328437+0000","last_became_active":"2024-09-21T22:19:11.130432+0000","last_became_peered":"2024-09-21T22:19:11.130432+0000","last_unstale":"2024-09-21T22:19:16.328437+0000","last_undegraded":"2024-09-21T22:19:16.328437+0000","last_fullsized":"2024-09-21T22:19:16.328437+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:34.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017990440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1732,"num_read_kb":37996,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"204'655","reported_seq":2836,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328101+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:19:16.328101+0000","last_peered":"2024-09-21T22:19:16.328101+0000","last_clean":"2024-09-21T22:19:16.328101+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:19:16.328101+0000","last_undegraded":"2024-09-21T22:19:16.328101+0000","last_fullsized":"2024-09-21T22:19:16.328101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"207'677","reported_seq":2301,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328226+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:19:16.328226+0000","last_peered":"2024-09-21T22:19:16.328226+0000","last_clean":"2024-09-21T22:19:16.328226+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:19:16.328226+0000","last_undegraded":"2024-09-21T22:19:16.328226+0000","last_fullsized":"2024-09-21T22:19:16.328226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"204'616","reported_seq":3004,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328411+0000","last_change":"2024-09-21T22:18:56.917619+0000","last_active":"2024-09-21T22:19:16.328411+0000","last_peered":"2024-09-21T22:19:16.328411+0000","last_clean":"2024-09-21T22:19:16.328411+0000","last_became_active":"2024-09-21T22:18:56.916154+0000","last_became_peered":"2024-09-21T22:18:56.916154+0000","last_unstale":"2024-09-21T22:19:16.328411+0000","last_undegraded":"2024-09-21T22:19:16.328411+0000","last_fullsized":"2024-09-21T22:19:16.328411+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:01:54.099402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"204'395","reported_seq":2607,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327871+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:19:16.327871+0000","last_peered":"2024-09-21T22:19:16.327871+0000","last_clean":"2024-09-21T22:19:16.327871+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:19:16.327871+0000","last_undegraded":"2024-09-21T22:19:16.327871+0000","last_fullsized":"2024-09-21T22:19:16.327871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"207'713","reported_seq":2509,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328215+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:19:16.328215+0000","last_peered":"2024-09-21T22:19:16.328215+0000","last_clean":"2024-09-21T22:19:16.328215+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:19:16.328215+0000","last_undegraded":"2024-09-21T22:19:16.328215+0000","last_fullsized":"2024-09-21T22:19:16.328215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"204'591","reported_seq":7439,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327708+0000","last_change":"2024-09-21T22:19:03.071739+0000","last_active":"2024-09-21T22:19:16.327708+0000","last_peered":"2024-09-21T22:19:16.327708+0000","last_clean":"2024-09-21T22:19:16.327708+0000","last_became_active":"2024-09-21T22:19:03.070891+0000","last_became_peered":"2024-09-21T22:19:03.070891+0000","last_unstale":"2024-09-21T22:19:16.327708+0000","last_undegraded":"2024-09-21T22:19:16.327708+0000","last_fullsized":"2024-09-21T22:19:16.327708+0000","mapping_epoch":218,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":219,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:52:13.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011971970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"207'699","reported_seq":12591,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328405+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:19:16.328405+0000","last_peered":"2024-09-21T22:19:16.328405+0000","last_clean":"2024-09-21T22:19:16.328405+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:19:16.328405+0000","last_undegraded":"2024-09-21T22:19:16.328405+0000","last_fullsized":"2024-09-21T22:19:16.328405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216012,"num_read_kb":1301047,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1909,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78928,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292912,"statfs":{"total":96636764160,"available":96555941888,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29776,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342064,"statfs":{"total":96636764160,"available":96606273536,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74196,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297644,"statfs":{"total":96636764160,"available":96560787456,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74192,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297648,"statfs":{"total":96636764160,"available":96560791552,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528362,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57228,"kb_used_data":2744,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314612,"statfs":{"total":96636764160,"available":96578162688,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42252,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329588,"statfs":{"total":96636764160,"available":96593498112,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33940,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337900,"statfs":{"total":96636764160,"available":96602009600,"internally_reserved":0,"allocated":2818048,"data_stored":1388746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70620,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301220,"statfs":{"total":96636764160,"available":96564449280,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:19:20.853 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T22:19:20.853 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:19:21.130 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:19:21.142 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-21T22:19:19.213018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216128,"num_read_kb":1301147,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1913,"num_bytes_recovered":167371473,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461132,"kb_used_data":23128,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754513588,"statfs":{"total":773094113280,"available":772621914112,"internally_reserved":0,"allocated":23683072,"data_stored":12290476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000996"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27916,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327991+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:19:16.327991+0000","last_peered":"2024-09-21T22:19:16.327991+0000","last_clean":"2024-09-21T22:19:16.327991+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:19:16.327991+0000","last_undegraded":"2024-09-21T22:19:16.327991+0000","last_fullsized":"2024-09-21T22:19:16.327991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:15.615057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"207'807","reported_seq":4691,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328121+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:19:16.328121+0000","last_peered":"2024-09-21T22:19:16.328121+0000","last_clean":"2024-09-21T22:19:16.328121+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:19:16.328121+0000","last_undegraded":"2024-09-21T22:19:16.328121+0000","last_fullsized":"2024-09-21T22:19:16.328121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"207'464","reported_seq":8635,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328173+0000","last_change":"2024-09-21T22:19:11.128355+0000","last_active":"2024-09-21T22:19:16.328173+0000","last_peered":"2024-09-21T22:19:16.328173+0000","last_clean":"2024-09-21T22:19:16.328173+0000","last_became_active":"2024-09-21T22:19:11.126877+0000","last_became_peered":"2024-09-21T22:19:11.126877+0000","last_unstale":"2024-09-21T22:19:16.328173+0000","last_undegraded":"2024-09-21T22:19:16.328173+0000","last_fullsized":"2024-09-21T22:19:16.328173+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:53.817301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"207'919","reported_seq":3876,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328434+0000","last_change":"2024-09-21T22:19:11.128365+0000","last_active":"2024-09-21T22:19:16.328434+0000","last_peered":"2024-09-21T22:19:16.328434+0000","last_clean":"2024-09-21T22:19:16.328434+0000","last_became_active":"2024-09-21T22:19:11.127057+0000","last_became_peered":"2024-09-21T22:19:11.127057+0000","last_unstale":"2024-09-21T22:19:16.328434+0000","last_undegraded":"2024-09-21T22:19:16.328434+0000","last_fullsized":"2024-09-21T22:19:16.328434+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:53.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4692,"num_read_kb":35493,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"206'513","reported_seq":11185,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327840+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:19:16.327840+0000","last_peered":"2024-09-21T22:19:16.327840+0000","last_clean":"2024-09-21T22:19:16.327840+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:19:16.327840+0000","last_undegraded":"2024-09-21T22:19:16.327840+0000","last_fullsized":"2024-09-21T22:19:16.327840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:07:19.092862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'362","reported_seq":3334,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166318+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:19:16.166318+0000","last_peered":"2024-09-21T22:19:16.166318+0000","last_clean":"2024-09-21T22:19:16.166318+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:19:16.166318+0000","last_undegraded":"2024-09-21T22:19:16.166318+0000","last_fullsized":"2024-09-21T22:19:16.166318+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"206'814","reported_seq":4125,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165522+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:19:16.165522+0000","last_peered":"2024-09-21T22:19:16.165522+0000","last_clean":"2024-09-21T22:19:16.165522+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:19:16.165522+0000","last_undegraded":"2024-09-21T22:19:16.165522+0000","last_fullsized":"2024-09-21T22:19:16.165522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"204'840","reported_seq":2846,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327609+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:19:16.327609+0000","last_peered":"2024-09-21T22:19:16.327609+0000","last_clean":"2024-09-21T22:19:16.327609+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:19:16.327609+0000","last_undegraded":"2024-09-21T22:19:16.327609+0000","last_fullsized":"2024-09-21T22:19:16.327609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"206'1170","reported_seq":4063,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328041+0000","last_change":"2024-09-21T22:18:48.031440+0000","last_active":"2024-09-21T22:19:16.328041+0000","last_peered":"2024-09-21T22:19:16.328041+0000","last_clean":"2024-09-21T22:19:16.328041+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:19:16.328041+0000","last_undegraded":"2024-09-21T22:19:16.328041+0000","last_fullsized":"2024-09-21T22:19:16.328041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:05.561479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"207'318","reported_seq":14493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165615+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:19:16.165615+0000","last_peered":"2024-09-21T22:19:16.165615+0000","last_clean":"2024-09-21T22:19:16.165615+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:19:16.165615+0000","last_undegraded":"2024-09-21T22:19:16.165615+0000","last_fullsized":"2024-09-21T22:19:16.165615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"207'898","reported_seq":3862,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327916+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:19:16.327916+0000","last_peered":"2024-09-21T22:19:16.327916+0000","last_clean":"2024-09-21T22:19:16.327916+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:19:16.327916+0000","last_undegraded":"2024-09-21T22:19:16.327916+0000","last_fullsized":"2024-09-21T22:19:16.327916+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"205'1008","reported_seq":5151,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166510+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:19:16.166510+0000","last_peered":"2024-09-21T22:19:16.166510+0000","last_clean":"2024-09-21T22:19:16.166510+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:19:16.166510+0000","last_undegraded":"2024-09-21T22:19:16.166510+0000","last_fullsized":"2024-09-21T22:19:16.166510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":445,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328029+0000","last_change":"2024-09-21T22:18:54.034627+0000","last_active":"2024-09-21T22:19:16.328029+0000","last_peered":"2024-09-21T22:19:16.328029+0000","last_clean":"2024-09-21T22:19:16.328029+0000","last_became_active":"2024-09-21T22:18:54.034243+0000","last_became_peered":"2024-09-21T22:18:54.034243+0000","last_unstale":"2024-09-21T22:19:16.328029+0000","last_undegraded":"2024-09-21T22:19:16.328029+0000","last_fullsized":"2024-09-21T22:19:16.328029+0000","mapping_epoch":212,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:11:55.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4227,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327895+0000","last_change":"2024-09-21T22:18:48.031413+0000","last_active":"2024-09-21T22:19:16.327895+0000","last_peered":"2024-09-21T22:19:16.327895+0000","last_clean":"2024-09-21T22:19:16.327895+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:19:16.327895+0000","last_undegraded":"2024-09-21T22:19:16.327895+0000","last_fullsized":"2024-09-21T22:19:16.327895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:52.106117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165706+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:19:16.165706+0000","last_peered":"2024-09-21T22:19:16.165706+0000","last_clean":"2024-09-21T22:19:16.165706+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:19:16.165706+0000","last_undegraded":"2024-09-21T22:19:16.165706+0000","last_fullsized":"2024-09-21T22:19:16.165706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11255,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327866+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:19:16.327866+0000","last_peered":"2024-09-21T22:19:16.327866+0000","last_clean":"2024-09-21T22:19:16.327866+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:19:16.327866+0000","last_undegraded":"2024-09-21T22:19:16.327866+0000","last_fullsized":"2024-09-21T22:19:16.327866+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328305+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:19:16.328305+0000","last_peered":"2024-09-21T22:19:16.328305+0000","last_clean":"2024-09-21T22:19:16.328305+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:19:16.328305+0000","last_undegraded":"2024-09-21T22:19:16.328305+0000","last_fullsized":"2024-09-21T22:19:16.328305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10295,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165605+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:19:16.165605+0000","last_peered":"2024-09-21T22:19:16.165605+0000","last_clean":"2024-09-21T22:19:16.165605+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:19:16.165605+0000","last_undegraded":"2024-09-21T22:19:16.165605+0000","last_fullsized":"2024-09-21T22:19:16.165605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165602+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:19:16.165602+0000","last_peered":"2024-09-21T22:19:16.165602+0000","last_clean":"2024-09-21T22:19:16.165602+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:19:16.165602+0000","last_undegraded":"2024-09-21T22:19:16.165602+0000","last_fullsized":"2024-09-21T22:19:16.165602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14477,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.131577+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130054+0000","last_became_peered":"2024-09-21T22:19:11.130054+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:46:55.850653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021147060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"207'770","reported_seq":4367,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166492+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:19:16.166492+0000","last_peered":"2024-09-21T22:19:16.166492+0000","last_clean":"2024-09-21T22:19:16.166492+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:19:16.166492+0000","last_undegraded":"2024-09-21T22:19:16.166492+0000","last_fullsized":"2024-09-21T22:19:16.166492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":198,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327952+0000","last_change":"2024-09-21T22:19:11.127849+0000","last_active":"2024-09-21T22:19:16.327952+0000","last_peered":"2024-09-21T22:19:16.327952+0000","last_clean":"2024-09-21T22:19:16.327952+0000","last_became_active":"2024-09-21T22:19:11.127479+0000","last_became_peered":"2024-09-21T22:19:11.127479+0000","last_unstale":"2024-09-21T22:19:16.327952+0000","last_undegraded":"2024-09-21T22:19:16.327952+0000","last_fullsized":"2024-09-21T22:19:16.327952+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:49.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165471+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:19:16.165471+0000","last_peered":"2024-09-21T22:19:16.165471+0000","last_clean":"2024-09-21T22:19:16.165471+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:19:16.165471+0000","last_undegraded":"2024-09-21T22:19:16.165471+0000","last_fullsized":"2024-09-21T22:19:16.165471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":394,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.167402+0000","last_change":"2024-09-21T22:19:07.095338+0000","last_active":"2024-09-21T22:19:16.167402+0000","last_peered":"2024-09-21T22:19:16.167402+0000","last_clean":"2024-09-21T22:19:16.167402+0000","last_became_active":"2024-09-21T22:19:07.095030+0000","last_became_peered":"2024-09-21T22:19:07.095030+0000","last_unstale":"2024-09-21T22:19:16.167402+0000","last_undegraded":"2024-09-21T22:19:16.167402+0000","last_fullsized":"2024-09-21T22:19:16.167402+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:55.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2623,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327719+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:19:16.327719+0000","last_peered":"2024-09-21T22:19:16.327719+0000","last_clean":"2024-09-21T22:19:16.327719+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:19:16.327719+0000","last_undegraded":"2024-09-21T22:19:16.327719+0000","last_fullsized":"2024-09-21T22:19:16.327719+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:45.211773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328201+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:19:16.328201+0000","last_peered":"2024-09-21T22:19:16.328201+0000","last_clean":"2024-09-21T22:19:16.328201+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:19:16.328201+0000","last_undegraded":"2024-09-21T22:19:16.328201+0000","last_fullsized":"2024-09-21T22:19:16.328201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1840,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327990+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:19:16.327990+0000","last_peered":"2024-09-21T22:19:16.327990+0000","last_clean":"2024-09-21T22:19:16.327990+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:19:16.327990+0000","last_undegraded":"2024-09-21T22:19:16.327990+0000","last_fullsized":"2024-09-21T22:19:16.327990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":256,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.130435+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130057+0000","last_became_peered":"2024-09-21T22:19:11.130057+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:32.125867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328122+0000","last_change":"2024-09-21T22:18:56.918903+0000","last_active":"2024-09-21T22:19:16.328122+0000","last_peered":"2024-09-21T22:19:16.328122+0000","last_clean":"2024-09-21T22:19:16.328122+0000","last_became_active":"2024-09-21T22:18:56.918614+0000","last_became_peered":"2024-09-21T22:18:56.918614+0000","last_unstale":"2024-09-21T22:19:16.328122+0000","last_undegraded":"2024-09-21T22:19:16.328122+0000","last_fullsized":"2024-09-21T22:19:16.328122+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:34.257530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2368,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327723+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:19:16.327723+0000","last_peered":"2024-09-21T22:19:16.327723+0000","last_clean":"2024-09-21T22:19:16.327723+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:19:16.327723+0000","last_undegraded":"2024-09-21T22:19:16.327723+0000","last_fullsized":"2024-09-21T22:19:16.327723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"207'563","reported_seq":4572,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166221+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:19:16.166221+0000","last_peered":"2024-09-21T22:19:16.166221+0000","last_clean":"2024-09-21T22:19:16.166221+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:19:16.166221+0000","last_undegraded":"2024-09-21T22:19:16.166221+0000","last_fullsized":"2024-09-21T22:19:16.166221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"199'839","reported_seq":3502,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328095+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:19:16.328095+0000","last_peered":"2024-09-21T22:19:16.328095+0000","last_clean":"2024-09-21T22:19:16.328095+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:19:16.328095+0000","last_undegraded":"2024-09-21T22:19:16.328095+0000","last_fullsized":"2024-09-21T22:19:16.328095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"206'863","reported_seq":3114,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327984+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:19:16.327984+0000","last_peered":"2024-09-21T22:19:16.327984+0000","last_clean":"2024-09-21T22:19:16.327984+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:19:16.327984+0000","last_undegraded":"2024-09-21T22:19:16.327984+0000","last_fullsized":"2024-09-21T22:19:16.327984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"206'503","reported_seq":1977,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328437+0000","last_change":"2024-09-21T22:19:11.131326+0000","last_active":"2024-09-21T22:19:16.328437+0000","last_peered":"2024-09-21T22:19:16.328437+0000","last_clean":"2024-09-21T22:19:16.328437+0000","last_became_active":"2024-09-21T22:19:11.130432+0000","last_became_peered":"2024-09-21T22:19:11.130432+0000","last_unstale":"2024-09-21T22:19:16.328437+0000","last_undegraded":"2024-09-21T22:19:16.328437+0000","last_fullsized":"2024-09-21T22:19:16.328437+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:34.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017990440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1732,"num_read_kb":37996,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"204'655","reported_seq":2836,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328101+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:19:16.328101+0000","last_peered":"2024-09-21T22:19:16.328101+0000","last_clean":"2024-09-21T22:19:16.328101+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:19:16.328101+0000","last_undegraded":"2024-09-21T22:19:16.328101+0000","last_fullsized":"2024-09-21T22:19:16.328101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"207'677","reported_seq":2301,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328226+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:19:16.328226+0000","last_peered":"2024-09-21T22:19:16.328226+0000","last_clean":"2024-09-21T22:19:16.328226+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:19:16.328226+0000","last_undegraded":"2024-09-21T22:19:16.328226+0000","last_fullsized":"2024-09-21T22:19:16.328226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"204'616","reported_seq":3004,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328411+0000","last_change":"2024-09-21T22:18:56.917619+0000","last_active":"2024-09-21T22:19:16.328411+0000","last_peered":"2024-09-21T22:19:16.328411+0000","last_clean":"2024-09-21T22:19:16.328411+0000","last_became_active":"2024-09-21T22:18:56.916154+0000","last_became_peered":"2024-09-21T22:18:56.916154+0000","last_unstale":"2024-09-21T22:19:16.328411+0000","last_undegraded":"2024-09-21T22:19:16.328411+0000","last_fullsized":"2024-09-21T22:19:16.328411+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:01:54.099402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"204'395","reported_seq":2607,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327871+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:19:16.327871+0000","last_peered":"2024-09-21T22:19:16.327871+0000","last_clean":"2024-09-21T22:19:16.327871+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:19:16.327871+0000","last_undegraded":"2024-09-21T22:19:16.327871+0000","last_fullsized":"2024-09-21T22:19:16.327871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"207'713","reported_seq":2509,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328215+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:19:16.328215+0000","last_peered":"2024-09-21T22:19:16.328215+0000","last_clean":"2024-09-21T22:19:16.328215+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:19:16.328215+0000","last_undegraded":"2024-09-21T22:19:16.328215+0000","last_fullsized":"2024-09-21T22:19:16.328215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"204'591","reported_seq":7439,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327708+0000","last_change":"2024-09-21T22:19:03.071739+0000","last_active":"2024-09-21T22:19:16.327708+0000","last_peered":"2024-09-21T22:19:16.327708+0000","last_clean":"2024-09-21T22:19:16.327708+0000","last_became_active":"2024-09-21T22:19:03.070891+0000","last_became_peered":"2024-09-21T22:19:03.070891+0000","last_unstale":"2024-09-21T22:19:16.327708+0000","last_undegraded":"2024-09-21T22:19:16.327708+0000","last_fullsized":"2024-09-21T22:19:16.327708+0000","mapping_epoch":218,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":219,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:52:13.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011971970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"207'699","reported_seq":12591,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328405+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:19:16.328405+0000","last_peered":"2024-09-21T22:19:16.328405+0000","last_clean":"2024-09-21T22:19:16.328405+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:19:16.328405+0000","last_undegraded":"2024-09-21T22:19:16.328405+0000","last_fullsized":"2024-09-21T22:19:16.328405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216012,"num_read_kb":1301047,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1909,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78928,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292912,"statfs":{"total":96636764160,"available":96555941888,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29776,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342064,"statfs":{"total":96636764160,"available":96606273536,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74196,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297644,"statfs":{"total":96636764160,"available":96560787456,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74192,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297648,"statfs":{"total":96636764160,"available":96560791552,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528362,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57228,"kb_used_data":2744,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314612,"statfs":{"total":96636764160,"available":96578162688,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42252,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329588,"statfs":{"total":96636764160,"available":96593498112,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33940,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337900,"statfs":{"total":96636764160,"available":96602009600,"internally_reserved":0,"allocated":2818048,"data_stored":1388746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70620,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301220,"statfs":{"total":96636764160,"available":96564449280,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:19:21.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:19:21.425 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:21.425 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":232,"fsid":"aacb52bd-b292-44e0-94ba-ee8e83c0c924","created":"2024-09-21T22:15:07.092340+0000","modified":"2024-09-21T22:19:16.154230+0000","last_up_change":"2024-09-21T22:15:59.900683+0000","last_in_change":"2024-09-21T22:16:44.923178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:15:21.204402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:15:25.020799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T22:15:34.502611+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":72,"snap_epoch":207,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96ad0a5a-c464-448c-b390-6e73c8fb449e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":218,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6817","nonce":1738784974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6819","nonce":1738784974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6823","nonce":1738784974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1738784974},{"type":"v1","addr":"172.21.15.134:6821","nonce":1738784974}]},"public_addr":"172.21.15.134:6817/1738784974","cluster_addr":"172.21.15.134:6819/1738784974","heartbeat_back_addr":"172.21.15.134:6823/1738784974","heartbeat_front_addr":"172.21.15.134:6821/1738784974","state":["exists","up"]},{"osd":1,"uuid":"f2c75579-e93c-44e8-85ed-144ec4ba096d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6825","nonce":3328015815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6827","nonce":3328015815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6831","nonce":3328015815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3328015815},{"type":"v1","addr":"172.21.15.134:6829","nonce":3328015815}]},"public_addr":"172.21.15.134:6825/3328015815","cluster_addr":"172.21.15.134:6827/3328015815","heartbeat_back_addr":"172.21.15.134:6831/3328015815","heartbeat_front_addr":"172.21.15.134:6829/3328015815","state":["exists","up"]},{"osd":2,"uuid":"a2ae2709-79f1-4a99-b854-d72cfe661be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":222,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6801","nonce":1987494452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6803","nonce":1987494452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6807","nonce":1987494452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1987494452},{"type":"v1","addr":"172.21.15.134:6805","nonce":1987494452}]},"public_addr":"172.21.15.134:6801/1987494452","cluster_addr":"172.21.15.134:6803/1987494452","heartbeat_back_addr":"172.21.15.134:6807/1987494452","heartbeat_front_addr":"172.21.15.134:6805/1987494452","state":["exists","up"]},{"osd":3,"uuid":"94ed467c-6601-41ec-8bdb-9d1f0d4c078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":26,"up_from":45,"up_thru":203,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6809","nonce":704257458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6811","nonce":704257458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6815","nonce":704257458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":704257458},{"type":"v1","addr":"172.21.15.134:6813","nonce":704257458}]},"public_addr":"172.21.15.134:6809/704257458","cluster_addr":"172.21.15.134:6811/704257458","heartbeat_back_addr":"172.21.15.134:6815/704257458","heartbeat_front_addr":"172.21.15.134:6813/704257458","state":["exists","up"]},{"osd":4,"uuid":"74e011e7-766b-437a-b71b-09fc990e210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6801","nonce":1724687038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6803","nonce":1724687038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6807","nonce":1724687038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1724687038},{"type":"v1","addr":"172.21.15.149:6805","nonce":1724687038}]},"public_addr":"172.21.15.149:6801/1724687038","cluster_addr":"172.21.15.149:6803/1724687038","heartbeat_back_addr":"172.21.15.149:6807/1724687038","heartbeat_front_addr":"172.21.15.149:6805/1724687038","state":["exists","up"]},{"osd":5,"uuid":"e7650da2-cbad-4915-bc9c-d5154151bcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":226,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6809","nonce":497583447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6811","nonce":497583447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6815","nonce":497583447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":497583447},{"type":"v1","addr":"172.21.15.149:6813","nonce":497583447}]},"public_addr":"172.21.15.149:6809/497583447","cluster_addr":"172.21.15.149:6811/497583447","heartbeat_back_addr":"172.21.15.149:6815/497583447","heartbeat_front_addr":"172.21.15.149:6813/497583447","state":["exists","up"]},{"osd":6,"uuid":"aec4bd84-857e-4cc9-898c-93440ba485c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":212,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6825","nonce":1853322645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6827","nonce":1853322645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6831","nonce":1853322645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1853322645},{"type":"v1","addr":"172.21.15.149:6829","nonce":1853322645}]},"public_addr":"172.21.15.149:6825/1853322645","cluster_addr":"172.21.15.149:6827/1853322645","heartbeat_back_addr":"172.21.15.149:6831/1853322645","heartbeat_front_addr":"172.21.15.149:6829/1853322645","state":["exists","up"]},{"osd":7,"uuid":"a244e703-8ec9-4edc-b0ca-e33b38bbd99c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":215,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6817","nonce":1872776196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6819","nonce":1872776196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6823","nonce":1872776196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1872776196},{"type":"v1","addr":"172.21.15.149:6821","nonce":1872776196}]},"public_addr":"172.21.15.149:6817/1872776196","cluster_addr":"172.21.15.149:6819/1872776196","heartbeat_back_addr":"172.21.15.149:6823/1872776196","heartbeat_front_addr":"172.21.15.149:6821/1872776196","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.845585+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.467598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.110690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.614040+0000","dead_epoch":27},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.594902+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.591315+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:16.191972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:15:15.510686+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1","osds":[0,1]},{"pgid":"3.d","osds":[6,0]},{"pgid":"3.15","osds":[6,5]},{"pgid":"3.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:19:22.439 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T22:19:22.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:22.574 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:22.574 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:22.574 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:22.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T22:19:22.862 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T22:19:22.875 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T22:19:22.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:22.998 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:22.998 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:23.008 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T22:19:23.285 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T22:19:23.299 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T22:19:23.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:23.422 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:23.422 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:23.422 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:23.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T22:19:23.707 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T22:19:23.720 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T22:19:23.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:23.843 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:23.843 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:23.843 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:23.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T22:19:24.132 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T22:19:24.145 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T22:19:24.145 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:24.269 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:24.269 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:24.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T22:19:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T22:19:24.569 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T22:19:24.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:24.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T22:19:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T22:19:24.994 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T22:19:24.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:25.116 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:25.116 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:25.116 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:25.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T22:19:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T22:19:25.420 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T22:19:25.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:19:25.543 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T22:19:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:19:25.544 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T22:19:25.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T22:19:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T22:19:25.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:19:26.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:26.121 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:19:26.132 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-21T22:19:25.214100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216128,"num_read_kb":1301147,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1913,"num_bytes_recovered":167371473,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21788,"ondisk_log_size":21788,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461116,"kb_used_data":23128,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754513604,"statfs":{"total":773094113280,"available":772621930496,"internally_reserved":0,"allocated":23683072,"data_stored":12290476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001796"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27917,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328013+0000","last_change":"2024-09-21T22:18:48.031737+0000","last_active":"2024-09-21T22:19:16.328013+0000","last_peered":"2024-09-21T22:19:16.328013+0000","last_clean":"2024-09-21T22:19:16.328013+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:19:16.328013+0000","last_undegraded":"2024-09-21T22:19:16.328013+0000","last_fullsized":"2024-09-21T22:19:16.328013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"207'807","reported_seq":4691,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328121+0000","last_change":"2024-09-21T22:18:48.000061+0000","last_active":"2024-09-21T22:19:16.328121+0000","last_peered":"2024-09-21T22:19:16.328121+0000","last_clean":"2024-09-21T22:19:16.328121+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:19:16.328121+0000","last_undegraded":"2024-09-21T22:19:16.328121+0000","last_fullsized":"2024-09-21T22:19:16.328121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:42:46.310429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"207'464","reported_seq":8635,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328173+0000","last_change":"2024-09-21T22:19:11.128355+0000","last_active":"2024-09-21T22:19:16.328173+0000","last_peered":"2024-09-21T22:19:16.328173+0000","last_clean":"2024-09-21T22:19:16.328173+0000","last_became_active":"2024-09-21T22:19:11.126877+0000","last_became_peered":"2024-09-21T22:19:11.126877+0000","last_unstale":"2024-09-21T22:19:16.328173+0000","last_undegraded":"2024-09-21T22:19:16.328173+0000","last_fullsized":"2024-09-21T22:19:16.328173+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:53.817301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"207'919","reported_seq":3876,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328434+0000","last_change":"2024-09-21T22:19:11.128365+0000","last_active":"2024-09-21T22:19:16.328434+0000","last_peered":"2024-09-21T22:19:16.328434+0000","last_clean":"2024-09-21T22:19:16.328434+0000","last_became_active":"2024-09-21T22:19:11.127057+0000","last_became_peered":"2024-09-21T22:19:11.127057+0000","last_unstale":"2024-09-21T22:19:16.328434+0000","last_undegraded":"2024-09-21T22:19:16.328434+0000","last_fullsized":"2024-09-21T22:19:16.328434+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:53.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4692,"num_read_kb":35493,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"206'513","reported_seq":11186,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327890+0000","last_change":"2024-09-21T22:18:48.031134+0000","last_active":"2024-09-21T22:19:16.327890+0000","last_peered":"2024-09-21T22:19:16.327890+0000","last_clean":"2024-09-21T22:19:16.327890+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:19:16.327890+0000","last_undegraded":"2024-09-21T22:19:16.327890+0000","last_fullsized":"2024-09-21T22:19:16.327890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'362","reported_seq":3334,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166318+0000","last_change":"2024-09-21T22:18:47.999226+0000","last_active":"2024-09-21T22:19:16.166318+0000","last_peered":"2024-09-21T22:19:16.166318+0000","last_clean":"2024-09-21T22:19:16.166318+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:19:16.166318+0000","last_undegraded":"2024-09-21T22:19:16.166318+0000","last_fullsized":"2024-09-21T22:19:16.166318+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:58.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"206'814","reported_seq":4125,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165522+0000","last_change":"2024-09-21T22:18:48.078427+0000","last_active":"2024-09-21T22:19:16.165522+0000","last_peered":"2024-09-21T22:19:16.165522+0000","last_clean":"2024-09-21T22:19:16.165522+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:19:16.165522+0000","last_undegraded":"2024-09-21T22:19:16.165522+0000","last_fullsized":"2024-09-21T22:19:16.165522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:43:18.896931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"204'840","reported_seq":2846,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327609+0000","last_change":"2024-09-21T22:18:47.997761+0000","last_active":"2024-09-21T22:19:16.327609+0000","last_peered":"2024-09-21T22:19:16.327609+0000","last_clean":"2024-09-21T22:19:16.327609+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:19:16.327609+0000","last_undegraded":"2024-09-21T22:19:16.327609+0000","last_fullsized":"2024-09-21T22:19:16.327609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:20.775227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"206'1170","reported_seq":4072,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:23.281841+0000","last_change":"2024-09-21T22:19:23.281870+0000","last_active":"2024-09-21T22:19:23.281841+0000","last_peered":"2024-09-21T22:19:23.281841+0000","last_clean":"2024-09-21T22:19:23.281841+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:19:23.281841+0000","last_undegraded":"2024-09-21T22:19:23.281841+0000","last_fullsized":"2024-09-21T22:19:23.281841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'1170","last_scrub_stamp":"2024-09-21T22:19:23.281753+0000","last_deep_scrub":"206'1170","last_deep_scrub_stamp":"2024-09-21T22:19:23.281753+0000","last_clean_scrub_stamp":"2024-09-21T22:19:23.281753+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:18:38.026324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"207'318","reported_seq":14493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165615+0000","last_change":"2024-09-21T22:18:48.078387+0000","last_active":"2024-09-21T22:19:16.165615+0000","last_peered":"2024-09-21T22:19:16.165615+0000","last_clean":"2024-09-21T22:19:16.165615+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:19:16.165615+0000","last_undegraded":"2024-09-21T22:19:16.165615+0000","last_fullsized":"2024-09-21T22:19:16.165615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:15.268090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"207'898","reported_seq":3862,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327916+0000","last_change":"2024-09-21T22:18:48.006164+0000","last_active":"2024-09-21T22:19:16.327916+0000","last_peered":"2024-09-21T22:19:16.327916+0000","last_clean":"2024-09-21T22:19:16.327916+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:19:16.327916+0000","last_undegraded":"2024-09-21T22:19:16.327916+0000","last_fullsized":"2024-09-21T22:19:16.327916+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:30.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"205'1008","reported_seq":5151,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166510+0000","last_change":"2024-09-21T22:18:47.999622+0000","last_active":"2024-09-21T22:19:16.166510+0000","last_peered":"2024-09-21T22:19:16.166510+0000","last_clean":"2024-09-21T22:19:16.166510+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:19:16.166510+0000","last_undegraded":"2024-09-21T22:19:16.166510+0000","last_fullsized":"2024-09-21T22:19:16.166510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:47.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":445,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328029+0000","last_change":"2024-09-21T22:18:54.034627+0000","last_active":"2024-09-21T22:19:16.328029+0000","last_peered":"2024-09-21T22:19:16.328029+0000","last_clean":"2024-09-21T22:19:16.328029+0000","last_became_active":"2024-09-21T22:18:54.034243+0000","last_became_peered":"2024-09-21T22:18:54.034243+0000","last_unstale":"2024-09-21T22:19:16.328029+0000","last_undegraded":"2024-09-21T22:19:16.328029+0000","last_fullsized":"2024-09-21T22:19:16.328029+0000","mapping_epoch":212,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:11:55.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4236,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:24.245282+0000","last_change":"2024-09-21T22:19:24.245305+0000","last_active":"2024-09-21T22:19:24.245282+0000","last_peered":"2024-09-21T22:19:24.245282+0000","last_clean":"2024-09-21T22:19:24.245282+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:19:24.245282+0000","last_undegraded":"2024-09-21T22:19:24.245282+0000","last_fullsized":"2024-09-21T22:19:24.245282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'525","last_scrub_stamp":"2024-09-21T22:19:24.245203+0000","last_deep_scrub":"207'525","last_deep_scrub_stamp":"2024-09-21T22:19:24.245203+0000","last_clean_scrub_stamp":"2024-09-21T22:19:24.245203+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:57:42.469612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165706+0000","last_change":"2024-09-21T22:15:28.408718+0000","last_active":"2024-09-21T22:19:16.165706+0000","last_peered":"2024-09-21T22:19:16.165706+0000","last_clean":"2024-09-21T22:19:16.165706+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:19:16.165706+0000","last_undegraded":"2024-09-21T22:19:16.165706+0000","last_fullsized":"2024-09-21T22:19:16.165706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:55.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11255,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327866+0000","last_change":"2024-09-21T22:18:47.999612+0000","last_active":"2024-09-21T22:19:16.327866+0000","last_peered":"2024-09-21T22:19:16.327866+0000","last_clean":"2024-09-21T22:19:16.327866+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:19:16.327866+0000","last_undegraded":"2024-09-21T22:19:16.327866+0000","last_fullsized":"2024-09-21T22:19:16.327866+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:16:14.741330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328305+0000","last_change":"2024-09-21T22:15:28.402054+0000","last_active":"2024-09-21T22:19:16.328305+0000","last_peered":"2024-09-21T22:19:16.328305+0000","last_clean":"2024-09-21T22:19:16.328305+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:19:16.328305+0000","last_undegraded":"2024-09-21T22:19:16.328305+0000","last_fullsized":"2024-09-21T22:19:16.328305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:58.517167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10295,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165605+0000","last_change":"2024-09-21T22:18:48.076787+0000","last_active":"2024-09-21T22:19:16.165605+0000","last_peered":"2024-09-21T22:19:16.165605+0000","last_clean":"2024-09-21T22:19:16.165605+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:19:16.165605+0000","last_undegraded":"2024-09-21T22:19:16.165605+0000","last_fullsized":"2024-09-21T22:19:16.165605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:26.980185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165602+0000","last_change":"2024-09-21T22:15:28.408704+0000","last_active":"2024-09-21T22:19:16.165602+0000","last_peered":"2024-09-21T22:19:16.165602+0000","last_clean":"2024-09-21T22:19:16.165602+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:19:16.165602+0000","last_undegraded":"2024-09-21T22:19:16.165602+0000","last_fullsized":"2024-09-21T22:19:16.165602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:52.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14477,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.131577+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130054+0000","last_became_peered":"2024-09-21T22:19:11.130054+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:46:55.850653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021147060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"207'770","reported_seq":4367,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166492+0000","last_change":"2024-09-21T22:18:47.999937+0000","last_active":"2024-09-21T22:19:16.166492+0000","last_peered":"2024-09-21T22:19:16.166492+0000","last_clean":"2024-09-21T22:19:16.166492+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:19:16.166492+0000","last_undegraded":"2024-09-21T22:19:16.166492+0000","last_fullsized":"2024-09-21T22:19:16.166492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:52.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":198,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327952+0000","last_change":"2024-09-21T22:19:11.127849+0000","last_active":"2024-09-21T22:19:16.327952+0000","last_peered":"2024-09-21T22:19:16.327952+0000","last_clean":"2024-09-21T22:19:16.327952+0000","last_became_active":"2024-09-21T22:19:11.127479+0000","last_became_peered":"2024-09-21T22:19:11.127479+0000","last_unstale":"2024-09-21T22:19:16.327952+0000","last_undegraded":"2024-09-21T22:19:16.327952+0000","last_fullsized":"2024-09-21T22:19:16.327952+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:49.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18493,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.165471+0000","last_change":"2024-09-21T22:18:48.078684+0000","last_active":"2024-09-21T22:19:16.165471+0000","last_peered":"2024-09-21T22:19:16.165471+0000","last_clean":"2024-09-21T22:19:16.165471+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:19:16.165471+0000","last_undegraded":"2024-09-21T22:19:16.165471+0000","last_fullsized":"2024-09-21T22:19:16.165471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:50.732035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":394,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.167402+0000","last_change":"2024-09-21T22:19:07.095338+0000","last_active":"2024-09-21T22:19:16.167402+0000","last_peered":"2024-09-21T22:19:16.167402+0000","last_clean":"2024-09-21T22:19:16.167402+0000","last_became_active":"2024-09-21T22:19:07.095030+0000","last_became_peered":"2024-09-21T22:19:07.095030+0000","last_unstale":"2024-09-21T22:19:16.167402+0000","last_undegraded":"2024-09-21T22:19:16.167402+0000","last_fullsized":"2024-09-21T22:19:16.167402+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:21:55.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2624,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327766+0000","last_change":"2024-09-21T22:18:48.031063+0000","last_active":"2024-09-21T22:19:16.327766+0000","last_peered":"2024-09-21T22:19:16.327766+0000","last_clean":"2024-09-21T22:19:16.327766+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:19:16.327766+0000","last_undegraded":"2024-09-21T22:19:16.327766+0000","last_fullsized":"2024-09-21T22:19:16.327766+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328201+0000","last_change":"2024-09-21T22:15:28.402053+0000","last_active":"2024-09-21T22:19:16.328201+0000","last_peered":"2024-09-21T22:19:16.328201+0000","last_clean":"2024-09-21T22:19:16.328201+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:19:16.328201+0000","last_undegraded":"2024-09-21T22:19:16.328201+0000","last_fullsized":"2024-09-21T22:19:16.328201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:01.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1840,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327990+0000","last_change":"2024-09-21T22:18:47.999682+0000","last_active":"2024-09-21T22:19:16.327990+0000","last_peered":"2024-09-21T22:19:16.327990+0000","last_clean":"2024-09-21T22:19:16.327990+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:19:16.327990+0000","last_undegraded":"2024-09-21T22:19:16.327990+0000","last_fullsized":"2024-09-21T22:19:16.327990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:47.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":256,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328284+0000","last_change":"2024-09-21T22:19:11.130435+0000","last_active":"2024-09-21T22:19:16.328284+0000","last_peered":"2024-09-21T22:19:16.328284+0000","last_clean":"2024-09-21T22:19:16.328284+0000","last_became_active":"2024-09-21T22:19:11.130057+0000","last_became_peered":"2024-09-21T22:19:11.130057+0000","last_unstale":"2024-09-21T22:19:16.328284+0000","last_undegraded":"2024-09-21T22:19:16.328284+0000","last_fullsized":"2024-09-21T22:19:16.328284+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:25.382389+0000","last_clean_scrub_stamp":"2024-09-21T22:15:25.382389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:32.125867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328122+0000","last_change":"2024-09-21T22:18:56.918903+0000","last_active":"2024-09-21T22:19:16.328122+0000","last_peered":"2024-09-21T22:19:16.328122+0000","last_clean":"2024-09-21T22:19:16.328122+0000","last_became_active":"2024-09-21T22:18:56.918614+0000","last_became_peered":"2024-09-21T22:18:56.918614+0000","last_unstale":"2024-09-21T22:19:16.328122+0000","last_undegraded":"2024-09-21T22:19:16.328122+0000","last_fullsized":"2024-09-21T22:19:16.328122+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:21.348714+0000","last_clean_scrub_stamp":"2024-09-21T22:15:21.348714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:34.257530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2368,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327723+0000","last_change":"2024-09-21T22:18:47.999320+0000","last_active":"2024-09-21T22:19:16.327723+0000","last_peered":"2024-09-21T22:19:16.327723+0000","last_clean":"2024-09-21T22:19:16.327723+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:19:16.327723+0000","last_undegraded":"2024-09-21T22:19:16.327723+0000","last_fullsized":"2024-09-21T22:19:16.327723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:26:48.484684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"207'563","reported_seq":4572,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.166221+0000","last_change":"2024-09-21T22:18:47.998877+0000","last_active":"2024-09-21T22:19:16.166221+0000","last_peered":"2024-09-21T22:19:16.166221+0000","last_clean":"2024-09-21T22:19:16.166221+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:19:16.166221+0000","last_undegraded":"2024-09-21T22:19:16.166221+0000","last_fullsized":"2024-09-21T22:19:16.166221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:28:36.331429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"199'839","reported_seq":3502,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328095+0000","last_change":"2024-09-21T22:18:48.005215+0000","last_active":"2024-09-21T22:19:16.328095+0000","last_peered":"2024-09-21T22:19:16.328095+0000","last_clean":"2024-09-21T22:19:16.328095+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:19:16.328095+0000","last_undegraded":"2024-09-21T22:19:16.328095+0000","last_fullsized":"2024-09-21T22:19:16.328095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:37:12.667147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"206'863","reported_seq":3114,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327984+0000","last_change":"2024-09-21T22:18:47.997811+0000","last_active":"2024-09-21T22:19:16.327984+0000","last_peered":"2024-09-21T22:19:16.327984+0000","last_clean":"2024-09-21T22:19:16.327984+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:19:16.327984+0000","last_undegraded":"2024-09-21T22:19:16.327984+0000","last_fullsized":"2024-09-21T22:19:16.327984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:36.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"206'503","reported_seq":1977,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328437+0000","last_change":"2024-09-21T22:19:11.131326+0000","last_active":"2024-09-21T22:19:16.328437+0000","last_peered":"2024-09-21T22:19:16.328437+0000","last_clean":"2024-09-21T22:19:16.328437+0000","last_became_active":"2024-09-21T22:19:11.130432+0000","last_became_peered":"2024-09-21T22:19:11.130432+0000","last_unstale":"2024-09-21T22:19:16.328437+0000","last_undegraded":"2024-09-21T22:19:16.328437+0000","last_fullsized":"2024-09-21T22:19:16.328437+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:34.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017990440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1732,"num_read_kb":37996,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"204'655","reported_seq":2836,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328101+0000","last_change":"2024-09-21T22:18:48.005395+0000","last_active":"2024-09-21T22:19:16.328101+0000","last_peered":"2024-09-21T22:19:16.328101+0000","last_clean":"2024-09-21T22:19:16.328101+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:19:16.328101+0000","last_undegraded":"2024-09-21T22:19:16.328101+0000","last_fullsized":"2024-09-21T22:19:16.328101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:47.716979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"207'677","reported_seq":2301,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328226+0000","last_change":"2024-09-21T22:18:48.078362+0000","last_active":"2024-09-21T22:19:16.328226+0000","last_peered":"2024-09-21T22:19:16.328226+0000","last_clean":"2024-09-21T22:19:16.328226+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:19:16.328226+0000","last_undegraded":"2024-09-21T22:19:16.328226+0000","last_fullsized":"2024-09-21T22:19:16.328226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:29.505408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"204'616","reported_seq":3004,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328411+0000","last_change":"2024-09-21T22:18:56.917619+0000","last_active":"2024-09-21T22:19:16.328411+0000","last_peered":"2024-09-21T22:19:16.328411+0000","last_clean":"2024-09-21T22:19:16.328411+0000","last_became_active":"2024-09-21T22:18:56.916154+0000","last_became_peered":"2024-09-21T22:18:56.916154+0000","last_unstale":"2024-09-21T22:19:16.328411+0000","last_undegraded":"2024-09-21T22:19:16.328411+0000","last_fullsized":"2024-09-21T22:19:16.328411+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:01:54.099402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"204'395","reported_seq":2607,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327871+0000","last_change":"2024-09-21T22:18:48.005124+0000","last_active":"2024-09-21T22:19:16.327871+0000","last_peered":"2024-09-21T22:19:16.327871+0000","last_clean":"2024-09-21T22:19:16.327871+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:19:16.327871+0000","last_undegraded":"2024-09-21T22:19:16.327871+0000","last_fullsized":"2024-09-21T22:19:16.327871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:14:49.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"207'713","reported_seq":2509,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328215+0000","last_change":"2024-09-21T22:18:48.077511+0000","last_active":"2024-09-21T22:19:16.328215+0000","last_peered":"2024-09-21T22:19:16.328215+0000","last_clean":"2024-09-21T22:19:16.328215+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:19:16.328215+0000","last_undegraded":"2024-09-21T22:19:16.328215+0000","last_fullsized":"2024-09-21T22:19:16.328215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:48.765781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"204'591","reported_seq":7440,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.327760+0000","last_change":"2024-09-21T22:19:03.071739+0000","last_active":"2024-09-21T22:19:16.327760+0000","last_peered":"2024-09-21T22:19:16.327760+0000","last_clean":"2024-09-21T22:19:16.327760+0000","last_became_active":"2024-09-21T22:19:03.070891+0000","last_became_peered":"2024-09-21T22:19:03.070891+0000","last_unstale":"2024-09-21T22:19:16.327760+0000","last_undegraded":"2024-09-21T22:19:16.327760+0000","last_fullsized":"2024-09-21T22:19:16.327760+0000","mapping_epoch":218,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":219,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011971970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"207'699","reported_seq":12591,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:16.328405+0000","last_change":"2024-09-21T22:18:48.078502+0000","last_active":"2024-09-21T22:19:16.328405+0000","last_peered":"2024-09-21T22:19:16.328405+0000","last_clean":"2024-09-21T22:19:16.328405+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:19:16.328405+0000","last_undegraded":"2024-09-21T22:19:16.328405+0000","last_fullsized":"2024-09-21T22:19:16.328405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:15:35.421467+0000","last_clean_scrub_stamp":"2024-09-21T22:15:35.421467+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:26.495741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216012,"num_read_kb":1301047,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1909,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78928,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292912,"statfs":{"total":96636764160,"available":96555941888,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29776,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342064,"statfs":{"total":96636764160,"available":96606273536,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74196,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297644,"statfs":{"total":96636764160,"available":96560787456,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74192,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297648,"statfs":{"total":96636764160,"available":96560791552,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528363,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57228,"kb_used_data":2744,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314612,"statfs":{"total":96636764160,"available":96578162688,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42252,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329588,"statfs":{"total":96636764160,"available":96593498112,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33940,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337900,"statfs":{"total":96636764160,"available":96602009600,"internally_reserved":0,"allocated":2818048,"data_stored":1388746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70604,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301236,"statfs":{"total":96636764160,"available":96564465664,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:19:26.136 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.136 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.137 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.138 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T22:15:25.382389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T22:15:21.348714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.139 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.140 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.141 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.141 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T22:15:35.421467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=19, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:19:26.141 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T22:19:46.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:19:46.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T22:19:46.435 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-09-21T22:19:46.447 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-21T22:19:45.218650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216128,"num_read_kb":1301147,"num_write":27954,"num_write_kb":884545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1913,"num_bytes_recovered":167371473,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21795,"ondisk_log_size":21795,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461080,"kb_used_data":23128,"kb_used_omap":15,"kb_used_meta":437808,"kb_avail":754513640,"statfs":{"total":773094113280,"available":772621967360,"internally_reserved":0,"allocated":23683072,"data_stored":12290476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":448316188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002624"},"pg_stats":[{"pgid":"3.1f","version":"207'1281","reported_seq":27925,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:25.235505+0000","last_change":"2024-09-21T22:19:25.235527+0000","last_active":"2024-09-21T22:19:25.235505+0000","last_peered":"2024-09-21T22:19:25.235505+0000","last_clean":"2024-09-21T22:19:25.235505+0000","last_became_active":"2024-09-21T22:15:36.449087+0000","last_became_peered":"2024-09-21T22:15:36.449087+0000","last_unstale":"2024-09-21T22:19:25.235505+0000","last_undegraded":"2024-09-21T22:19:25.235505+0000","last_fullsized":"2024-09-21T22:19:25.235505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'1281","last_scrub_stamp":"2024-09-21T22:19:25.235435+0000","last_deep_scrub":"207'1281","last_deep_scrub_stamp":"2024-09-21T22:19:25.235435+0000","last_clean_scrub_stamp":"2024-09-21T22:19:25.235435+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:20:52.264323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072631900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30041,"num_read_kb":75552,"num_write":2102,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"207'807","reported_seq":4700,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:30.039525+0000","last_change":"2024-09-21T22:19:30.039553+0000","last_active":"2024-09-21T22:19:30.039525+0000","last_peered":"2024-09-21T22:19:30.039525+0000","last_clean":"2024-09-21T22:19:30.039525+0000","last_became_active":"2024-09-21T22:16:03.922868+0000","last_became_peered":"2024-09-21T22:16:03.922868+0000","last_unstale":"2024-09-21T22:19:30.039525+0000","last_undegraded":"2024-09-21T22:19:30.039525+0000","last_fullsized":"2024-09-21T22:19:30.039525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'807","last_scrub_stamp":"2024-09-21T22:19:30.039394+0000","last_deep_scrub":"207'807","last_deep_scrub_stamp":"2024-09-21T22:19:30.039394+0000","last_clean_scrub_stamp":"2024-09-21T22:19:30.039394+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:41:17.764171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00131113,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5601,"num_read_kb":36647,"num_write":957,"num_write_kb":21933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1793131,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"207'464","reported_seq":8644,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:27.684976+0000","last_change":"2024-09-21T22:19:27.685006+0000","last_active":"2024-09-21T22:19:27.684976+0000","last_peered":"2024-09-21T22:19:27.684976+0000","last_clean":"2024-09-21T22:19:27.684976+0000","last_became_active":"2024-09-21T22:19:11.126877+0000","last_became_peered":"2024-09-21T22:19:11.126877+0000","last_unstale":"2024-09-21T22:19:27.684976+0000","last_undegraded":"2024-09-21T22:19:27.684976+0000","last_fullsized":"2024-09-21T22:19:27.684976+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'464","last_scrub_stamp":"2024-09-21T22:19:27.684879+0000","last_deep_scrub":"207'464","last_deep_scrub_stamp":"2024-09-21T22:19:27.684879+0000","last_clean_scrub_stamp":"2024-09-21T22:19:27.684879+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:18:05.831348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011014060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7616,"num_read_kb":59998,"num_write":531,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":12798515,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"232'920","reported_seq":3886,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:26.713263+0000","last_change":"2024-09-21T22:19:26.713288+0000","last_active":"2024-09-21T22:19:26.713263+0000","last_peered":"2024-09-21T22:19:26.713263+0000","last_clean":"2024-09-21T22:19:26.713263+0000","last_became_active":"2024-09-21T22:19:11.127057+0000","last_became_peered":"2024-09-21T22:19:11.127057+0000","last_unstale":"2024-09-21T22:19:26.713263+0000","last_undegraded":"2024-09-21T22:19:26.713263+0000","last_fullsized":"2024-09-21T22:19:26.713263+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"232'920","last_scrub_stamp":"2024-09-21T22:19:26.713179+0000","last_deep_scrub":"232'920","last_deep_scrub_stamp":"2024-09-21T22:19:26.713179+0000","last_clean_scrub_stamp":"2024-09-21T22:19:26.713179+0000","objects_scrubbed":1,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:00:02.053711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000816448,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4692,"num_read_kb":35493,"num_write":1359,"num_write_kb":41463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":15662282,"num_keys_recovered":62,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"206'513","reported_seq":11194,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:26.252981+0000","last_change":"2024-09-21T22:19:26.253004+0000","last_active":"2024-09-21T22:19:26.252981+0000","last_peered":"2024-09-21T22:19:26.252981+0000","last_clean":"2024-09-21T22:19:26.252981+0000","last_became_active":"2024-09-21T22:16:48.956707+0000","last_became_peered":"2024-09-21T22:16:48.956707+0000","last_unstale":"2024-09-21T22:19:26.252981+0000","last_undegraded":"2024-09-21T22:19:26.252981+0000","last_fullsized":"2024-09-21T22:19:26.252981+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'513","last_scrub_stamp":"2024-09-21T22:19:26.252902+0000","last_deep_scrub":"206'513","last_deep_scrub_stamp":"2024-09-21T22:19:26.252902+0000","last_clean_scrub_stamp":"2024-09-21T22:19:26.252902+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:04.249683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039053800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10918,"num_read_kb":37469,"num_write":524,"num_write_kb":23308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":11779814,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"232'363","reported_seq":3344,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:27.187892+0000","last_change":"2024-09-21T22:19:27.187922+0000","last_active":"2024-09-21T22:19:27.187892+0000","last_peered":"2024-09-21T22:19:27.187892+0000","last_clean":"2024-09-21T22:19:27.187892+0000","last_became_active":"2024-09-21T22:16:48.957086+0000","last_became_peered":"2024-09-21T22:16:48.957086+0000","last_unstale":"2024-09-21T22:19:27.187892+0000","last_undegraded":"2024-09-21T22:19:27.187892+0000","last_fullsized":"2024-09-21T22:19:27.187892+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"232'363","last_scrub_stamp":"2024-09-21T22:19:27.187802+0000","last_deep_scrub":"232'363","last_deep_scrub_stamp":"2024-09-21T22:19:27.187802+0000","last_clean_scrub_stamp":"2024-09-21T22:19:27.187802+0000","objects_scrubbed":1,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:45.153773+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00093681999999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2580,"num_read_kb":17674,"num_write":422,"num_write_kb":17807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":5342878,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"206'814","reported_seq":4134,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:27.936031+0000","last_change":"2024-09-21T22:19:27.936068+0000","last_active":"2024-09-21T22:19:27.936031+0000","last_peered":"2024-09-21T22:19:27.936031+0000","last_clean":"2024-09-21T22:19:27.936031+0000","last_became_active":"2024-09-21T22:16:03.922719+0000","last_became_peered":"2024-09-21T22:16:03.922719+0000","last_unstale":"2024-09-21T22:19:27.936031+0000","last_undegraded":"2024-09-21T22:19:27.936031+0000","last_fullsized":"2024-09-21T22:19:27.936031+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'814","last_scrub_stamp":"2024-09-21T22:19:27.935920+0000","last_deep_scrub":"206'814","last_deep_scrub_stamp":"2024-09-21T22:19:27.935920+0000","last_clean_scrub_stamp":"2024-09-21T22:19:27.935920+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:38.633201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0018695719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5620,"num_read_kb":28581,"num_write":886,"num_write_kb":24198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1448379,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"204'840","reported_seq":2855,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:27.026468+0000","last_change":"2024-09-21T22:19:27.026492+0000","last_active":"2024-09-21T22:19:27.026468+0000","last_peered":"2024-09-21T22:19:27.026468+0000","last_clean":"2024-09-21T22:19:27.026468+0000","last_became_active":"2024-09-21T22:16:00.919551+0000","last_became_peered":"2024-09-21T22:16:00.919551+0000","last_unstale":"2024-09-21T22:19:27.026468+0000","last_undegraded":"2024-09-21T22:19:27.026468+0000","last_fullsized":"2024-09-21T22:19:27.026468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'840","last_scrub_stamp":"2024-09-21T22:19:27.026366+0000","last_deep_scrub":"204'840","last_deep_scrub_stamp":"2024-09-21T22:19:27.026366+0000","last_clean_scrub_stamp":"2024-09-21T22:19:27.026366+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:49:02.190624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057185899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3834,"num_read_kb":23052,"num_write":1014,"num_write_kb":27287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":57912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"206'1170","reported_seq":4072,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:23.281841+0000","last_change":"2024-09-21T22:19:23.281870+0000","last_active":"2024-09-21T22:19:23.281841+0000","last_peered":"2024-09-21T22:19:23.281841+0000","last_clean":"2024-09-21T22:19:23.281841+0000","last_became_active":"2024-09-21T22:15:36.447461+0000","last_became_peered":"2024-09-21T22:15:36.447461+0000","last_unstale":"2024-09-21T22:19:23.281841+0000","last_undegraded":"2024-09-21T22:19:23.281841+0000","last_fullsized":"2024-09-21T22:19:23.281841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'1170","last_scrub_stamp":"2024-09-21T22:19:23.281753+0000","last_deep_scrub":"206'1170","last_deep_scrub_stamp":"2024-09-21T22:19:23.281753+0000","last_clean_scrub_stamp":"2024-09-21T22:19:23.281753+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:18:38.026324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047086600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6324,"num_read_kb":35494,"num_write":1987,"num_write_kb":25035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"207'318","reported_seq":14502,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:28.926463+0000","last_change":"2024-09-21T22:19:28.926490+0000","last_active":"2024-09-21T22:19:28.926463+0000","last_peered":"2024-09-21T22:19:28.926463+0000","last_clean":"2024-09-21T22:19:28.926463+0000","last_became_active":"2024-09-21T22:16:20.897080+0000","last_became_peered":"2024-09-21T22:16:20.897080+0000","last_unstale":"2024-09-21T22:19:28.926463+0000","last_undegraded":"2024-09-21T22:19:28.926463+0000","last_fullsized":"2024-09-21T22:19:28.926463+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'318","last_scrub_stamp":"2024-09-21T22:19:28.926364+0000","last_deep_scrub":"207'318","last_deep_scrub_stamp":"2024-09-21T22:19:28.926364+0000","last_clean_scrub_stamp":"2024-09-21T22:19:28.926364+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:07:28.517847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734380000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14197,"num_read_kb":54266,"num_write":388,"num_write_kb":26438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":320555,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"207'898","reported_seq":3871,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:28.501293+0000","last_change":"2024-09-21T22:19:28.501318+0000","last_active":"2024-09-21T22:19:28.501293+0000","last_peered":"2024-09-21T22:19:28.501293+0000","last_clean":"2024-09-21T22:19:28.501293+0000","last_became_active":"2024-09-21T22:18:32.911133+0000","last_became_peered":"2024-09-21T22:18:32.911133+0000","last_unstale":"2024-09-21T22:19:28.501293+0000","last_undegraded":"2024-09-21T22:19:28.501293+0000","last_fullsized":"2024-09-21T22:19:28.501293+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'898","last_scrub_stamp":"2024-09-21T22:19:28.501198+0000","last_deep_scrub":"207'898","last_deep_scrub_stamp":"2024-09-21T22:19:28.501198+0000","last_clean_scrub_stamp":"2024-09-21T22:19:28.501198+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:39:20.476898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014083170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4475,"num_read_kb":45848,"num_write":1241,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":13919372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"205'1008","reported_seq":5160,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:28.222501+0000","last_change":"2024-09-21T22:19:28.222540+0000","last_active":"2024-09-21T22:19:28.222501+0000","last_peered":"2024-09-21T22:19:28.222501+0000","last_clean":"2024-09-21T22:19:28.222501+0000","last_became_active":"2024-09-21T22:16:48.959087+0000","last_became_peered":"2024-09-21T22:16:48.959087+0000","last_unstale":"2024-09-21T22:19:28.222501+0000","last_undegraded":"2024-09-21T22:19:28.222501+0000","last_fullsized":"2024-09-21T22:19:28.222501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"205'1008","last_scrub_stamp":"2024-09-21T22:19:28.222399+0000","last_deep_scrub":"205'1008","last_deep_scrub_stamp":"2024-09-21T22:19:28.222399+0000","last_clean_scrub_stamp":"2024-09-21T22:19:28.222399+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:40.877372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010352250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5994,"num_read_kb":47956,"num_write":1470,"num_write_kb":26846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":6694844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":454,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:29.530757+0000","last_change":"2024-09-21T22:19:29.530807+0000","last_active":"2024-09-21T22:19:29.530757+0000","last_peered":"2024-09-21T22:19:29.530757+0000","last_clean":"2024-09-21T22:19:29.530757+0000","last_became_active":"2024-09-21T22:18:54.034243+0000","last_became_peered":"2024-09-21T22:18:54.034243+0000","last_unstale":"2024-09-21T22:19:29.530757+0000","last_undegraded":"2024-09-21T22:19:29.530757+0000","last_fullsized":"2024-09-21T22:19:29.530757+0000","mapping_epoch":212,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":213,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:19:29.530644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:19:29.530644+0000","last_clean_scrub_stamp":"2024-09-21T22:19:29.530644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:49:43.752513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000402622,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"207'525","reported_seq":4236,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:24.245282+0000","last_change":"2024-09-21T22:19:24.245305+0000","last_active":"2024-09-21T22:19:24.245282+0000","last_peered":"2024-09-21T22:19:24.245282+0000","last_clean":"2024-09-21T22:19:24.245282+0000","last_became_active":"2024-09-21T22:15:36.447473+0000","last_became_peered":"2024-09-21T22:15:36.447473+0000","last_unstale":"2024-09-21T22:19:24.245282+0000","last_undegraded":"2024-09-21T22:19:24.245282+0000","last_fullsized":"2024-09-21T22:19:24.245282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'525","last_scrub_stamp":"2024-09-21T22:19:24.245203+0000","last_deep_scrub":"207'525","last_deep_scrub_stamp":"2024-09-21T22:19:24.245203+0000","last_clean_scrub_stamp":"2024-09-21T22:19:24.245203+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:57:42.469612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060790400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3870,"num_read_kb":43571,"num_write":520,"num_write_kb":27046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":449,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:24.023128+0000","last_change":"2024-09-21T22:19:24.023149+0000","last_active":"2024-09-21T22:19:24.023128+0000","last_peered":"2024-09-21T22:19:24.023128+0000","last_clean":"2024-09-21T22:19:24.023128+0000","last_became_active":"2024-09-21T22:15:26.398804+0000","last_became_peered":"2024-09-21T22:15:26.398804+0000","last_unstale":"2024-09-21T22:19:24.023128+0000","last_undegraded":"2024-09-21T22:19:24.023128+0000","last_fullsized":"2024-09-21T22:19:24.023128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:19:24.023050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:19:24.023050+0000","last_clean_scrub_stamp":"2024-09-21T22:19:24.023050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:59:40.390080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053843999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"206'498","reported_seq":11264,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:24.995819+0000","last_change":"2024-09-21T22:19:24.995870+0000","last_active":"2024-09-21T22:19:24.995819+0000","last_peered":"2024-09-21T22:19:24.995819+0000","last_clean":"2024-09-21T22:19:24.995819+0000","last_became_active":"2024-09-21T22:16:00.916180+0000","last_became_peered":"2024-09-21T22:16:00.916180+0000","last_unstale":"2024-09-21T22:19:24.995819+0000","last_undegraded":"2024-09-21T22:19:24.995819+0000","last_fullsized":"2024-09-21T22:19:24.995819+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'498","last_scrub_stamp":"2024-09-21T22:19:24.995692+0000","last_deep_scrub":"206'498","last_deep_scrub_stamp":"2024-09-21T22:19:24.995692+0000","last_clean_scrub_stamp":"2024-09-21T22:19:24.995692+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:11:08.232491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019527570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10824,"num_read_kb":38469,"num_write":610,"num_write_kb":22037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1839595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":450,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:27.300699+0000","last_change":"2024-09-21T22:19:27.300699+0000","last_active":"2024-09-21T22:19:27.300699+0000","last_peered":"2024-09-21T22:19:27.300699+0000","last_clean":"2024-09-21T22:19:27.300699+0000","last_became_active":"2024-09-21T22:15:26.685344+0000","last_became_peered":"2024-09-21T22:15:26.685344+0000","last_unstale":"2024-09-21T22:19:27.300699+0000","last_undegraded":"2024-09-21T22:19:27.300699+0000","last_fullsized":"2024-09-21T22:19:27.300699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:19:27.300575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:19:27.300575+0000","last_clean_scrub_stamp":"2024-09-21T22:19:27.300575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:08:38.683146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00047785200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"206'554","reported_seq":10304,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:25.943794+0000","last_change":"2024-09-21T22:19:25.943815+0000","last_active":"2024-09-21T22:19:25.943794+0000","last_peered":"2024-09-21T22:19:25.943794+0000","last_clean":"2024-09-21T22:19:25.943794+0000","last_became_active":"2024-09-21T22:15:36.554095+0000","last_became_peered":"2024-09-21T22:15:36.554095+0000","last_unstale":"2024-09-21T22:19:25.943794+0000","last_undegraded":"2024-09-21T22:19:25.943794+0000","last_fullsized":"2024-09-21T22:19:25.943794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'554","last_scrub_stamp":"2024-09-21T22:19:25.943711+0000","last_deep_scrub":"206'554","last_deep_scrub_stamp":"2024-09-21T22:19:25.943711+0000","last_clean_scrub_stamp":"2024-09-21T22:19:25.943711+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:01.967898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042018099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9640,"num_read_kb":64454,"num_write":599,"num_write_kb":36440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":450,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:24.988667+0000","last_change":"2024-09-21T22:19:24.988667+0000","last_active":"2024-09-21T22:19:24.988667+0000","last_peered":"2024-09-21T22:19:24.988667+0000","last_clean":"2024-09-21T22:19:24.988667+0000","last_became_active":"2024-09-21T22:15:26.685738+0000","last_became_peered":"2024-09-21T22:15:26.685738+0000","last_unstale":"2024-09-21T22:19:24.988667+0000","last_undegraded":"2024-09-21T22:19:24.988667+0000","last_fullsized":"2024-09-21T22:19:24.988667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:19:24.988569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:19:24.988569+0000","last_clean_scrub_stamp":"2024-09-21T22:19:24.988569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:15:55.256291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052145800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"205'520","reported_seq":14486,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:30.655667+0000","last_change":"2024-09-21T22:19:30.655693+0000","last_active":"2024-09-21T22:19:30.655667+0000","last_peered":"2024-09-21T22:19:30.655667+0000","last_clean":"2024-09-21T22:19:30.655667+0000","last_became_active":"2024-09-21T22:19:11.130054+0000","last_became_peered":"2024-09-21T22:19:11.130054+0000","last_unstale":"2024-09-21T22:19:30.655667+0000","last_undegraded":"2024-09-21T22:19:30.655667+0000","last_fullsized":"2024-09-21T22:19:30.655667+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"205'520","last_scrub_stamp":"2024-09-21T22:19:30.655571+0000","last_deep_scrub":"205'520","last_deep_scrub_stamp":"2024-09-21T22:19:30.655571+0000","last_clean_scrub_stamp":"2024-09-21T22:19:30.655571+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:47:48.397064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0021147060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14002,"num_read_kb":60968,"num_write":557,"num_write_kb":24469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2160332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"232'771","reported_seq":4377,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:25.186584+0000","last_change":"2024-09-21T22:19:25.186613+0000","last_active":"2024-09-21T22:19:25.186584+0000","last_peered":"2024-09-21T22:19:25.186584+0000","last_clean":"2024-09-21T22:19:25.186584+0000","last_became_active":"2024-09-21T22:16:48.956444+0000","last_became_peered":"2024-09-21T22:16:48.956444+0000","last_unstale":"2024-09-21T22:19:25.186584+0000","last_undegraded":"2024-09-21T22:19:25.186584+0000","last_fullsized":"2024-09-21T22:19:25.186584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"232'771","last_scrub_stamp":"2024-09-21T22:19:25.186498+0000","last_deep_scrub":"232'771","last_deep_scrub_stamp":"2024-09-21T22:19:25.186498+0000","last_clean_scrub_stamp":"2024-09-21T22:19:25.186498+0000","objects_scrubbed":1,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:42:17.040033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011438889999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4452,"num_read_kb":41186,"num_write":800,"num_write_kb":35721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":11011686,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"232'3","reported_seq":208,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:25.703051+0000","last_change":"2024-09-21T22:19:25.703114+0000","last_active":"2024-09-21T22:19:25.703051+0000","last_peered":"2024-09-21T22:19:25.703051+0000","last_clean":"2024-09-21T22:19:25.703051+0000","last_became_active":"2024-09-21T22:19:11.127479+0000","last_became_peered":"2024-09-21T22:19:11.127479+0000","last_unstale":"2024-09-21T22:19:25.703051+0000","last_undegraded":"2024-09-21T22:19:25.703051+0000","last_fullsized":"2024-09-21T22:19:25.703051+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"232'3","last_scrub_stamp":"2024-09-21T22:19:25.702934+0000","last_deep_scrub":"232'3","last_deep_scrub_stamp":"2024-09-21T22:19:25.702934+0000","last_clean_scrub_stamp":"2024-09-21T22:19:25.702934+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:06:47.147774+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00094300799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"205'709","reported_seq":18503,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:26.919492+0000","last_change":"2024-09-21T22:19:26.919492+0000","last_active":"2024-09-21T22:19:26.919492+0000","last_peered":"2024-09-21T22:19:26.919492+0000","last_clean":"2024-09-21T22:19:26.919492+0000","last_became_active":"2024-09-21T22:15:36.554129+0000","last_became_peered":"2024-09-21T22:15:36.554129+0000","last_unstale":"2024-09-21T22:19:26.919492+0000","last_undegraded":"2024-09-21T22:19:26.919492+0000","last_fullsized":"2024-09-21T22:19:26.919492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"205'709","last_scrub_stamp":"2024-09-21T22:19:26.919367+0000","last_deep_scrub":"205'709","last_deep_scrub_stamp":"2024-09-21T22:19:26.919367+0000","last_clean_scrub_stamp":"2024-09-21T22:19:26.919367+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:53:31.683554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002023899,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18030,"num_read_kb":72580,"num_write":839,"num_write_kb":33449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":404,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:23.885104+0000","last_change":"2024-09-21T22:19:23.885104+0000","last_active":"2024-09-21T22:19:23.885104+0000","last_peered":"2024-09-21T22:19:23.885104+0000","last_clean":"2024-09-21T22:19:23.885104+0000","last_became_active":"2024-09-21T22:19:07.095030+0000","last_became_peered":"2024-09-21T22:19:07.095030+0000","last_unstale":"2024-09-21T22:19:23.885104+0000","last_undegraded":"2024-09-21T22:19:23.885104+0000","last_fullsized":"2024-09-21T22:19:23.885104+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:19:23.885002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:19:23.885002+0000","last_clean_scrub_stamp":"2024-09-21T22:19:23.885002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:02:26.473315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"206'447","reported_seq":2632,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:27.213221+0000","last_change":"2024-09-21T22:19:27.213248+0000","last_active":"2024-09-21T22:19:27.213221+0000","last_peered":"2024-09-21T22:19:27.213221+0000","last_clean":"2024-09-21T22:19:27.213221+0000","last_became_active":"2024-09-21T22:17:27.897678+0000","last_became_peered":"2024-09-21T22:17:27.897678+0000","last_unstale":"2024-09-21T22:19:27.213221+0000","last_undegraded":"2024-09-21T22:19:27.213221+0000","last_fullsized":"2024-09-21T22:19:27.213221+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'447","last_scrub_stamp":"2024-09-21T22:19:27.213127+0000","last_deep_scrub":"206'447","last_deep_scrub_stamp":"2024-09-21T22:19:27.213127+0000","last_clean_scrub_stamp":"2024-09-21T22:19:27.213127+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:08:50.571307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000421431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":29474,"num_write":592,"num_write_kb":25528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":16016290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":450,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:26.314921+0000","last_change":"2024-09-21T22:19:26.314921+0000","last_active":"2024-09-21T22:19:26.314921+0000","last_peered":"2024-09-21T22:19:26.314921+0000","last_clean":"2024-09-21T22:19:26.314921+0000","last_became_active":"2024-09-21T22:15:26.404435+0000","last_became_peered":"2024-09-21T22:15:26.404435+0000","last_unstale":"2024-09-21T22:19:26.314921+0000","last_undegraded":"2024-09-21T22:19:26.314921+0000","last_fullsized":"2024-09-21T22:19:26.314921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:19:26.314756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:19:26.314756+0000","last_clean_scrub_stamp":"2024-09-21T22:19:26.314756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:29:28.998597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046480600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"206'428","reported_seq":1849,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:25.987555+0000","last_change":"2024-09-21T22:19:25.987595+0000","last_active":"2024-09-21T22:19:25.987555+0000","last_peered":"2024-09-21T22:19:25.987555+0000","last_clean":"2024-09-21T22:19:25.987555+0000","last_became_active":"2024-09-21T22:16:00.917423+0000","last_became_peered":"2024-09-21T22:16:00.917423+0000","last_unstale":"2024-09-21T22:19:25.987555+0000","last_undegraded":"2024-09-21T22:19:25.987555+0000","last_fullsized":"2024-09-21T22:19:25.987555+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'428","last_scrub_stamp":"2024-09-21T22:19:25.987448+0000","last_deep_scrub":"206'428","last_deep_scrub_stamp":"2024-09-21T22:19:25.987448+0000","last_clean_scrub_stamp":"2024-09-21T22:19:25.987448+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:44:03.838403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095942800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1204,"num_read_kb":37424,"num_write":513,"num_write_kb":28466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1519094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"232'2","reported_seq":266,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:28.684299+0000","last_change":"2024-09-21T22:19:28.684349+0000","last_active":"2024-09-21T22:19:28.684299+0000","last_peered":"2024-09-21T22:19:28.684299+0000","last_clean":"2024-09-21T22:19:28.684299+0000","last_became_active":"2024-09-21T22:19:11.130057+0000","last_became_peered":"2024-09-21T22:19:11.130057+0000","last_unstale":"2024-09-21T22:19:28.684299+0000","last_undegraded":"2024-09-21T22:19:28.684299+0000","last_fullsized":"2024-09-21T22:19:28.684299+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"232'2","last_scrub_stamp":"2024-09-21T22:19:28.684214+0000","last_deep_scrub":"232'2","last_deep_scrub_stamp":"2024-09-21T22:19:28.684214+0000","last_clean_scrub_stamp":"2024-09-21T22:19:28.684214+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:52:12.642334+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00041056300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"232'119","reported_seq":251,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:32.409456+0000","last_change":"2024-09-21T22:19:32.409508+0000","last_active":"2024-09-21T22:19:32.409456+0000","last_peered":"2024-09-21T22:19:32.409456+0000","last_clean":"2024-09-21T22:19:32.409456+0000","last_became_active":"2024-09-21T22:18:56.918614+0000","last_became_peered":"2024-09-21T22:18:56.918614+0000","last_unstale":"2024-09-21T22:19:32.409456+0000","last_undegraded":"2024-09-21T22:19:32.409456+0000","last_fullsized":"2024-09-21T22:19:32.409456+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"232'119","last_scrub_stamp":"2024-09-21T22:19:32.409355+0000","last_deep_scrub":"232'119","last_deep_scrub_stamp":"2024-09-21T22:19:32.409355+0000","last_clean_scrub_stamp":"2024-09-21T22:19:32.409355+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:10:56.078368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"206'709","reported_seq":2377,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:29.017262+0000","last_change":"2024-09-21T22:19:29.017289+0000","last_active":"2024-09-21T22:19:29.017262+0000","last_peered":"2024-09-21T22:19:29.017262+0000","last_clean":"2024-09-21T22:19:29.017262+0000","last_became_active":"2024-09-21T22:16:03.922317+0000","last_became_peered":"2024-09-21T22:16:03.922317+0000","last_unstale":"2024-09-21T22:19:29.017262+0000","last_undegraded":"2024-09-21T22:19:29.017262+0000","last_fullsized":"2024-09-21T22:19:29.017262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'709","last_scrub_stamp":"2024-09-21T22:19:29.017167+0000","last_deep_scrub":"206'709","last_deep_scrub_stamp":"2024-09-21T22:19:29.017167+0000","last_clean_scrub_stamp":"2024-09-21T22:19:29.017167+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:15:18.700830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021342319999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2565,"num_read_kb":21752,"num_write":997,"num_write_kb":21297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1908228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"207'563","reported_seq":4581,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:26.214235+0000","last_change":"2024-09-21T22:19:26.214262+0000","last_active":"2024-09-21T22:19:26.214235+0000","last_peered":"2024-09-21T22:19:26.214235+0000","last_clean":"2024-09-21T22:19:26.214235+0000","last_became_active":"2024-09-21T22:16:48.956839+0000","last_became_peered":"2024-09-21T22:16:48.956839+0000","last_unstale":"2024-09-21T22:19:26.214235+0000","last_undegraded":"2024-09-21T22:19:26.214235+0000","last_fullsized":"2024-09-21T22:19:26.214235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'563","last_scrub_stamp":"2024-09-21T22:19:26.214140+0000","last_deep_scrub":"207'563","last_deep_scrub_stamp":"2024-09-21T22:19:26.214140+0000","last_clean_scrub_stamp":"2024-09-21T22:19:26.214140+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:28:28.081180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00059336899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4501,"num_read_kb":58687,"num_write":671,"num_write_kb":34443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3383196,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"199'839","reported_seq":3511,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:27.516848+0000","last_change":"2024-09-21T22:19:27.516875+0000","last_active":"2024-09-21T22:19:27.516848+0000","last_peered":"2024-09-21T22:19:27.516848+0000","last_clean":"2024-09-21T22:19:27.516848+0000","last_became_active":"2024-09-21T22:16:48.961426+0000","last_became_peered":"2024-09-21T22:16:48.961426+0000","last_unstale":"2024-09-21T22:19:27.516848+0000","last_undegraded":"2024-09-21T22:19:27.516848+0000","last_fullsized":"2024-09-21T22:19:27.516848+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'839","last_scrub_stamp":"2024-09-21T22:19:27.516747+0000","last_deep_scrub":"199'839","last_deep_scrub_stamp":"2024-09-21T22:19:27.516747+0000","last_clean_scrub_stamp":"2024-09-21T22:19:27.516747+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:05.472471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052590799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4351,"num_read_kb":33397,"num_write":1003,"num_write_kb":20735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":4664776,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"206'863","reported_seq":3123,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:28.054646+0000","last_change":"2024-09-21T22:19:28.054672+0000","last_active":"2024-09-21T22:19:28.054646+0000","last_peered":"2024-09-21T22:19:28.054646+0000","last_clean":"2024-09-21T22:19:28.054646+0000","last_became_active":"2024-09-21T22:16:00.919628+0000","last_became_peered":"2024-09-21T22:16:00.919628+0000","last_unstale":"2024-09-21T22:19:28.054646+0000","last_undegraded":"2024-09-21T22:19:28.054646+0000","last_fullsized":"2024-09-21T22:19:28.054646+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'863","last_scrub_stamp":"2024-09-21T22:19:28.054553+0000","last_deep_scrub":"206'863","last_deep_scrub_stamp":"2024-09-21T22:19:28.054553+0000","last_clean_scrub_stamp":"2024-09-21T22:19:28.054553+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:13:38.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067658400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4806,"num_read_kb":31576,"num_write":1102,"num_write_kb":31272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1069761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"206'503","reported_seq":1986,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:29.660610+0000","last_change":"2024-09-21T22:19:29.660643+0000","last_active":"2024-09-21T22:19:29.660610+0000","last_peered":"2024-09-21T22:19:29.660610+0000","last_clean":"2024-09-21T22:19:29.660610+0000","last_became_active":"2024-09-21T22:19:11.130432+0000","last_became_peered":"2024-09-21T22:19:11.130432+0000","last_unstale":"2024-09-21T22:19:29.660610+0000","last_undegraded":"2024-09-21T22:19:29.660610+0000","last_fullsized":"2024-09-21T22:19:29.660610+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"206'503","last_scrub_stamp":"2024-09-21T22:19:29.660501+0000","last_deep_scrub":"206'503","last_deep_scrub_stamp":"2024-09-21T22:19:29.660501+0000","last_clean_scrub_stamp":"2024-09-21T22:19:29.660501+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:38:20.817812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017990440000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1732,"num_read_kb":37996,"num_write":671,"num_write_kb":23546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":73536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"204'655","reported_seq":2845,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:26.553752+0000","last_change":"2024-09-21T22:19:26.553807+0000","last_active":"2024-09-21T22:19:26.553752+0000","last_peered":"2024-09-21T22:19:26.553752+0000","last_clean":"2024-09-21T22:19:26.553752+0000","last_became_active":"2024-09-21T22:16:36.888283+0000","last_became_peered":"2024-09-21T22:16:36.888283+0000","last_unstale":"2024-09-21T22:19:26.553752+0000","last_undegraded":"2024-09-21T22:19:26.553752+0000","last_fullsized":"2024-09-21T22:19:26.553752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'655","last_scrub_stamp":"2024-09-21T22:19:26.553643+0000","last_deep_scrub":"204'655","last_deep_scrub_stamp":"2024-09-21T22:19:26.553643+0000","last_clean_scrub_stamp":"2024-09-21T22:19:26.553643+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:10:45.665105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00065907400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3623,"num_read_kb":26546,"num_write":819,"num_write_kb":20243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2090106,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"207'677","reported_seq":2310,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:28.343645+0000","last_change":"2024-09-21T22:19:28.343688+0000","last_active":"2024-09-21T22:19:28.343645+0000","last_peered":"2024-09-21T22:19:28.343645+0000","last_clean":"2024-09-21T22:19:28.343645+0000","last_became_active":"2024-09-21T22:16:45.937509+0000","last_became_peered":"2024-09-21T22:16:45.937509+0000","last_unstale":"2024-09-21T22:19:28.343645+0000","last_undegraded":"2024-09-21T22:19:28.343645+0000","last_fullsized":"2024-09-21T22:19:28.343645+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'677","last_scrub_stamp":"2024-09-21T22:19:28.343511+0000","last_deep_scrub":"207'677","last_deep_scrub_stamp":"2024-09-21T22:19:28.343511+0000","last_clean_scrub_stamp":"2024-09-21T22:19:28.343511+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:56:42.829543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021638310000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":32922,"num_write":949,"num_write_kb":31401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6951854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"204'616","reported_seq":3013,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:31.381811+0000","last_change":"2024-09-21T22:19:31.381838+0000","last_active":"2024-09-21T22:19:31.381811+0000","last_peered":"2024-09-21T22:19:31.381811+0000","last_clean":"2024-09-21T22:19:31.381811+0000","last_became_active":"2024-09-21T22:18:56.916154+0000","last_became_peered":"2024-09-21T22:18:56.916154+0000","last_unstale":"2024-09-21T22:19:31.381811+0000","last_undegraded":"2024-09-21T22:19:31.381811+0000","last_fullsized":"2024-09-21T22:19:31.381811+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'616","last_scrub_stamp":"2024-09-21T22:19:31.381675+0000","last_deep_scrub":"204'616","last_deep_scrub_stamp":"2024-09-21T22:19:31.381675+0000","last_clean_scrub_stamp":"2024-09-21T22:19:31.381675+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:15:48.537820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00091566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2721,"num_read_kb":25046,"num_write":713,"num_write_kb":20808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":6821687,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"204'395","reported_seq":2616,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:25.601274+0000","last_change":"2024-09-21T22:19:25.601299+0000","last_active":"2024-09-21T22:19:25.601274+0000","last_peered":"2024-09-21T22:19:25.601274+0000","last_clean":"2024-09-21T22:19:25.601274+0000","last_became_active":"2024-09-21T22:15:36.447769+0000","last_became_peered":"2024-09-21T22:15:36.447769+0000","last_unstale":"2024-09-21T22:19:25.601274+0000","last_undegraded":"2024-09-21T22:19:25.601274+0000","last_fullsized":"2024-09-21T22:19:25.601274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'395","last_scrub_stamp":"2024-09-21T22:19:25.601185+0000","last_deep_scrub":"204'395","last_deep_scrub_stamp":"2024-09-21T22:19:25.601185+0000","last_clean_scrub_stamp":"2024-09-21T22:19:25.601185+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:53.287398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000444289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1512,"num_read_kb":34000,"num_write":405,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"207'713","reported_seq":2518,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:30.382396+0000","last_change":"2024-09-21T22:19:30.382426+0000","last_active":"2024-09-21T22:19:30.382396+0000","last_peered":"2024-09-21T22:19:30.382396+0000","last_clean":"2024-09-21T22:19:30.382396+0000","last_became_active":"2024-09-21T22:18:11.908431+0000","last_became_peered":"2024-09-21T22:18:11.908431+0000","last_unstale":"2024-09-21T22:19:30.382396+0000","last_undegraded":"2024-09-21T22:19:30.382396+0000","last_fullsized":"2024-09-21T22:19:30.382396+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'713","last_scrub_stamp":"2024-09-21T22:19:30.382284+0000","last_deep_scrub":"207'713","last_deep_scrub_stamp":"2024-09-21T22:19:30.382284+0000","last_clean_scrub_stamp":"2024-09-21T22:19:30.382284+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:36:16.007020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328402,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2744,"num_read_kb":23657,"num_write":999,"num_write_kb":20986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":24358480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"204'591","reported_seq":7448,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:28.230468+0000","last_change":"2024-09-21T22:19:28.230494+0000","last_active":"2024-09-21T22:19:28.230468+0000","last_peered":"2024-09-21T22:19:28.230468+0000","last_clean":"2024-09-21T22:19:28.230468+0000","last_became_active":"2024-09-21T22:19:03.070891+0000","last_became_peered":"2024-09-21T22:19:03.070891+0000","last_unstale":"2024-09-21T22:19:28.230468+0000","last_undegraded":"2024-09-21T22:19:28.230468+0000","last_fullsized":"2024-09-21T22:19:28.230468+0000","mapping_epoch":218,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":219,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'591","last_scrub_stamp":"2024-09-21T22:19:28.230362+0000","last_deep_scrub":"204'591","last_deep_scrub_stamp":"2024-09-21T22:19:28.230362+0000","last_clean_scrub_stamp":"2024-09-21T22:19:28.230362+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:37:01.138213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011971970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7207,"num_read_kb":25556,"num_write":687,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":49,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"207'699","reported_seq":12600,"reported_epoch":232,"state":"active+clean","last_fresh":"2024-09-21T22:19:29.352833+0000","last_change":"2024-09-21T22:19:29.352856+0000","last_active":"2024-09-21T22:19:29.352833+0000","last_peered":"2024-09-21T22:19:29.352833+0000","last_clean":"2024-09-21T22:19:29.352833+0000","last_became_active":"2024-09-21T22:16:48.957138+0000","last_became_peered":"2024-09-21T22:16:48.957138+0000","last_unstale":"2024-09-21T22:19:29.352833+0000","last_undegraded":"2024-09-21T22:19:29.352833+0000","last_fullsized":"2024-09-21T22:19:29.352833+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'699","last_scrub_stamp":"2024-09-21T22:19:29.352738+0000","last_deep_scrub":"207'699","last_deep_scrub_stamp":"2024-09-21T22:19:29.352738+0000","last_clean_scrub_stamp":"2024-09-21T22:19:29.352738+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:19:16.132185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0023131530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12442,"num_read_kb":63756,"num_write":866,"num_write_kb":28856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12504385,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216012,"num_read_kb":1301047,"num_write":27793,"num_write_kb":882127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1909,"num_bytes_recovered":166190737,"num_keys_recovered":223,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21671,"ondisk_log_size":21671,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78924,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292916,"statfs":{"total":96636764160,"available":96555945984,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29768,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342072,"statfs":{"total":96636764160,"available":96606281728,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74188,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297652,"statfs":{"total":96636764160,"available":96560795648,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74188,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297652,"statfs":{"total":96636764160,"available":96560795648,"internally_reserved":0,"allocated":2813952,"data_stored":1388727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":45,"seq":193273528367,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57224,"kb_used_data":2744,"kb_used_omap":4,"kb_used_meta":54459,"kb_avail":94314616,"statfs":{"total":96636764160,"available":96578166784,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4430,"internal_metadata":55766706},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42248,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329592,"statfs":{"total":96636764160,"available":96593502208,"internally_reserved":0,"allocated":2809856,"data_stored":1388708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33936,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337904,"statfs":{"total":96636764160,"available":96602013696,"internally_reserved":0,"allocated":2818048,"data_stored":1388746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70604,"kb_used_data":3324,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301236,"statfs":{"total":96636764160,"available":96564465664,"internally_reserved":0,"allocated":3403776,"data_stored":1979076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:19:46.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T22:19:46.747 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T22:19:46.747 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T22:19:46.747 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T22:19:46.747 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:46.788 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T22:19:46.788 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T22:19:46.788 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:46.862 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T22:19:46.862 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T22:19:46.862 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:46.937 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T22:19:46.938 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T22:19:46.938 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.016 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T22:19:47.016 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T22:19:47.016 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.059 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T22:19:47.060 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T22:19:47.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.099 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T22:19:47.099 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T22:19:47.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.181 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T22:19:47.182 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T22:19:47.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.220 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T22:19:47.220 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T22:19:47.220 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T22:19:47.220 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.246 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T22:19:47.246 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T22:19:47.246 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.287 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T22:19:47.288 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T22:19:47.288 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T22:19:47.288 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.300 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T22:19:47.300 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T22:19:47.300 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.351 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T22:19:47.351 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T22:19:47.352 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:19:47.364 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T22:19:47.364 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T22:19:47.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-21T22:19:47.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:19:47.431 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T22:19:47.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:19:47.605 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T22:19:47.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:19:47.722 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T22:19:47.787 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:19:47.787 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T22:19:47.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:19:47.848 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T22:19:47.952 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:19:47.952 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T22:19:48.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:19:48.038 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T22:19:48.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:19:48.086 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T22:19:48.145 INFO:tasks.ceph:Archiving mon data... 2024-09-21T22:19:48.146 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/data/mon.a.tgz 2024-09-21T22:19:48.146 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-21T22:19:48.161 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.h2nqao2KvV 2024-09-21T22:19:48.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.h2nqao2KvV 2024-09-21T22:19:48.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.h2nqao2KvV 2024-09-21T22:19:48.414 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.h2nqao2KvV is 464KB 2024-09-21T22:19:48.483 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.h2nqao2KvV 2024-09-21T22:19:48.498 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/data/mon.c.tgz 2024-09-21T22:19:48.498 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-21T22:19:48.553 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.HkIXR00Mcl 2024-09-21T22:19:48.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HkIXR00Mcl 2024-09-21T22:19:48.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.HkIXR00Mcl 2024-09-21T22:19:48.831 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.HkIXR00Mcl is 619KB 2024-09-21T22:19:48.902 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.HkIXR00Mcl 2024-09-21T22:19:48.917 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/data/mon.b.tgz 2024-09-21T22:19:48.917 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T22:19:48.936 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.SCuV0mWUob 2024-09-21T22:19:48.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SCuV0mWUob 2024-09-21T22:19:49.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.SCuV0mWUob 2024-09-21T22:19:49.225 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.SCuV0mWUob is 619KB 2024-09-21T22:19:49.324 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.SCuV0mWUob 2024-09-21T22:19:49.339 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T22:19:49.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T22:19:49.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T22:19:49.420 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T22:19:49.458 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T22:19:49.458 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T22:19:49.460 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/remote/smithi134/crash 2024-09-21T22:19:49.460 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T22:19:49.486 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/remote/smithi149/crash 2024-09-21T22:19:49.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T22:19:49.521 INFO:tasks.ceph:Compressing logs... 2024-09-21T22:19:49.521 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T22:19:49.531 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T22:19:49.554 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T22:19:49.554 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62526.log 2024-09-21T22:19:49.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40469.log 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33320.log 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33360.log 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33456.log 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33320.log.gz 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33360.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33360.log.gz 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33456.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33456.log.gz 2024-09-21T22:19:49.604 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33496.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33616.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33496.log.gz 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33616.log.gz 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33536.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33416.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33536.log.gz 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33576.log 2024-09-21T22:19:49.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33416.log.gz 2024-09-21T22:19:49.606 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33576.log.gz 2024-09-21T22:19:49.606 INFO:teuthology.orchestra.run.smithi149.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T22:19:49.677 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-09-21T22:19:49.677 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62526.log.gz 2024-09-21T22:19:49.677 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40469.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.54306.log 2024-09-21T22:19:49.677 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40469.log.gz 2024-09-21T22:19:49.677 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70590.log 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59380.log/var/log/ceph/ceph-client.admin.54306.log: 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54306.log.gz 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70590.log.gz 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63504.log 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59380.log.gz 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40755.log 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58116.log 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63504.log.gz 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40755.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40755.log.gz 2024-09-21T22:19:49.678 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60676.log 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70588.log 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58116.log.gz 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71726.log 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60676.log.gz 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70588.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.70588.log.gz -- 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.51458.log 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71726.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.71726.log.gz --verbose 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.49721.log 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39713.log 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51458.log.gz 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60530.log 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49721.log.gz 2024-09-21T22:19:49.679 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50137.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39713.log.gz 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51084.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60530.log.gz 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39433.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50137.log.gz 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70017.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51084.log.gz 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58941.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39433.log.gz 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70017.log.gz 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66212.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70349.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58941.log.gz 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66212.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.42544.log 2024-09-21T22:19:49.680 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66212.log.gz 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71222.log 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70349.log.gz 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/objectstore_tool.42544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39728.log 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71222.log.gz 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65243.log 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39728.log.gz 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27094.log 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39429.log 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65243.log.gz 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.tmp-client.admin.27094.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27094.log.gz 2024-09-21T22:19:49.681 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56571.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69794.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39429.log.gz 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56571.log.gz 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68149.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67310.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69794.log.gz 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68149.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68595.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68149.log.gz 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40087.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67310.log.gz 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68595.log.gz 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70337.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67732.log 2024-09-21T22:19:49.682 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40087.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56091.log 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70337.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64208.log 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67732.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62485.log 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56091.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60115.log 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64208.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62485.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68513.log 95.1% 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/objectstore_tool.42544.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60115.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68513.log.gz 2024-09-21T22:19:49.683 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68656.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66272.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68656.log.gz 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66031.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40301.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66272.log.gz 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66031.log.gz 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54346.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67671.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40301.log.gz 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54346.log.gz 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71516.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50700.log 2024-09-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67671.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51685.log 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71516.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50700.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70886.log 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70589.log 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51685.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70886.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61441.log 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65491.log 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70589.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61441.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60135.log 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62104.log 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65491.log.gz 2024-09-21T22:19:49.685 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60135.log.gz 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39116.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62104.log.gz 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40044.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69542.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39116.log.gz 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40044.log.gz 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55968.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40667.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69542.log.gz 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55968.log.gz 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66913.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.40667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2024-09-21T22:19:49.686 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66913.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39769.log 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57877.log 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39769.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40667.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39769.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69332.log 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58900.log 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57877.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66533.log 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69332.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58900.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66130.log 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55785.log 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66533.log.gz 2024-09-21T22:19:49.687 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66130.log.gz 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48823.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45460.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55785.log.gz 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48823.log.gz 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49860.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54870.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45460.log.gz 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49860.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.49860.log.gz -5 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69033.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67987.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54870.log.gz 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69033.log.gz 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47790.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69626.log 2024-09-21T22:19:49.688 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67987.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47790.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48498.log 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71054.log 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69626.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48498.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45581.log 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69458.log 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71054.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45581.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65573.log 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69458.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2024-09-21T22:19:49.689 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61321.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65573.log.gz 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54224.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61321.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61321.log.gz -5 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39718.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54224.log.gz 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39718.log.gz 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56050.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68991.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56050.log.gz 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70014.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60531.log 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68991.log.gz 2024-09-21T22:19:49.690 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70014.log.gz 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60995.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59719.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60531.log.gz 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60995.log.gz 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40511.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58639.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59719.log.gz 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57517.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40511.log.gz 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69075.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58639.log.gz 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57517.log.gz 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70018.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61080.log 2024-09-21T22:19:49.691 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69075.log.gz 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70018.log.gz 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63347.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71810.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61080.log.gz 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63347.log.gz 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39426.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62403.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71810.log.gz 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39426.log.gz 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65119.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62403.log.gz 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gzgzip 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39729.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51541.log 2024-09-21T22:19:49.692 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65119.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39729.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39723.log 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40427.log 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51541.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39431.log 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39723.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64772.log 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39431.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64772.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.64772.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-09-21T22:19:49.693 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49082.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39251.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71934.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49082.log.gz 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68308.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39251.log.gz 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71934.log.gz 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69668.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65613.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68308.log.gz 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69668.log.gz 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62964.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63646.log 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65613.log.gz 2024-09-21T22:19:49.694 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54731.log 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62964.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63646.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.63646.log.gz /var/log/ceph/ceph-client.admin.64710.log 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53941.log 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54731.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54828.log 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64710.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53941.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48114.log 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43346.log 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54828.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64066.log 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48114.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43346.log.gz 2024-09-21T22:19:49.695 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40553.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68129.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64066.log.gz 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40553.log.gz 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52819.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63743.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68129.log.gz 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52819.log.gz 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70015.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48115.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63743.log.gz 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64249.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70015.log.gz 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46078.log 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48115.log.gz 2024-09-21T22:19:49.696 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39167.log 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64249.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46078.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59338.log 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68657.log 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39167.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59338.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70354.log 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68657.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70354.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65751.log 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65751.log.gz 2024-09-21T22:19:49.697 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57135.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59776.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57135.log.gz 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70684.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59776.log.gz 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40385.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70684.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70684.log.gz -5 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62266.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40385.log.gz 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56871.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70688.log 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62266.log.gz 2024-09-21T22:19:49.698 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46706.log 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56871.log.gz 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68907.log 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70688.log.gz 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69710.log 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46706.log.gz 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39209.log 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68907.log.gz 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69710.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.69710.log.gz 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53532.log 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39209.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.41507.log 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39209.log.gz 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71852.log 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53532.log.gz 2024-09-21T22:19:49.699 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/objectstore_tool.41507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55054.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62824.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71852.log.gz 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55054.log.gz 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61582.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62824.log.gz 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64876.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61582.log.gz 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39768.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53701.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64876.log.gz 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39768.log.gz 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52176.log 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53701.log.gz 2024-09-21T22:19:49.700 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40038.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58435.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52176.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64612.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40038.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53660.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58435.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33244.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64612.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53660.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54771.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33244.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49762.log 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2024-09-21T22:19:49.701 INFO:teuthology.orchestra.run.smithi134.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.41507.log.gz 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53759.log 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54771.log.gz 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49762.log.gz 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66872.log 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53759.log.gz 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65869.log 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66872.log.gz 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41151.log 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55570.log 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65869.log.gz 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70340.log 2024-09-21T22:19:49.702 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41151.log.gz 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55570.log.gz 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67890.log 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70689.log 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70340.log.gz 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67890.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.67890.log.gz -5 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52642.log 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70348.log 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70689.log.gz 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52642.log.gz 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51478.log 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69206.log 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70348.log.gz 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70352.log 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51478.log.gz 2024-09-21T22:19:49.703 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59159.log 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69206.log.gz 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71432.log 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70352.log.gz 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69164.log 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59159.log.gz 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71432.log.gz 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57092.log 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61666.log 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69164.log.gz 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47932.log 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57092.log.gz 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69248.log 2024-09-21T22:19:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61666.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47932.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47932.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62871.log 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69248.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68801.log 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40127.log 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62871.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57734.log 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68801.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40045.log 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40127.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57258.log 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57734.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40045.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40045.log.gz 2024-09-21T22:19:49.705 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52403.log 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57258.log.gz 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68865.log 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40753.log 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52403.log.gz 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68865.log.gz 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57050.log 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40753.log.gz 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58378.log 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gz 2024-09-21T22:19:49.706 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39965.log 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57050.log.gz 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71600.log 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58378.log.gz 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39965.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.39965.log.gz -- 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.54083.log 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71600.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71600.log.gz 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49382.log 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54083.log.gz 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71306.log 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49382.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49382.log.gz 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.71138.log 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71306.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71306.log.gz 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.65367.log 2024-09-21T22:19:49.707 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71138.log.gz 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66011.log 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65367.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65367.log.gz 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63103.log 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66011.log.gz 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69122.log 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63103.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63103.log.gz 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69122.log.gz 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71012.log 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70690.log 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71012.log.gz 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51062.log 2024-09-21T22:19:49.708 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70690.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70690.log.gz 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49012.log 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51062.log.gz 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49342.log 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49012.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.66971.log 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49012.log.gz 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63804.log 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49342.log.gz 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66971.log: /var/log/ceph/ceph-client.admin.50285.log 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66971.log.gz 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr:gzip/var/log/ceph/ceph-client.admin.63804.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63804.log.gz 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.61381.log 2024-09-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50285.log.gz 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52881.log 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61381.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61381.log.gz 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65305.log 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52881.log: 28.0% -- replaced with /var/log/ceph/ceph-client.admin.52881.log.gz 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52800.log 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65305.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53938.log 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65305.log.gz 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60996.log 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52800.log.gz 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53938.log: /var/log/ceph/ceph-client.admin.44343.log 2024-09-21T22:19:49.710 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53938.log.gz 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60996.log: -- /var/log/ceph/ceph-client.admin.39721.log 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60996.log.gz 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44343.log.gz 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70011.log 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39721.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.60454.log 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70011.log.gz 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61159.log 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60454.log.gz 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61159.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70009.log 2024-09-21T22:19:49.711 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61159.log.gz 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57944.log 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55252.log 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70009.log.gz 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57944.log.gz 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68949.log 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55252.log.gz 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56313.log 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51841.log 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68949.log.gz 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56313.log.gz 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52178.log 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51841.log.gz 2024-09-21T22:19:49.712 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64792.log 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70343.log 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52178.log.gz 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64792.log.gz 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57816.log 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70343.log.gz 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59516.log 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57816.log.gz 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59516.log.gz 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66456.log 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71348.log 2024-09-21T22:19:49.713 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33325.log 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66456.log.gz 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71348.log.gz 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40085.log 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.33325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33325.log.gz 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48597.log 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45385.log 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40085.log.gz 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48597.log.gz 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52062.log 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45385.log.gz 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69500.log 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55211.log 2024-09-21T22:19:49.714 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52062.log.gz 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69500.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54547.log 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55211.log.gz 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54547.log: 28.5% -- replaced with /var/log/ceph/ceph-client.admin.54547.log.gz 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32930.log 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55529.log 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.32930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32930.log.gz 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56191.log 2024-09-21T22:19:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56191.log: /var/log/ceph/ceph-client.admin.55529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55529.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56191.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39432.log 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40754.log 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39432.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40615.log 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70928.log 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40615.log: /var/log/ceph/ceph-client.admin.40754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40754.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40615.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71264.log 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61060.log 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70928.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71264.log.gz 2024-09-21T22:19:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50002.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39430.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50002.log: /var/log/ceph/ceph-client.admin.61060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61060.log.gz 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50002.log.gz 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58455.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39035.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39430.log.gz 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58455.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70012.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61727.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39035.log: /var/log/ceph/ceph-client.admin.70012.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39035.log.gz 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70012.log.gz 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52460.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71558.log 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61727.log.gz 2024-09-21T22:19:49.717 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.52460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52460.log.gz 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65057.log 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54160.log 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65057.log: /var/log/ceph/ceph-client.admin.71558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71558.log.gz 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65057.log.gz 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62943.log 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38882.log 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54160.log.gz 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.62943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62943.log.gz 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58039.log 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.44381.log 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58039.log: /var/log/ceph/ceph-client.admin.38882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38882.log.gz 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58039.log.gz 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63905.log 2024-09-21T22:19:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69752.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/objectstore_tool.44381.log: /var/log/ceph/ceph-client.admin.63905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63905.log.gz 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71390.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69752.log.gz 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71894.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71390.log.gz 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39425.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71894.log.gz 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56530.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39425.log.gz 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56530.log.gz 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63865.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56931.log 2024-09-21T22:19:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63865.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55669.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56931.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60595.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.55669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55669.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.44381.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39423.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70686.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60595.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.39423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54689.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69290.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54689.log: /var/log/ceph/ceph-client.admin.70686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70686.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54689.log.gz 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69374.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40043.log 2024-09-21T22:19:49.720 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69290.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69374.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49142.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53200.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49142.log: /var/log/ceph/ceph-client.admin.40043.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49142.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40043.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58538.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53200.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42430.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53200.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59179.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58538.log: /var/log/ceph/ceph-client.admin.42430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58538.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42430.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65181.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.43400.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59179.log.gz 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65181.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69836.log 2024-09-21T22:19:49.721 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T22:19:49.722 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69416.log 2024-09-21T22:19:49.722 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/objectstore_tool.43400.log: /var/log/ceph/ceph-client.admin.69836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69836.log.gz 2024-09-21T22:19:49.722 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64471.log 2024-09-21T22:19:49.722 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69416.log.gz 2024-09-21T22:19:49.722 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48135.log 2024-09-21T22:19:49.722 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64471.log.gz 2024-09-21T22:19:49.739 INFO:teuthology.orchestra.run.smithi149.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2024-09-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48135.log.gz 2024-09-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2024-09-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2024-09-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57435.log 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64975.log 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57435.log.gz 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48376.log 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64975.log.gz 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66634.log 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48376.log.gz 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40343.log 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.66634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66634.log.gz 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49424.log 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.40343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40343.log.gz 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63205.log 2024-09-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49424.log.gz 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53180.log 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.43400.log.gz 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.63205.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62047.log 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63205.log.gz 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58722.log 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.53180.log: /var/log/ceph/ceph-client.admin.62047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53180.log.gz 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62047.log.gz 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71096.log 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45779.log 2024-09-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.58722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58722.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71096.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47551.log 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59937.log 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45779.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47551.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70353.log 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61845.log 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.59937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59937.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70353.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48925.log 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71768.log 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61845.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48925.log.gz 2024-09-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65429.log 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56789.log 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71768.log.gz 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.65429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65429.log.gz 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50803.log 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56789.log.gz 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51361.log 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50382.log 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50803.log: 28.9% -- replaced with /var/log/ceph/ceph-client.admin.50803.log.gz 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.51361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51361.log.gz 2024-09-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57674.log 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56133.log 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.50382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50382.log.gz 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.57674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57674.log.gz 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47468.log 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56133.log.gz 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.49262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67193.log 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54345.log/var/log/ceph/ceph-client.admin.47468.log: 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47468.log.gz 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67193.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.54345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67193.log.gz 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54345.log.gz 2024-09-21T22:19:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71474.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.46779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67489.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71474.log.gz 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71642.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.67489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67489.log.gz 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41376.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71642.log.gz 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64327.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41376.log.gz 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56998.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64327.log.gz 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71684.log 2024-09-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.56998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56998.log.gz 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41094.log 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71684.log.gz 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64307.log 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41094.log.gz 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61624.log 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64307.log.gz 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71180.log 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.61624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61624.log.gz 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64854.log 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.71180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71180.log.gz 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68328.log 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.64854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64854.log.gz 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68781.log 2024-09-21T22:19:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68328.log.gz 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70016.log 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.68781.log: 92.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68781.log.gz 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70970.log 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.70016.log: -- /var/log/ceph/ceph-client.admin.69584.log 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70016.log.gz 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.70970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60774.log 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.69584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70970.log.gz 0.0% 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69584.log.gz 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67352.log 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.60774.log: 0.0%/var/log/ceph/ceph-client.admin.67352.log: -- replaced with /var/log/ceph/ceph-client.admin.60774.log.gz 2024-09-21T22:19:49.756 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67352.log.gz 2024-09-21T22:19:49.799 INFO:teuthology.orchestra.run.smithi134.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T22:19:49.987 INFO:teuthology.orchestra.run.smithi134.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T22:19:50.027 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T22:19:50.890 INFO:teuthology.orchestra.run.smithi149.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T22:19:51.310 INFO:teuthology.orchestra.run.smithi149.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T22:19:52.424 INFO:teuthology.orchestra.run.smithi149.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T22:19:52.722 INFO:teuthology.orchestra.run.smithi149.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T22:19:52.724 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-09-21T22:19:52.724 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m3.143s 2024-09-21T22:19:52.724 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m8.762s 2024-09-21T22:19:52.724 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.381s 2024-09-21T22:19:54.135 INFO:teuthology.orchestra.run.smithi134.stderr: 96.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T22:19:54.244 INFO:teuthology.orchestra.run.smithi134.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T22:19:55.603 INFO:teuthology.orchestra.run.smithi134.stderr: 96.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T22:19:55.604 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T22:19:55.605 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m6.061s 2024-09-21T22:19:55.605 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m15.694s 2024-09-21T22:19:55.605 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.834s 2024-09-21T22:19:55.605 INFO:tasks.ceph:Archiving logs... 2024-09-21T22:19:55.606 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/remote/smithi134/log 2024-09-21T22:19:55.607 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T22:19:57.614 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/remote/smithi149/log 2024-09-21T22:19:57.615 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T22:19:58.757 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T22:19:58.767 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T22:19:58.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T22:19:58.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T22:19:58.846 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T22:19:58.857 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T22:19:58.857 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T22:19:58.859 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T22:19:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-21T22:19:58.875 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T22:19:58.879 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T22:19:58.879 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T22:19:58.879 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 14 +396us[ +396us] +/- 65ms 2024-09-21T22:19:58.879 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -1596us[-1600us] +/- 62ms 2024-09-21T22:19:58.879 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +1405us[+1402us] +/- 68ms 2024-09-21T22:19:58.879 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:19:58.880 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T22:19:58.880 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-21T22:19:58.880 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 13 +385us[ +385us] +/- 65ms 2024-09-21T22:19:58.880 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -1619us[-1625us] +/- 62ms 2024-09-21T22:19:58.880 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +1390us[+1390us] +/- 68ms 2024-09-21T22:19:58.881 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:19:58.881 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T22:19:58.900 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T22:19:58.900 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T22:19:58.953 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T22:19:59.042 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T22:19:59.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T22:19:59.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:19:59.151 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T22:19:59.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:19:59.180 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T22:19:59.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T22:19:59.231 INFO:teuthology.task.internal:Duration was 705.544088 seconds 2024-09-21T22:19:59.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T22:19:59.293 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T22:19:59.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T22:19:59.295 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T22:19:59.333 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T22:19:59.334 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T22:19:59.657 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T22:19:59.658 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T22:19:59.658 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T22:19:59.678 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T22:19:59.679 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T22:19:59.720 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T22:19:59.720 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T22:19:59.723 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T22:19:59.787 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T22:19:59.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T22:19:59.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T22:19:59.948 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T22:19:59.957 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T22:19:59.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T22:19:59.982 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T22:20:00.011 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T22:20:00.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:20:00.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:20:00.046 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-21T22:20:00.075 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-21T22:20:00.114 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:20:00.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:20:00.168 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:20:00.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:20:00.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T22:20:00.192 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T22:20:00.193 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/remote/smithi134 2024-09-21T22:20:00.193 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T22:20:00.248 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914464/remote/smithi149 2024-09-21T22:20:00.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T22:20:00.282 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T22:20:00.282 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T22:20:00.284 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T22:20:00.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T22:20:00.348 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T22:20:00.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T22:20:00.410 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T22:20:00.410 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T22:20:00.412 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T22:20:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 22:20 /home/ubuntu/cephtest 2024-09-21T22:20:00.427 INFO:teuthology.orchestra.run.smithi149.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 22:20 /home/ubuntu/cephtest 2024-09-21T22:20:00.428 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T22:20:00.448 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T22:20:00.516 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} duration: 705.5440878868103 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-21T22:20:00.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T22:20:00.587 INFO:teuthology.run:pass